Aug 17 18:12:04 user nova-compute[72874]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 17 18:12:06 user nova-compute[72874]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72874) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 18:12:06 user nova-compute[72874]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72874) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 18:12:06 user nova-compute[72874]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72874) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 18:12:06 user nova-compute[72874]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:12:07 user nova-compute[72874]: INFO nova.virt.driver [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 17 18:12:07 user nova-compute[72874]: INFO nova.compute.provider_config [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] Acquiring lock "singleton_lock" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] Acquired lock "singleton_lock" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] Releasing lock "singleton_lock" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] Full set of CONF: {{(pid=72874) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ******************************************************************************** {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] Configuration options gathered from: {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ================================================================================ {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] allow_resize_to_same_host      = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] arq_binding_timeout            = 300 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] backdoor_port                  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] backdoor_socket                = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] block_device_allocate_retries  = 300 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] block_device_allocate_retries_interval = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cert                           = self.pem {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] compute_monitors               = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] config_dir                     = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] config_drive_format            = iso9660 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] config_source                  = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] console_host                   = user {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] control_exchange               = nova {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cpu_allocation_ratio           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] daemon                         = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] debug                          = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] default_access_ip_network_name = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] default_availability_zone      = nova {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] default_ephemeral_format       = ext4 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] default_schedule_zone          = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] disk_allocation_ratio          = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] enable_new_services            = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] enabled_apis                   = ['osapi_compute'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] enabled_ssl_apis               = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] flat_injected                  = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] force_config_drive             = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] force_raw_images               = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] graceful_shutdown_timeout      = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] heal_instance_info_cache_interval = 60 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] host                           = user {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] instance_build_timeout         = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] instance_delete_interval       = 300 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] instance_format                = [instance: %(uuid)s]  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] instance_name_template         = instance-%08x {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] instance_usage_audit           = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] instance_usage_audit_period    = month {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] internal_service_availability_zone = internal {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] key                            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] live_migration_retry_count     = 30 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] log_config_append              = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] log_dir                        = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] log_file                       = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] log_options                    = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] log_rotate_interval            = 1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] log_rotate_interval_type       = days {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] log_rotation_type              = none {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] long_rpc_timeout               = 1800 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] max_concurrent_builds          = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] max_concurrent_live_migrations = 1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] max_concurrent_snapshots       = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] max_local_block_devices        = 3 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] max_logfile_count              = 30 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] max_logfile_size_mb            = 200 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] maximum_instance_delete_attempts = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] metadata_listen                = 0.0.0.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] metadata_listen_port           = 8775 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] metadata_workers               = 3 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] migrate_max_retries            = -1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] mkisofs_cmd                    = genisoimage {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] my_ip                          = 10.0.0.210 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] network_allocate_retries       = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] osapi_compute_listen_port      = 8774 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] osapi_compute_unique_server_name_scope =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] osapi_compute_workers          = 3 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] password_length                = 12 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] periodic_enable                = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] periodic_fuzzy_delay           = 60 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] pointer_model                  = ps2mouse {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] preallocate_images             = none {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] publish_errors                 = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] pybasedir                      = /opt/stack/nova {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ram_allocation_ratio           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] rate_limit_burst               = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] rate_limit_except_level        = CRITICAL {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] rate_limit_interval            = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] reboot_timeout                 = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] reclaim_instance_interval      = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] record                         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] reimage_timeout_per_gb         = 60 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] report_interval                = 120 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] rescue_timeout                 = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] reserved_host_cpus             = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] reserved_host_disk_mb          = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] reserved_host_memory_mb        = 512 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] reserved_huge_pages            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] resize_confirm_window          = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] resize_fs_using_block_device   = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] resume_guests_state_on_host_boot = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] rpc_response_timeout           = 60 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] run_external_periodic_tasks    = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] running_deleted_instance_action = reap {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] running_deleted_instance_poll_interval = 1800 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] running_deleted_instance_timeout = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] scheduler_instance_sync_interval = 120 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] service_down_time              = 720 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] servicegroup_driver            = db {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] shelved_offload_time           = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] shelved_poll_interval          = 3600 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] shutdown_timeout               = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] source_is_ipv6                 = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ssl_only                       = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] state_path                     = /opt/stack/data/nova {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] sync_power_state_interval      = 600 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] sync_power_state_pool_size     = 1000 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] syslog_log_facility            = LOG_USER {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] tempdir                        = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] timeout_nbd                    = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] transport_url                  = **** {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] update_resources_interval      = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] use_cow_images                 = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] use_eventlog                   = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] use_journal                    = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] use_json                       = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] use_rootwrap_daemon            = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] use_stderr                     = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] use_syslog                     = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vcpu_pin_set                   = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vif_plugging_is_fatal          = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vif_plugging_timeout           = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] virt_mkfs                      = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] volume_usage_poll_interval     = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] watch_log_file                 = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] web                            = /usr/share/spice-html5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_concurrency.disable_process_locking = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.auth_strategy              = keystone {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.compute_link_prefix        = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.dhcp_domain                = novalocal {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.enable_instance_password   = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.glance_link_prefix         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.instance_list_per_project_cells = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.list_records_by_skipping_down_cells = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.local_metadata_per_cell    = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.max_limit                  = 1000 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.metadata_cache_expiration  = 15 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.neutron_default_tenant_id  = default {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.use_forwarded_for          = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.use_neutron_default_nets   = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.vendordata_dynamic_targets = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.vendordata_jsonfile_path   = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.backend                  = dogpile.cache.memcached {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.backend_argument         = **** {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.config_prefix            = cache.oslo {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.dead_timeout             = 60.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.debug_cache_backend      = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.enable_retry_client      = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.enable_socket_keepalive  = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.enabled                  = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.expiration_time          = 600 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.hashclient_retry_attempts = 2 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.memcache_dead_retry      = 300 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.memcache_password        =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.memcache_pool_maxsize    = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.memcache_sasl_enabled    = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.memcache_username        =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.proxies                  = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.retry_attempts           = 2 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.retry_delay              = 0.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.socket_keepalive_count   = 1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.socket_keepalive_idle    = 1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.socket_keepalive_interval = 1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.tls_allowed_ciphers      = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.tls_cafile               = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.tls_certfile             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.tls_enabled              = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cache.tls_keyfile              = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cinder.auth_section            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cinder.auth_type               = password {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cinder.cafile                  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cinder.certfile                = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cinder.collect_timing          = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cinder.cross_az_attach         = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cinder.debug                   = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cinder.endpoint_template       = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cinder.http_retries            = 3 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cinder.insecure                = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cinder.keyfile                 = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cinder.os_region_name          = RegionOne {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cinder.split_loggers           = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cinder.timeout                 = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] compute.cpu_dedicated_set      = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] compute.cpu_shared_set         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] compute.image_type_exclude_list = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] compute.max_concurrent_disk_ops = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] compute.max_disk_devices_to_attach = -1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] compute.resource_provider_association_refresh = 300 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] compute.shutdown_retry_interval = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] conductor.workers              = 3 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] console.allowed_origins        = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] console.ssl_ciphers            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] console.ssl_minimum_version    = default {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] consoleauth.token_ttl          = 600 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.cafile                  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.certfile                = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.collect_timing          = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.connect_retries         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.connect_retry_delay     = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.endpoint_override       = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.insecure                = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.keyfile                 = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.max_version             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.min_version             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.region_name             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.service_name            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.service_type            = accelerator {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.split_loggers           = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.status_code_retries     = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.status_code_retry_delay = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.timeout                 = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] cyborg.version                 = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.backend               = sqlalchemy {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.connection            = **** {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.connection_debug      = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.connection_parameters =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.connection_recycle_time = 3600 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.connection_trace      = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.db_inc_retry_interval = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.db_max_retries        = 20 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.db_max_retry_interval = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.db_retry_interval     = 1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.max_overflow          = 50 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.max_pool_size         = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.max_retries           = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.mysql_enable_ndb      = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.mysql_wsrep_sync_wait = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.pool_timeout          = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.retry_interval        = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.slave_connection      = **** {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] database.sqlite_synchronous    = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.backend           = sqlalchemy {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.connection        = **** {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.connection_debug  = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.connection_parameters =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.connection_recycle_time = 3600 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.connection_trace  = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.db_inc_retry_interval = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.db_max_retries    = 20 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.db_max_retry_interval = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.db_retry_interval = 1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.max_overflow      = 50 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.max_pool_size     = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.max_retries       = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.mysql_enable_ndb  = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.pool_timeout      = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.retry_interval    = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.slave_connection  = **** {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] api_database.sqlite_synchronous = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] devices.enabled_mdev_types     = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ephemeral_storage_encryption.enabled = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.api_servers             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.cafile                  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.certfile                = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.collect_timing          = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.connect_retries         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.connect_retry_delay     = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.debug                   = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.default_trusted_certificate_ids = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.enable_certificate_validation = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.enable_rbd_download     = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.endpoint_override       = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.insecure                = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.keyfile                 = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.max_version             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.min_version             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.num_retries             = 3 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.rbd_ceph_conf           =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.rbd_connect_timeout     = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.rbd_pool                =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.rbd_user                =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.region_name             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.service_name            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.service_type            = image {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.split_loggers           = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.status_code_retries     = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.status_code_retry_delay = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.timeout                 = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.verify_glance_signatures = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] glance.version                 = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] guestfs.debug                  = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.config_drive_cdrom      = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.config_drive_inject_password = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.enable_instance_metrics_collection = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.enable_remotefx         = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.instances_path_share    =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.iscsi_initiator_list    = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.limit_cpu_features      = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.power_state_check_timeframe = 60 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.use_multipath_io        = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.volume_attach_retry_count = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.vswitch_name            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] mks.enabled                    = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] image_cache.manager_interval   = 2400 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] image_cache.precache_concurrency = 1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] image_cache.remove_unused_base_images = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] image_cache.subdirectory_name  = _base {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.api_max_retries         = 60 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.api_retry_interval      = 2 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.auth_section            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.auth_type               = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.cafile                  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.certfile                = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.collect_timing          = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.connect_retries         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.connect_retry_delay     = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.endpoint_override       = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.insecure                = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.keyfile                 = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.max_version             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.min_version             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.partition_key           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.peer_list               = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.region_name             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.serial_console_state_timeout = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.service_name            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.service_type            = baremetal {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.split_loggers           = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.status_code_retries     = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.status_code_retry_delay = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.timeout                 = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ironic.version                 = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] key_manager.fixed_key          = **** {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.barbican_api_version  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.barbican_endpoint     = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.barbican_endpoint_type = public {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.barbican_region_name  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.cafile                = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.certfile              = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.collect_timing        = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.insecure              = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.keyfile               = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.number_of_retries     = 60 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.retry_delay           = 1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.send_service_user_token = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.split_loggers         = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.timeout               = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.verify_ssl            = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican.verify_ssl_path       = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican_service_user.auth_section = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican_service_user.auth_type = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican_service_user.cafile   = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican_service_user.certfile = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican_service_user.collect_timing = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican_service_user.insecure = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican_service_user.keyfile  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican_service_user.split_loggers = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] barbican_service_user.timeout  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vault.approle_role_id          = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vault.approle_secret_id        = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vault.cafile                   = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vault.certfile                 = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vault.collect_timing           = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vault.insecure                 = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vault.keyfile                  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vault.kv_mountpoint            = secret {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vault.kv_version               = 2 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vault.namespace                = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vault.root_token_id            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vault.split_loggers            = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vault.ssl_ca_crt_file          = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vault.timeout                  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vault.use_ssl                  = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.cafile                = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.certfile              = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.collect_timing        = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.connect_retries       = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.connect_retry_delay   = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.endpoint_override     = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.insecure              = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.keyfile               = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.max_version           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.min_version           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.region_name           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.service_name          = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.service_type          = identity {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.split_loggers         = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.status_code_retries   = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.status_code_retry_delay = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.timeout               = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] keystone.version               = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.connection_uri         =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.cpu_mode               = custom {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: WARNING oslo_config.cfg [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.cpu_power_governor_high = performance {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.cpu_power_governor_low = powersave {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.cpu_power_management   = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.device_detach_attempts = 8 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.device_detach_timeout  = 20 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.disk_cachemodes        = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.disk_prefix            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.enabled_perf_events    = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.file_backed_memory     = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.gid_maps               = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.hw_disk_discard        = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.hw_machine_type        = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.images_rbd_glance_store_name =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.images_rbd_pool        = rbd {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.images_type            = default {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.images_volume_group    = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.inject_key             = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.inject_partition       = -2 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.inject_password        = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.iscsi_iface            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.iser_use_multipath     = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.live_migration_bandwidth = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.live_migration_downtime = 500 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.live_migration_inbound_addr = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.live_migration_permit_post_copy = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.live_migration_scheme  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.live_migration_timeout_action = abort {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.live_migration_tunnelled = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: WARNING oslo_config.cfg [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 17 18:12:07 user nova-compute[72874]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 17 18:12:07 user nova-compute[72874]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 17 18:12:07 user nova-compute[72874]: and ``live_migration_inbound_addr`` respectively.
Aug 17 18:12:07 user nova-compute[72874]: ).  Its value may be silently ignored in the future.
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.live_migration_with_native_tls = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.max_queues             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.nfs_mount_options      = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.num_memory_encrypted_guests = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.num_pcie_ports         = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.pmem_namespaces        = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.quobyte_client_cfg     = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.rbd_secret_uuid        = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.rbd_user               = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.remote_filesystem_transport = ssh {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.rescue_image_id        = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.rescue_kernel_id       = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.rescue_ramdisk_id      = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.rx_queue_size          = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.smbfs_mount_options    =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.snapshot_compression   = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.snapshot_image_format  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.sparse_logical_volumes = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.swtpm_enabled          = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.swtpm_group            = tss {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.swtpm_user             = tss {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.sysinfo_serial         = unique {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.tb_cache_size          = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.tx_queue_size          = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.uid_maps               = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.use_virtio_for_bridges = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.virt_type              = kvm {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.volume_clear           = zero {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.volume_clear_size      = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.volume_use_multipath   = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.vzstorage_cache_path   = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.vzstorage_mount_user   = stack {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.auth_section           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.auth_type              = password {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.cafile                 = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.certfile               = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.collect_timing         = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.connect_retries        = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.connect_retry_delay    = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.default_floating_pool  = public {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.endpoint_override      = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.extension_sync_interval = 600 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.http_retries           = 3 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.insecure               = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.keyfile                = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.max_version            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.min_version            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.ovs_bridge             = br-int {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.physnets               = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.region_name            = RegionOne {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.service_metadata_proxy = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.service_name           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.service_type           = network {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.split_loggers          = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.status_code_retries    = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.status_code_retry_delay = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.timeout                = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] neutron.version                = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] notifications.bdms_in_notifications = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] notifications.default_level    = INFO {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] notifications.notification_format = unversioned {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] notifications.notify_on_state_change = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] pci.alias                      = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] pci.device_spec                = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] pci.report_in_placement        = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.auth_section         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.auth_type            = password {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.cafile               = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.certfile             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.collect_timing       = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.connect_retries      = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.connect_retry_delay  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.default_domain_id    = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.default_domain_name  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.domain_id            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.domain_name          = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.endpoint_override    = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.insecure             = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.keyfile              = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.max_version          = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.min_version          = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.password             = **** {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.project_domain_id    = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.project_domain_name  = Default {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.project_id           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.project_name         = service {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.region_name          = RegionOne {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.service_name         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.service_type         = placement {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.split_loggers        = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.status_code_retries  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.status_code_retry_delay = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.system_scope         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.timeout              = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.trust_id             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.user_domain_id       = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.user_domain_name     = Default {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.user_id              = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.username             = placement {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] placement.version              = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] quota.cores                    = 20 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] quota.count_usage_from_placement = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] quota.injected_file_content_bytes = 10240 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] quota.injected_file_path_length = 255 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] quota.injected_files           = 5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] quota.instances                = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] quota.key_pairs                = 100 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] quota.metadata_items           = 128 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] quota.ram                      = 51200 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] quota.recheck_quota            = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] quota.server_group_members     = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] quota.server_groups            = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] rdp.enabled                    = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] scheduler.image_metadata_prefilter = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] scheduler.max_attempts         = 3 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] scheduler.max_placement_results = 1000 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] scheduler.query_placement_for_availability_zone = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] scheduler.query_placement_for_image_type_support = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] scheduler.workers              = 3 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.host_subset_size = 1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.isolated_hosts = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.isolated_images = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.pci_in_placement = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.track_instance_changes = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] metrics.required               = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] metrics.weight_multiplier      = 1.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] metrics.weight_setting         = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] serial_console.enabled         = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] serial_console.port_range      = 10000:20000 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] serial_console.serialproxy_port = 6083 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] service_user.auth_section      = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] service_user.auth_type         = password {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] service_user.cafile            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] service_user.certfile          = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] service_user.collect_timing    = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] service_user.insecure          = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] service_user.keyfile           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] service_user.send_service_user_token = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] service_user.split_loggers     = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] service_user.timeout           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] spice.agent_enabled            = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] spice.enabled                  = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] spice.html5proxy_port          = 6082 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] spice.image_compression        = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] spice.jpeg_compression         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] spice.playback_compression     = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] spice.server_listen            = 127.0.0.1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] spice.streaming_mode           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] spice.zlib_compression         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] upgrade_levels.baseapi         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] upgrade_levels.cert            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] upgrade_levels.compute         = auto {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] upgrade_levels.conductor       = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] upgrade_levels.scheduler       = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vendordata_dynamic_auth.auth_section = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vendordata_dynamic_auth.auth_type = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vendordata_dynamic_auth.cafile = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vendordata_dynamic_auth.certfile = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vendordata_dynamic_auth.insecure = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vendordata_dynamic_auth.keyfile = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vendordata_dynamic_auth.timeout = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.api_retry_count         = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.ca_file                 = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.cache_prefix            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.cluster_name            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.connection_pool_size    = 10 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.console_delay_seconds   = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.datastore_regex         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.host_ip                 = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.host_password           = **** {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.host_port               = 443 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.host_username           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.insecure                = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.integration_bridge      = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.maximum_objects         = 100 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.pbm_default_policy      = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.pbm_enabled             = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.pbm_wsdl_location       = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.serial_port_proxy_uri   = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.serial_port_service_uri = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.task_poll_interval      = 0.5 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.use_linked_clone        = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.vnc_keymap              = en-us {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.vnc_port                = 5900 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vmware.vnc_port_total          = 10000 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vnc.auth_schemes               = ['none'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vnc.enabled                    = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vnc.novncproxy_port            = 6080 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vnc.server_listen              = 0.0.0.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vnc.vencrypt_ca_certs          = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vnc.vencrypt_client_cert       = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vnc.vencrypt_client_key        = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.disable_rootwrap   = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.enable_numa_live_migration = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.libvirt_disable_apic = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] wsgi.client_socket_timeout     = 900 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] wsgi.default_pool_size         = 1000 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] wsgi.keep_alive                = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] wsgi.max_header_line           = 16384 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] wsgi.ssl_ca_file               = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] wsgi.ssl_cert_file             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] wsgi.ssl_key_file              = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] wsgi.tcp_keepidle              = 600 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] zvm.ca_file                    = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] zvm.cloud_connector_url        = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] zvm.reachable_timeout          = 300 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_policy.enforce_new_defaults = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_policy.enforce_scope      = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_policy.policy_default_rule = default {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_policy.policy_file        = policy.yaml {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] profiler.connection_string     = messaging:// {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] profiler.enabled               = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] profiler.es_doc_type           = notification {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] profiler.es_scroll_size        = 10000 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] profiler.es_scroll_time        = 2m {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] profiler.filter_error_trace    = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] profiler.hmac_keys             = **** {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] profiler.sentinel_service_name = mymaster {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] profiler.socket_timeout        = 0.1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] profiler.trace_requests        = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] profiler.trace_sqlalchemy      = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] profiler_jaeger.process_tags   = {} {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] profiler_jaeger.service_name_prefix = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] profiler_otlp.service_name_prefix = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] remote_debug.host              = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] remote_debug.port              = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.ssl      = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_notifications.retry = -1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_messaging_notifications.transport_url = **** {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.auth_section        = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.auth_type           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.cafile              = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.certfile            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.collect_timing      = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.connect_retries     = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.connect_retry_delay = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.endpoint_id         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.endpoint_override   = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.insecure            = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.keyfile             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.max_version         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.min_version         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.region_name         = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.service_name        = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.service_type        = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.split_loggers       = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.status_code_retries = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.status_code_retry_delay = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.timeout             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.valid_interfaces    = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_limit.version             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_reports.file_event_handler = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] oslo_reports.log_dir           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vif_plug_ovs_privileged.group  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] vif_plug_ovs_privileged.user   = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] os_vif_linux_bridge.flat_interface = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] os_vif_ovs.isolate_vif         = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] os_vif_ovs.per_port_bridge     = False {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] os_brick.lock_path             = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] privsep_osbrick.capabilities   = [21] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] privsep_osbrick.group          = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] privsep_osbrick.helper_command = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] privsep_osbrick.user           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] nova_sys_admin.group           = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] nova_sys_admin.helper_command  = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] nova_sys_admin.user            = None {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG oslo_service.service [None req-34c525bb-ed95-4333-a900-ab9a6ee7622f None None] ******************************************************************************** {{(pid=72874) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 17 18:12:07 user nova-compute[72874]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 17 18:12:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Starting native event thread {{(pid=72874) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Starting green dispatch thread {{(pid=72874) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Starting connection event dispatch thread {{(pid=72874) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Connecting to libvirt: qemu:///system {{(pid=72874) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fc6e71f4eb0> {{(pid=72874) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 17 18:12:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fc6e71f4eb0> {{(pid=72874) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 17 18:12:07 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Connection event '1' reason 'None'
Aug 17 18:12:07 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 18:12:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.mount [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Initialising _HostMountState generation 0 {{(pid=72874) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 17 18:12:15 user nova-compute[72874]: INFO nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Libvirt host capabilities <capabilities>
Aug 17 18:12:15 user nova-compute[72874]:   <host>
Aug 17 18:12:15 user nova-compute[72874]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 17 18:12:15 user nova-compute[72874]:     <cpu>
Aug 17 18:12:15 user nova-compute[72874]:       <arch>x86_64</arch>
Aug 17 18:12:15 user nova-compute[72874]:       <model>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <vendor>Intel</vendor>
Aug 17 18:12:15 user nova-compute[72874]:       <microcode version='1070'/>
Aug 17 18:12:15 user nova-compute[72874]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 17 18:12:15 user nova-compute[72874]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature name='ss'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature name='vmx'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature name='pcid'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature name='osxsave'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature name='hypervisor'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature name='arat'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature name='tsc_adjust'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature name='md-clear'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature name='stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature name='arch-capabilities'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature name='ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature name='invtsc'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature name='rsba'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature name='skip-l1dfl-vmentry'/>
Aug 17 18:12:15 user nova-compute[72874]:       <pages unit='KiB' size='4'/>
Aug 17 18:12:15 user nova-compute[72874]:       <pages unit='KiB' size='2048'/>
Aug 17 18:12:15 user nova-compute[72874]:     </cpu>
Aug 17 18:12:15 user nova-compute[72874]:     <power_management>
Aug 17 18:12:15 user nova-compute[72874]:       <suspend_mem/>
Aug 17 18:12:15 user nova-compute[72874]:       <suspend_disk/>
Aug 17 18:12:15 user nova-compute[72874]:       <suspend_hybrid/>
Aug 17 18:12:15 user nova-compute[72874]:     </power_management>
Aug 17 18:12:15 user nova-compute[72874]:     <iommu support='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     <migration_features>
Aug 17 18:12:15 user nova-compute[72874]:       <live/>
Aug 17 18:12:15 user nova-compute[72874]:       <uri_transports>
Aug 17 18:12:15 user nova-compute[72874]:         <uri_transport>tcp</uri_transport>
Aug 17 18:12:15 user nova-compute[72874]:         <uri_transport>rdma</uri_transport>
Aug 17 18:12:15 user nova-compute[72874]:       </uri_transports>
Aug 17 18:12:15 user nova-compute[72874]:     </migration_features>
Aug 17 18:12:15 user nova-compute[72874]:     <topology>
Aug 17 18:12:15 user nova-compute[72874]:       <cells num='2'>
Aug 17 18:12:15 user nova-compute[72874]:         <cell id='0'>
Aug 17 18:12:15 user nova-compute[72874]:           <memory unit='KiB'>8189224</memory>
Aug 17 18:12:15 user nova-compute[72874]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 17 18:12:15 user nova-compute[72874]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 18:12:15 user nova-compute[72874]:           <distances>
Aug 17 18:12:15 user nova-compute[72874]:             <sibling id='0' value='10'/>
Aug 17 18:12:15 user nova-compute[72874]:             <sibling id='1' value='20'/>
Aug 17 18:12:15 user nova-compute[72874]:           </distances>
Aug 17 18:12:15 user nova-compute[72874]:           <cpus num='6'>
Aug 17 18:12:15 user nova-compute[72874]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 17 18:12:15 user nova-compute[72874]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 17 18:12:15 user nova-compute[72874]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 17 18:12:15 user nova-compute[72874]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 17 18:12:15 user nova-compute[72874]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 17 18:12:15 user nova-compute[72874]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 17 18:12:15 user nova-compute[72874]:           </cpus>
Aug 17 18:12:15 user nova-compute[72874]:         </cell>
Aug 17 18:12:15 user nova-compute[72874]:         <cell id='1'>
Aug 17 18:12:15 user nova-compute[72874]:           <memory unit='KiB'>8206460</memory>
Aug 17 18:12:15 user nova-compute[72874]:           <pages unit='KiB' size='4'>2051615</pages>
Aug 17 18:12:15 user nova-compute[72874]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 18:12:15 user nova-compute[72874]:           <distances>
Aug 17 18:12:15 user nova-compute[72874]:             <sibling id='0' value='20'/>
Aug 17 18:12:15 user nova-compute[72874]:             <sibling id='1' value='10'/>
Aug 17 18:12:15 user nova-compute[72874]:           </distances>
Aug 17 18:12:15 user nova-compute[72874]:           <cpus num='6'>
Aug 17 18:12:15 user nova-compute[72874]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 17 18:12:15 user nova-compute[72874]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 17 18:12:15 user nova-compute[72874]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 17 18:12:15 user nova-compute[72874]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 17 18:12:15 user nova-compute[72874]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 17 18:12:15 user nova-compute[72874]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 17 18:12:15 user nova-compute[72874]:           </cpus>
Aug 17 18:12:15 user nova-compute[72874]:         </cell>
Aug 17 18:12:15 user nova-compute[72874]:       </cells>
Aug 17 18:12:15 user nova-compute[72874]:     </topology>
Aug 17 18:12:15 user nova-compute[72874]:     <cache>
Aug 17 18:12:15 user nova-compute[72874]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 17 18:12:15 user nova-compute[72874]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 17 18:12:15 user nova-compute[72874]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 17 18:12:15 user nova-compute[72874]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 17 18:12:15 user nova-compute[72874]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 17 18:12:15 user nova-compute[72874]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 17 18:12:15 user nova-compute[72874]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 17 18:12:15 user nova-compute[72874]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 17 18:12:15 user nova-compute[72874]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 17 18:12:15 user nova-compute[72874]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 17 18:12:15 user nova-compute[72874]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 17 18:12:15 user nova-compute[72874]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 17 18:12:15 user nova-compute[72874]:     </cache>
Aug 17 18:12:15 user nova-compute[72874]:     <secmodel>
Aug 17 18:12:15 user nova-compute[72874]:       <model>apparmor</model>
Aug 17 18:12:15 user nova-compute[72874]:       <doi>0</doi>
Aug 17 18:12:15 user nova-compute[72874]:     </secmodel>
Aug 17 18:12:15 user nova-compute[72874]:     <secmodel>
Aug 17 18:12:15 user nova-compute[72874]:       <model>dac</model>
Aug 17 18:12:15 user nova-compute[72874]:       <doi>0</doi>
Aug 17 18:12:15 user nova-compute[72874]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 17 18:12:15 user nova-compute[72874]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 17 18:12:15 user nova-compute[72874]:     </secmodel>
Aug 17 18:12:15 user nova-compute[72874]:   </host>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='alpha'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>64</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>clipper</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='armv6l'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>32</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>spitz</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>nuri</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>kzm</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>sx1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>z2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>tosa</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>n810</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>n800</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>terrier</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>midway</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>microbit</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>verdex</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>highbank</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>akita</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>connex</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>collie</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='armv7l'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>32</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>spitz</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>nuri</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>kzm</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>sx1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>z2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>tosa</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>n810</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>n800</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>terrier</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>midway</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>microbit</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>verdex</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>highbank</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>akita</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>connex</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>collie</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='aarch64'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>64</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>spitz</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>nuri</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>kzm</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>sx1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>z2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>tosa</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>n810</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>n800</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>terrier</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>midway</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>microbit</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>verdex</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>raspi3b</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>highbank</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>akita</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>connex</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>collie</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <acpi default='on' toggle='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='cris'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>32</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='i686'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>32</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>isapc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>microvm</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='kvm'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <pae/>
Aug 17 18:12:15 user nova-compute[72874]:       <nonpae/>
Aug 17 18:12:15 user nova-compute[72874]:       <acpi default='on' toggle='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:       <apic default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='m68k'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>32</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>an5206</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>q800</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>next-cube</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='microblaze'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>32</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='microblazeel'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>32</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='mips'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>32</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='16'>malta</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='mipsel'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>32</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='16'>malta</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='mips64'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>64</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='16'>malta</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>pica61</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>magnum</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='mips64el'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>64</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='16'>malta</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>pica61</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>magnum</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='16'>boston</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='ppc'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>32</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mac99</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>40p</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>taihu</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='ppc64'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>64</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>taihu</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>40p</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mac99</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='ppc64le'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>64</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>taihu</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>40p</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>mac99</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='riscv32'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>32</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='8'>spike</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>opentitan</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='8'>virt</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='riscv64'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>64</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='8'>spike</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>shakti_c</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='8'>virt</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='s390x'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>64</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='sh4'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>32</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>shix</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>r2d</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='sh4eb'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>64</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>shix</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>r2d</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='sparc'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>32</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>SS-5</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>SS-20</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>LX</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>SS-4</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>SS-10</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>Voyager</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='sparc64'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>64</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>sun4u</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>niagara</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>sun4v</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='x86_64'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>64</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='1'>isapc</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>microvm</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='kvm'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <acpi default='on' toggle='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:       <apic default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='xtensa'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>32</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>sim</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>kc705</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>ml605</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>virt</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>lx200</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>lx60</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]:   <guest>
Aug 17 18:12:15 user nova-compute[72874]:     <os_type>hvm</os_type>
Aug 17 18:12:15 user nova-compute[72874]:     <arch name='xtensaeb'>
Aug 17 18:12:15 user nova-compute[72874]:       <wordsize>32</wordsize>
Aug 17 18:12:15 user nova-compute[72874]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='4'>sim</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>kc705</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>ml605</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>virt</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>lx200</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>lx60</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 18:12:15 user nova-compute[72874]:       <domain type='qemu'/>
Aug 17 18:12:15 user nova-compute[72874]:     </arch>
Aug 17 18:12:15 user nova-compute[72874]:     <features>
Aug 17 18:12:15 user nova-compute[72874]:       <cpuselection/>
Aug 17 18:12:15 user nova-compute[72874]:       <deviceboot/>
Aug 17 18:12:15 user nova-compute[72874]:       <disksnapshot default='on' toggle='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     </features>
Aug 17 18:12:15 user nova-compute[72874]:   </guest>
Aug 17 18:12:15 user nova-compute[72874]: </capabilities>
Aug 17 18:12:15 user nova-compute[72874]: 
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 17 18:12:15 user nova-compute[72874]: <domainCapabilities>
Aug 17 18:12:15 user nova-compute[72874]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 18:12:15 user nova-compute[72874]:   <domain>kvm</domain>
Aug 17 18:12:15 user nova-compute[72874]:   <machine>pc-i440fx-6.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:   <arch>i686</arch>
Aug 17 18:12:15 user nova-compute[72874]:   <vcpu max='255'/>
Aug 17 18:12:15 user nova-compute[72874]:   <iothreads supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:   <os supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:     <enum name='firmware'/>
Aug 17 18:12:15 user nova-compute[72874]:     <loader supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='type'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>rom</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>pflash</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='readonly'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>yes</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>no</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='secure'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>no</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </loader>
Aug 17 18:12:15 user nova-compute[72874]:   </os>
Aug 17 18:12:15 user nova-compute[72874]:   <cpu>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='host-passthrough' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='hostPassthroughMigratable'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>off</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='maximum' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='maximumMigratable'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>on</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>off</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='host-model' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <vendor>Intel</vendor>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ss'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='vmx'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='pcid'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='hypervisor'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='arat'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='umip'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='md-clear'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ibpb'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ibrs'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='amd-stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='erms'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='lm'/>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='custom' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>qemu64</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>qemu32</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>phenom</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium3</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium2</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>n270</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>kvm64</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>kvm32</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>coreduo</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>core2duo</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>athlon</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Westmere</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Snowridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>SandyBridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Penryn</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G5</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G4</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G3</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G2</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G1</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Nehalem</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>IvyBridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Icelake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-Rome</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-Milan</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Dhyana</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cooperlake</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Conroe</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>486</model>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:   </cpu>
Aug 17 18:12:15 user nova-compute[72874]:   <memoryBacking supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:     <enum name='sourceType'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>file</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>anonymous</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>memfd</value>
Aug 17 18:12:15 user nova-compute[72874]:     </enum>
Aug 17 18:12:15 user nova-compute[72874]:   </memoryBacking>
Aug 17 18:12:15 user nova-compute[72874]:   <devices>
Aug 17 18:12:15 user nova-compute[72874]:     <disk supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='diskDevice'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>disk</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>cdrom</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>floppy</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>lun</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='bus'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>ide</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>fdc</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>scsi</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>usb</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>sata</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-non-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </disk>
Aug 17 18:12:15 user nova-compute[72874]:     <graphics supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='type'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>sdl</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vnc</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>spice</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>egl-headless</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </graphics>
Aug 17 18:12:15 user nova-compute[72874]:     <video supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='modelType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vga</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>cirrus</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vmvga</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>qxl</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>none</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>bochs</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>ramfb</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </video>
Aug 17 18:12:15 user nova-compute[72874]:     <hostdev supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='mode'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>subsystem</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='startupPolicy'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>default</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>mandatory</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>requisite</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>optional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='subsysType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>usb</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>pci</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>scsi</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='capsType'/>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='pciBackend'/>
Aug 17 18:12:15 user nova-compute[72874]:     </hostdev>
Aug 17 18:12:15 user nova-compute[72874]:     <rng supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-non-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='backendModel'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>random</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>egd</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>builtin</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </rng>
Aug 17 18:12:15 user nova-compute[72874]:     <filesystem supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='driverType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>path</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>handle</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtiofs</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </filesystem>
Aug 17 18:12:15 user nova-compute[72874]:     <tpm supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>tpm-tis</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>tpm-crb</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='backendModel'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>passthrough</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>emulator</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </tpm>
Aug 17 18:12:15 user nova-compute[72874]:   </devices>
Aug 17 18:12:15 user nova-compute[72874]:   <features>
Aug 17 18:12:15 user nova-compute[72874]:     <gic supported='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     <vmcoreinfo supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <genid supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <backingStoreInput supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <backup supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <sev supported='no'/>
Aug 17 18:12:15 user nova-compute[72874]:   </features>
Aug 17 18:12:15 user nova-compute[72874]: </domainCapabilities>
Aug 17 18:12:15 user nova-compute[72874]:  {{(pid=72874) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 17 18:12:15 user nova-compute[72874]: <domainCapabilities>
Aug 17 18:12:15 user nova-compute[72874]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 18:12:15 user nova-compute[72874]:   <domain>kvm</domain>
Aug 17 18:12:15 user nova-compute[72874]:   <machine>pc-q35-jammy</machine>
Aug 17 18:12:15 user nova-compute[72874]:   <arch>i686</arch>
Aug 17 18:12:15 user nova-compute[72874]:   <vcpu max='288'/>
Aug 17 18:12:15 user nova-compute[72874]:   <iothreads supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:   <os supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:     <enum name='firmware'/>
Aug 17 18:12:15 user nova-compute[72874]:     <loader supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='type'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>rom</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>pflash</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='readonly'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>yes</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>no</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='secure'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>no</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </loader>
Aug 17 18:12:15 user nova-compute[72874]:   </os>
Aug 17 18:12:15 user nova-compute[72874]:   <cpu>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='host-passthrough' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='hostPassthroughMigratable'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>off</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='maximum' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='maximumMigratable'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>on</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>off</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='host-model' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <vendor>Intel</vendor>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ss'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='vmx'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='pcid'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='hypervisor'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='arat'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='umip'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='md-clear'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ibpb'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ibrs'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='amd-stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='erms'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='lm'/>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='custom' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>qemu64</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>qemu32</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>phenom</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium3</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium2</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>n270</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>kvm64</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>kvm32</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>coreduo</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>core2duo</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>athlon</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Westmere</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Snowridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>SandyBridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Penryn</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G5</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G4</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G3</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G2</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G1</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Nehalem</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>IvyBridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Icelake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-Rome</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-Milan</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Dhyana</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cooperlake</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Conroe</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>486</model>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:   </cpu>
Aug 17 18:12:15 user nova-compute[72874]:   <memoryBacking supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:     <enum name='sourceType'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>file</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>anonymous</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>memfd</value>
Aug 17 18:12:15 user nova-compute[72874]:     </enum>
Aug 17 18:12:15 user nova-compute[72874]:   </memoryBacking>
Aug 17 18:12:15 user nova-compute[72874]:   <devices>
Aug 17 18:12:15 user nova-compute[72874]:     <disk supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='diskDevice'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>disk</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>cdrom</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>floppy</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>lun</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='bus'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>fdc</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>scsi</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>usb</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>sata</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-non-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </disk>
Aug 17 18:12:15 user nova-compute[72874]:     <graphics supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='type'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>sdl</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vnc</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>spice</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>egl-headless</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </graphics>
Aug 17 18:12:15 user nova-compute[72874]:     <video supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='modelType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vga</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>cirrus</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vmvga</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>qxl</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>none</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>bochs</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>ramfb</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </video>
Aug 17 18:12:15 user nova-compute[72874]:     <hostdev supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='mode'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>subsystem</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='startupPolicy'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>default</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>mandatory</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>requisite</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>optional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='subsysType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>usb</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>pci</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>scsi</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='capsType'/>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='pciBackend'/>
Aug 17 18:12:15 user nova-compute[72874]:     </hostdev>
Aug 17 18:12:15 user nova-compute[72874]:     <rng supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-non-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='backendModel'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>random</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>egd</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>builtin</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </rng>
Aug 17 18:12:15 user nova-compute[72874]:     <filesystem supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='driverType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>path</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>handle</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtiofs</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </filesystem>
Aug 17 18:12:15 user nova-compute[72874]:     <tpm supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>tpm-tis</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>tpm-crb</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='backendModel'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>passthrough</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>emulator</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </tpm>
Aug 17 18:12:15 user nova-compute[72874]:   </devices>
Aug 17 18:12:15 user nova-compute[72874]:   <features>
Aug 17 18:12:15 user nova-compute[72874]:     <gic supported='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     <vmcoreinfo supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <genid supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <backingStoreInput supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <backup supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <sev supported='no'/>
Aug 17 18:12:15 user nova-compute[72874]:   </features>
Aug 17 18:12:15 user nova-compute[72874]: </domainCapabilities>
Aug 17 18:12:15 user nova-compute[72874]:  {{(pid=72874) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 17 18:12:15 user nova-compute[72874]: <domainCapabilities>
Aug 17 18:12:15 user nova-compute[72874]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 18:12:15 user nova-compute[72874]:   <domain>kvm</domain>
Aug 17 18:12:15 user nova-compute[72874]:   <machine>pc-q35-6.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:   <arch>i686</arch>
Aug 17 18:12:15 user nova-compute[72874]:   <vcpu max='288'/>
Aug 17 18:12:15 user nova-compute[72874]:   <iothreads supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:   <os supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:     <enum name='firmware'/>
Aug 17 18:12:15 user nova-compute[72874]:     <loader supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='type'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>rom</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>pflash</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='readonly'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>yes</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>no</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='secure'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>no</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </loader>
Aug 17 18:12:15 user nova-compute[72874]:   </os>
Aug 17 18:12:15 user nova-compute[72874]:   <cpu>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='host-passthrough' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='hostPassthroughMigratable'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>off</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='maximum' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='maximumMigratable'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>on</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>off</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='host-model' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <vendor>Intel</vendor>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ss'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='vmx'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='pcid'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='hypervisor'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='arat'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='umip'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='md-clear'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ibpb'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ibrs'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='amd-stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='erms'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='lm'/>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='custom' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>qemu64</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>qemu32</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>phenom</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium3</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium2</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>n270</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>kvm64</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>kvm32</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>coreduo</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>core2duo</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>athlon</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Westmere</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Snowridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>SandyBridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Penryn</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G5</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G4</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G3</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G2</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G1</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Nehalem</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>IvyBridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Icelake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-Rome</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-Milan</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Dhyana</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cooperlake</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Conroe</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>486</model>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:   </cpu>
Aug 17 18:12:15 user nova-compute[72874]:   <memoryBacking supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:     <enum name='sourceType'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>file</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>anonymous</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>memfd</value>
Aug 17 18:12:15 user nova-compute[72874]:     </enum>
Aug 17 18:12:15 user nova-compute[72874]:   </memoryBacking>
Aug 17 18:12:15 user nova-compute[72874]:   <devices>
Aug 17 18:12:15 user nova-compute[72874]:     <disk supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='diskDevice'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>disk</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>cdrom</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>floppy</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>lun</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='bus'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>fdc</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>scsi</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>usb</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>sata</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-non-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </disk>
Aug 17 18:12:15 user nova-compute[72874]:     <graphics supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='type'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>sdl</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vnc</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>spice</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>egl-headless</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </graphics>
Aug 17 18:12:15 user nova-compute[72874]:     <video supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='modelType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vga</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>cirrus</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vmvga</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>qxl</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>none</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>bochs</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>ramfb</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </video>
Aug 17 18:12:15 user nova-compute[72874]:     <hostdev supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='mode'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>subsystem</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='startupPolicy'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>default</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>mandatory</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>requisite</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>optional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='subsysType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>usb</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>pci</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>scsi</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='capsType'/>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='pciBackend'/>
Aug 17 18:12:15 user nova-compute[72874]:     </hostdev>
Aug 17 18:12:15 user nova-compute[72874]:     <rng supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-non-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='backendModel'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>random</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>egd</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>builtin</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </rng>
Aug 17 18:12:15 user nova-compute[72874]:     <filesystem supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='driverType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>path</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>handle</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtiofs</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </filesystem>
Aug 17 18:12:15 user nova-compute[72874]:     <tpm supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>tpm-tis</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>tpm-crb</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='backendModel'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>passthrough</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>emulator</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </tpm>
Aug 17 18:12:15 user nova-compute[72874]:   </devices>
Aug 17 18:12:15 user nova-compute[72874]:   <features>
Aug 17 18:12:15 user nova-compute[72874]:     <gic supported='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     <vmcoreinfo supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <genid supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <backingStoreInput supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <backup supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <sev supported='no'/>
Aug 17 18:12:15 user nova-compute[72874]:   </features>
Aug 17 18:12:15 user nova-compute[72874]: </domainCapabilities>
Aug 17 18:12:15 user nova-compute[72874]:  {{(pid=72874) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 17 18:12:15 user nova-compute[72874]: <domainCapabilities>
Aug 17 18:12:15 user nova-compute[72874]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 18:12:15 user nova-compute[72874]:   <domain>kvm</domain>
Aug 17 18:12:15 user nova-compute[72874]:   <machine>pc-i440fx-jammy</machine>
Aug 17 18:12:15 user nova-compute[72874]:   <arch>i686</arch>
Aug 17 18:12:15 user nova-compute[72874]:   <vcpu max='255'/>
Aug 17 18:12:15 user nova-compute[72874]:   <iothreads supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:   <os supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:     <enum name='firmware'/>
Aug 17 18:12:15 user nova-compute[72874]:     <loader supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='type'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>rom</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>pflash</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='readonly'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>yes</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>no</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='secure'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>no</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </loader>
Aug 17 18:12:15 user nova-compute[72874]:   </os>
Aug 17 18:12:15 user nova-compute[72874]:   <cpu>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='host-passthrough' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='hostPassthroughMigratable'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>off</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='maximum' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='maximumMigratable'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>on</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>off</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='host-model' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <vendor>Intel</vendor>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ss'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='vmx'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='pcid'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='hypervisor'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='arat'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='umip'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='md-clear'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ibpb'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ibrs'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='amd-stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='erms'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='lm'/>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='custom' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>qemu64</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>qemu32</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>phenom</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium3</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium2</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>n270</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>kvm64</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>kvm32</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>coreduo</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>core2duo</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>athlon</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Westmere</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Snowridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>SandyBridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Penryn</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G5</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G4</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G3</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G2</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G1</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Nehalem</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>IvyBridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Icelake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-Rome</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-Milan</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Dhyana</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cooperlake</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Conroe</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>486</model>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:   </cpu>
Aug 17 18:12:15 user nova-compute[72874]:   <memoryBacking supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:     <enum name='sourceType'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>file</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>anonymous</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>memfd</value>
Aug 17 18:12:15 user nova-compute[72874]:     </enum>
Aug 17 18:12:15 user nova-compute[72874]:   </memoryBacking>
Aug 17 18:12:15 user nova-compute[72874]:   <devices>
Aug 17 18:12:15 user nova-compute[72874]:     <disk supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='diskDevice'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>disk</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>cdrom</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>floppy</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>lun</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='bus'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>ide</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>fdc</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>scsi</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>usb</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>sata</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-non-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </disk>
Aug 17 18:12:15 user nova-compute[72874]:     <graphics supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='type'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>sdl</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vnc</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>spice</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>egl-headless</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </graphics>
Aug 17 18:12:15 user nova-compute[72874]:     <video supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='modelType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vga</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>cirrus</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vmvga</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>qxl</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>none</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>bochs</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>ramfb</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </video>
Aug 17 18:12:15 user nova-compute[72874]:     <hostdev supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='mode'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>subsystem</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='startupPolicy'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>default</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>mandatory</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>requisite</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>optional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='subsysType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>usb</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>pci</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>scsi</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='capsType'/>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='pciBackend'/>
Aug 17 18:12:15 user nova-compute[72874]:     </hostdev>
Aug 17 18:12:15 user nova-compute[72874]:     <rng supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-non-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='backendModel'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>random</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>egd</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>builtin</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </rng>
Aug 17 18:12:15 user nova-compute[72874]:     <filesystem supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='driverType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>path</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>handle</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtiofs</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </filesystem>
Aug 17 18:12:15 user nova-compute[72874]:     <tpm supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>tpm-tis</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>tpm-crb</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='backendModel'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>passthrough</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>emulator</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </tpm>
Aug 17 18:12:15 user nova-compute[72874]:   </devices>
Aug 17 18:12:15 user nova-compute[72874]:   <features>
Aug 17 18:12:15 user nova-compute[72874]:     <gic supported='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     <vmcoreinfo supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <genid supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <backingStoreInput supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <backup supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <sev supported='no'/>
Aug 17 18:12:15 user nova-compute[72874]:   </features>
Aug 17 18:12:15 user nova-compute[72874]: </domainCapabilities>
Aug 17 18:12:15 user nova-compute[72874]:  {{(pid=72874) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 17 18:12:15 user nova-compute[72874]: <domainCapabilities>
Aug 17 18:12:15 user nova-compute[72874]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 18:12:15 user nova-compute[72874]:   <domain>kvm</domain>
Aug 17 18:12:15 user nova-compute[72874]:   <machine>pc-i440fx-6.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:   <arch>x86_64</arch>
Aug 17 18:12:15 user nova-compute[72874]:   <vcpu max='255'/>
Aug 17 18:12:15 user nova-compute[72874]:   <iothreads supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:   <os supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:     <enum name='firmware'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>efi</value>
Aug 17 18:12:15 user nova-compute[72874]:     </enum>
Aug 17 18:12:15 user nova-compute[72874]:     <loader supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='type'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>rom</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>pflash</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='readonly'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>yes</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>no</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='secure'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>no</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </loader>
Aug 17 18:12:15 user nova-compute[72874]:   </os>
Aug 17 18:12:15 user nova-compute[72874]:   <cpu>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='host-passthrough' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='hostPassthroughMigratable'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>on</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>off</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='maximum' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='maximumMigratable'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>on</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>off</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='host-model' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <vendor>Intel</vendor>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ss'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='vmx'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='pcid'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='hypervisor'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='arat'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='umip'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='md-clear'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='invtsc'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ibpb'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ibrs'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='amd-stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='rsba'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='erms'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='custom' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>qemu64</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>qemu32</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>phenom</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium3</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium2</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>n270</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>kvm64</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>kvm32</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>coreduo</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>core2duo</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>athlon</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Westmere</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Snowridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>SandyBridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Penryn</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G5</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G4</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G3</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G2</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Opteron_G1</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Nehalem</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>IvyBridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Icelake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-Rome</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-Milan</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Dhyana</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cooperlake</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Conroe</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>486</model>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:   </cpu>
Aug 17 18:12:15 user nova-compute[72874]:   <memoryBacking supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:     <enum name='sourceType'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>file</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>anonymous</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>memfd</value>
Aug 17 18:12:15 user nova-compute[72874]:     </enum>
Aug 17 18:12:15 user nova-compute[72874]:   </memoryBacking>
Aug 17 18:12:15 user nova-compute[72874]:   <devices>
Aug 17 18:12:15 user nova-compute[72874]:     <disk supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='diskDevice'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>disk</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>cdrom</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>floppy</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>lun</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='bus'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>ide</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>fdc</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>scsi</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>usb</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>sata</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-non-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </disk>
Aug 17 18:12:15 user nova-compute[72874]:     <graphics supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='type'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>sdl</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vnc</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>spice</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>egl-headless</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </graphics>
Aug 17 18:12:15 user nova-compute[72874]:     <video supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='modelType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vga</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>cirrus</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vmvga</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>qxl</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>none</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>bochs</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>ramfb</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </video>
Aug 17 18:12:15 user nova-compute[72874]:     <hostdev supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='mode'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>subsystem</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='startupPolicy'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>default</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>mandatory</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>requisite</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>optional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='subsysType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>usb</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>pci</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>scsi</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='capsType'/>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='pciBackend'/>
Aug 17 18:12:15 user nova-compute[72874]:     </hostdev>
Aug 17 18:12:15 user nova-compute[72874]:     <rng supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-non-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='backendModel'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>random</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>egd</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>builtin</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </rng>
Aug 17 18:12:15 user nova-compute[72874]:     <filesystem supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='driverType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>path</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>handle</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtiofs</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </filesystem>
Aug 17 18:12:15 user nova-compute[72874]:     <tpm supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>tpm-tis</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>tpm-crb</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='backendModel'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>passthrough</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>emulator</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </tpm>
Aug 17 18:12:15 user nova-compute[72874]:   </devices>
Aug 17 18:12:15 user nova-compute[72874]:   <features>
Aug 17 18:12:15 user nova-compute[72874]:     <gic supported='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     <vmcoreinfo supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <genid supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <backingStoreInput supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <backup supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <sev supported='no'/>
Aug 17 18:12:15 user nova-compute[72874]:   </features>
Aug 17 18:12:15 user nova-compute[72874]: </domainCapabilities>
Aug 17 18:12:15 user nova-compute[72874]:  {{(pid=72874) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 17 18:12:15 user nova-compute[72874]: <domainCapabilities>
Aug 17 18:12:15 user nova-compute[72874]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 18:12:15 user nova-compute[72874]:   <domain>kvm</domain>
Aug 17 18:12:15 user nova-compute[72874]:   <machine>pc-q35-jammy</machine>
Aug 17 18:12:15 user nova-compute[72874]:   <arch>x86_64</arch>
Aug 17 18:12:15 user nova-compute[72874]:   <vcpu max='288'/>
Aug 17 18:12:15 user nova-compute[72874]:   <iothreads supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:   <os supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:     <enum name='firmware'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>efi</value>
Aug 17 18:12:15 user nova-compute[72874]:     </enum>
Aug 17 18:12:15 user nova-compute[72874]:     <loader supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='type'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>rom</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>pflash</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='readonly'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>yes</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>no</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='secure'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>yes</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>no</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </loader>
Aug 17 18:12:15 user nova-compute[72874]:   </os>
Aug 17 18:12:15 user nova-compute[72874]:   <cpu>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='host-passthrough' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='hostPassthroughMigratable'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>on</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>off</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='maximum' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='maximumMigratable'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>on</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>off</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='host-model' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <vendor>Intel</vendor>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ss'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='vmx'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='pcid'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='hypervisor'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='arat'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='umip'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='md-clear'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='invtsc'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ibpb'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ibrs'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='amd-stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='rsba'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='erms'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='custom' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>qemu64</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>qemu32</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>phenom</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium3</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium2</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>n270</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>kvm64</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>kvm32</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>coreduo</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>core2duo</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>athlon</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Westmere</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Snowridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>SandyBridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Penryn</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G5</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G4</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G3</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G2</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Opteron_G1</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Nehalem</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>IvyBridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Icelake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-Rome</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-Milan</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Dhyana</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cooperlake</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Conroe</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>486</model>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:   </cpu>
Aug 17 18:12:15 user nova-compute[72874]:   <memoryBacking supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:     <enum name='sourceType'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>file</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>anonymous</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>memfd</value>
Aug 17 18:12:15 user nova-compute[72874]:     </enum>
Aug 17 18:12:15 user nova-compute[72874]:   </memoryBacking>
Aug 17 18:12:15 user nova-compute[72874]:   <devices>
Aug 17 18:12:15 user nova-compute[72874]:     <disk supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='diskDevice'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>disk</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>cdrom</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>floppy</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>lun</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='bus'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>fdc</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>scsi</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>usb</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>sata</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-non-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </disk>
Aug 17 18:12:15 user nova-compute[72874]:     <graphics supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='type'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>sdl</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vnc</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>spice</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>egl-headless</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </graphics>
Aug 17 18:12:15 user nova-compute[72874]:     <video supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='modelType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vga</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>cirrus</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vmvga</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>qxl</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>none</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>bochs</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>ramfb</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </video>
Aug 17 18:12:15 user nova-compute[72874]:     <hostdev supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='mode'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>subsystem</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='startupPolicy'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>default</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>mandatory</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>requisite</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>optional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='subsysType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>usb</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>pci</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>scsi</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='capsType'/>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='pciBackend'/>
Aug 17 18:12:15 user nova-compute[72874]:     </hostdev>
Aug 17 18:12:15 user nova-compute[72874]:     <rng supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-non-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='backendModel'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>random</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>egd</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>builtin</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </rng>
Aug 17 18:12:15 user nova-compute[72874]:     <filesystem supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='driverType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>path</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>handle</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtiofs</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </filesystem>
Aug 17 18:12:15 user nova-compute[72874]:     <tpm supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>tpm-tis</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>tpm-crb</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='backendModel'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>passthrough</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>emulator</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </tpm>
Aug 17 18:12:15 user nova-compute[72874]:   </devices>
Aug 17 18:12:15 user nova-compute[72874]:   <features>
Aug 17 18:12:15 user nova-compute[72874]:     <gic supported='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     <vmcoreinfo supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <genid supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <backingStoreInput supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <backup supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <sev supported='no'/>
Aug 17 18:12:15 user nova-compute[72874]:   </features>
Aug 17 18:12:15 user nova-compute[72874]: </domainCapabilities>
Aug 17 18:12:15 user nova-compute[72874]:  {{(pid=72874) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 17 18:12:15 user nova-compute[72874]: <domainCapabilities>
Aug 17 18:12:15 user nova-compute[72874]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 18:12:15 user nova-compute[72874]:   <domain>kvm</domain>
Aug 17 18:12:15 user nova-compute[72874]:   <machine>pc-q35-6.2</machine>
Aug 17 18:12:15 user nova-compute[72874]:   <arch>x86_64</arch>
Aug 17 18:12:15 user nova-compute[72874]:   <vcpu max='288'/>
Aug 17 18:12:15 user nova-compute[72874]:   <iothreads supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:   <os supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:     <enum name='firmware'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>efi</value>
Aug 17 18:12:15 user nova-compute[72874]:     </enum>
Aug 17 18:12:15 user nova-compute[72874]:     <loader supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='type'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>rom</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>pflash</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='readonly'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>yes</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>no</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='secure'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>yes</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>no</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </loader>
Aug 17 18:12:15 user nova-compute[72874]:   </os>
Aug 17 18:12:15 user nova-compute[72874]:   <cpu>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='host-passthrough' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='hostPassthroughMigratable'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>on</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>off</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='maximum' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='maximumMigratable'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>on</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>off</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='host-model' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <vendor>Intel</vendor>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ss'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='vmx'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='pcid'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='hypervisor'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='arat'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='umip'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='md-clear'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='invtsc'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ibpb'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ibrs'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='amd-stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='rsba'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='erms'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='custom' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>qemu64</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>qemu32</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>phenom</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium3</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium2</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>n270</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>kvm64</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>kvm32</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>coreduo</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>core2duo</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>athlon</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Westmere</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Snowridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>SandyBridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Penryn</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G5</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G4</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G3</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G2</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Opteron_G1</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Nehalem</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>IvyBridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Icelake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-Rome</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-Milan</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Dhyana</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cooperlake</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Conroe</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>486</model>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:   </cpu>
Aug 17 18:12:15 user nova-compute[72874]:   <memoryBacking supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:     <enum name='sourceType'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>file</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>anonymous</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>memfd</value>
Aug 17 18:12:15 user nova-compute[72874]:     </enum>
Aug 17 18:12:15 user nova-compute[72874]:   </memoryBacking>
Aug 17 18:12:15 user nova-compute[72874]:   <devices>
Aug 17 18:12:15 user nova-compute[72874]:     <disk supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='diskDevice'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>disk</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>cdrom</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>floppy</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>lun</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='bus'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>fdc</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>scsi</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>usb</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>sata</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-non-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </disk>
Aug 17 18:12:15 user nova-compute[72874]:     <graphics supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='type'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>sdl</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vnc</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>spice</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>egl-headless</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </graphics>
Aug 17 18:12:15 user nova-compute[72874]:     <video supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='modelType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vga</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>cirrus</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vmvga</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>qxl</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>none</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>bochs</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>ramfb</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </video>
Aug 17 18:12:15 user nova-compute[72874]:     <hostdev supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='mode'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>subsystem</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='startupPolicy'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>default</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>mandatory</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>requisite</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>optional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='subsysType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>usb</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>pci</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>scsi</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='capsType'/>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='pciBackend'/>
Aug 17 18:12:15 user nova-compute[72874]:     </hostdev>
Aug 17 18:12:15 user nova-compute[72874]:     <rng supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-non-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='backendModel'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>random</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>egd</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>builtin</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </rng>
Aug 17 18:12:15 user nova-compute[72874]:     <filesystem supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='driverType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>path</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>handle</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtiofs</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </filesystem>
Aug 17 18:12:15 user nova-compute[72874]:     <tpm supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>tpm-tis</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>tpm-crb</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='backendModel'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>passthrough</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>emulator</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </tpm>
Aug 17 18:12:15 user nova-compute[72874]:   </devices>
Aug 17 18:12:15 user nova-compute[72874]:   <features>
Aug 17 18:12:15 user nova-compute[72874]:     <gic supported='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     <vmcoreinfo supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <genid supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <backingStoreInput supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <backup supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <sev supported='no'/>
Aug 17 18:12:15 user nova-compute[72874]:   </features>
Aug 17 18:12:15 user nova-compute[72874]: </domainCapabilities>
Aug 17 18:12:15 user nova-compute[72874]:  {{(pid=72874) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 17 18:12:15 user nova-compute[72874]: <domainCapabilities>
Aug 17 18:12:15 user nova-compute[72874]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 18:12:15 user nova-compute[72874]:   <domain>kvm</domain>
Aug 17 18:12:15 user nova-compute[72874]:   <machine>pc-i440fx-jammy</machine>
Aug 17 18:12:15 user nova-compute[72874]:   <arch>x86_64</arch>
Aug 17 18:12:15 user nova-compute[72874]:   <vcpu max='255'/>
Aug 17 18:12:15 user nova-compute[72874]:   <iothreads supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:   <os supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:     <enum name='firmware'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>efi</value>
Aug 17 18:12:15 user nova-compute[72874]:     </enum>
Aug 17 18:12:15 user nova-compute[72874]:     <loader supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='type'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>rom</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>pflash</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='readonly'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>yes</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>no</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='secure'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>no</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </loader>
Aug 17 18:12:15 user nova-compute[72874]:   </os>
Aug 17 18:12:15 user nova-compute[72874]:   <cpu>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='host-passthrough' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='hostPassthroughMigratable'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>on</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>off</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='maximum' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='maximumMigratable'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>on</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>off</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='host-model' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <vendor>Intel</vendor>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ss'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='vmx'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='pcid'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='hypervisor'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='arat'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='umip'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='md-clear'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='invtsc'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ibpb'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='ibrs'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='amd-stibp'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='rsba'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='erms'/>
Aug 17 18:12:15 user nova-compute[72874]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:     <mode name='custom' supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>qemu64</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>qemu32</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>phenom</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium3</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium2</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>pentium</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>n270</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>kvm64</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>kvm32</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>coreduo</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>core2duo</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>athlon</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Westmere</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Snowridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Skylake-Client</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>SandyBridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Penryn</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G5</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G4</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G3</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Opteron_G2</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Opteron_G1</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Nehalem</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>IvyBridge</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Icelake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Haswell</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-Rome</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-Milan</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>EPYC</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Dhyana</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cooperlake</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>Conroe</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='no'>Broadwell</model>
Aug 17 18:12:15 user nova-compute[72874]:       <model usable='yes'>486</model>
Aug 17 18:12:15 user nova-compute[72874]:     </mode>
Aug 17 18:12:15 user nova-compute[72874]:   </cpu>
Aug 17 18:12:15 user nova-compute[72874]:   <memoryBacking supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:     <enum name='sourceType'>
Aug 17 18:12:15 user nova-compute[72874]:       <value>file</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>anonymous</value>
Aug 17 18:12:15 user nova-compute[72874]:       <value>memfd</value>
Aug 17 18:12:15 user nova-compute[72874]:     </enum>
Aug 17 18:12:15 user nova-compute[72874]:   </memoryBacking>
Aug 17 18:12:15 user nova-compute[72874]:   <devices>
Aug 17 18:12:15 user nova-compute[72874]:     <disk supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='diskDevice'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>disk</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>cdrom</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>floppy</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>lun</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='bus'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>ide</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>fdc</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>scsi</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>usb</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>sata</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-non-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </disk>
Aug 17 18:12:15 user nova-compute[72874]:     <graphics supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='type'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>sdl</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vnc</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>spice</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>egl-headless</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </graphics>
Aug 17 18:12:15 user nova-compute[72874]:     <video supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='modelType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vga</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>cirrus</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>vmvga</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>qxl</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>none</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>bochs</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>ramfb</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </video>
Aug 17 18:12:15 user nova-compute[72874]:     <hostdev supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='mode'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>subsystem</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='startupPolicy'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>default</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>mandatory</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>requisite</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>optional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='subsysType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>usb</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>pci</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>scsi</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='capsType'/>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='pciBackend'/>
Aug 17 18:12:15 user nova-compute[72874]:     </hostdev>
Aug 17 18:12:15 user nova-compute[72874]:     <rng supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtio-non-transitional</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='backendModel'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>random</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>egd</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>builtin</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </rng>
Aug 17 18:12:15 user nova-compute[72874]:     <filesystem supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='driverType'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>path</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>handle</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>virtiofs</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </filesystem>
Aug 17 18:12:15 user nova-compute[72874]:     <tpm supported='yes'>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='model'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>tpm-tis</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>tpm-crb</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:       <enum name='backendModel'>
Aug 17 18:12:15 user nova-compute[72874]:         <value>passthrough</value>
Aug 17 18:12:15 user nova-compute[72874]:         <value>emulator</value>
Aug 17 18:12:15 user nova-compute[72874]:       </enum>
Aug 17 18:12:15 user nova-compute[72874]:     </tpm>
Aug 17 18:12:15 user nova-compute[72874]:   </devices>
Aug 17 18:12:15 user nova-compute[72874]:   <features>
Aug 17 18:12:15 user nova-compute[72874]:     <gic supported='no'/>
Aug 17 18:12:15 user nova-compute[72874]:     <vmcoreinfo supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <genid supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <backingStoreInput supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <backup supported='yes'/>
Aug 17 18:12:15 user nova-compute[72874]:     <sev supported='no'/>
Aug 17 18:12:15 user nova-compute[72874]:   </features>
Aug 17 18:12:15 user nova-compute[72874]: </domainCapabilities>
Aug 17 18:12:15 user nova-compute[72874]:  {{(pid=72874) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72874) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72874) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Checking secure boot support for host arch (x86_64) {{(pid=72874) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Checking secure boot support for host arch (x86_64) {{(pid=72874) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Checking secure boot support for host arch (x86_64) {{(pid=72874) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 18:12:15 user nova-compute[72874]: INFO nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Secure Boot support detected
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] cpu compare xml: <cpu match="exact">
Aug 17 18:12:15 user nova-compute[72874]:   <model>Nehalem</model>
Aug 17 18:12:15 user nova-compute[72874]: </cpu>
Aug 17 18:12:15 user nova-compute[72874]:  {{(pid=72874) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 17 18:12:15 user nova-compute[72874]: INFO nova.virt.node [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Generated node identity b677d836-b01b-4674-8972-53d526f1b5f7
Aug 17 18:12:15 user nova-compute[72874]: INFO nova.virt.node [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Wrote node identity b677d836-b01b-4674-8972-53d526f1b5f7 to /opt/stack/data/nova/compute_id
Aug 17 18:12:15 user nova-compute[72874]: WARNING nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Compute nodes ['b677d836-b01b-4674-8972-53d526f1b5f7'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 17 18:12:15 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 17 18:12:15 user nova-compute[72874]: WARNING nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 18:12:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:12:15 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:12:15 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Hypervisor/Node resource view: name=user free_ram=10864MB free_disk=26.272098541259766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:12:15 user nova-compute[72874]: WARNING nova.compute.resource_tracker [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] No compute node record for user:b677d836-b01b-4674-8972-53d526f1b5f7: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host b677d836-b01b-4674-8972-53d526f1b5f7 could not be found.
Aug 17 18:12:15 user nova-compute[72874]: INFO nova.compute.resource_tracker [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Compute node record created for user:user with uuid: b677d836-b01b-4674-8972-53d526f1b5f7
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:12:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:12:16 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [req-589e5ee7-d187-4ba7-998d-c0dc22bbee86] Created resource provider record via placement API for resource provider with UUID b677d836-b01b-4674-8972-53d526f1b5f7 and name user.
Aug 17 18:12:16 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72874) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 17 18:12:16 user nova-compute[72874]: INFO nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] kernel doesn't support AMD SEV
Aug 17 18:12:16 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Updating inventory in ProviderTree for provider b677d836-b01b-4674-8972-53d526f1b5f7 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 18:12:16 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:12:16 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Libvirt baseline CPU <cpu>
Aug 17 18:12:16 user nova-compute[72874]:   <arch>x86_64</arch>
Aug 17 18:12:16 user nova-compute[72874]:   <model>Nehalem</model>
Aug 17 18:12:16 user nova-compute[72874]:   <vendor>Intel</vendor>
Aug 17 18:12:16 user nova-compute[72874]:   <topology sockets="6" cores="1" threads="1"/>
Aug 17 18:12:16 user nova-compute[72874]: </cpu>
Aug 17 18:12:16 user nova-compute[72874]:  {{(pid=72874) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 17 18:12:16 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Updated inventory for provider b677d836-b01b-4674-8972-53d526f1b5f7 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 17 18:12:16 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Updating resource provider b677d836-b01b-4674-8972-53d526f1b5f7 generation from 0 to 1 during operation: update_inventory {{(pid=72874) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 18:12:16 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Updating inventory in ProviderTree for provider b677d836-b01b-4674-8972-53d526f1b5f7 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 18:12:16 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Updating resource provider b677d836-b01b-4674-8972-53d526f1b5f7 generation from 1 to 2 during operation: update_traits {{(pid=72874) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 18:12:16 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:12:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.682s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:12:16 user nova-compute[72874]: DEBUG nova.service [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Creating RPC server for service compute {{(pid=72874) start /opt/stack/nova/nova/service.py:182}}
Aug 17 18:12:16 user nova-compute[72874]: DEBUG nova.service [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Join ServiceGroup membership for this service compute {{(pid=72874) start /opt/stack/nova/nova/service.py:199}}
Aug 17 18:12:16 user nova-compute[72874]: DEBUG nova.servicegroup.drivers.db [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72874) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 17 18:12:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:12:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Didn't find any instances for network info cache update. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:13:07 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:13:07 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:13:07 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=10244MB free_disk=26.17586898803711GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:13:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.174s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:14:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:14:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:14:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:14:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:14:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:14:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:14:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:14:07 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:14:08 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:14:08 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:14:08 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=10192MB free_disk=26.222026824951172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:14:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:14:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:14:08 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:14:08 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:14:08 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:14:08 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:14:08 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:14:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.141s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:14:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:14:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:14:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:14:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:14:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:14:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Didn't find any instances for network info cache update. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 18:14:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:14:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:14:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:14:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:15:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:15:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:15:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:15:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Didn't find any instances for network info cache update. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:15:09 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:15:09 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:15:09 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=10143MB free_disk=26.00609588623047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:15:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:15:11 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:16:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:16:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:16:09 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:16:09 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:16:09 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=9457MB free_disk=26.029193878173828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:16:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:10 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:16:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:16:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:16:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Didn't find any instances for network info cache update. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 18:16:11 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:16:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:16:12 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:16:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:19 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:16:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:16:19 user nova-compute[72874]: INFO nova.compute.claims [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Claim successful on node user
Aug 17 18:16:19 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:16:19 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:16:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:20 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:16:20 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:16:20 user nova-compute[72874]: DEBUG nova.network.neutron [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:16:20 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:16:20 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:16:20 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:16:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:16:20 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Creating image(s)
Aug 17 18:16:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "/opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "/opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "/opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Acquiring lock "3bf88e4a-ee43-471a-b375-30684f09c3e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:20 user nova-compute[72874]: DEBUG nova.compute.manager [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:16:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22.part --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:21 user nova-compute[72874]: DEBUG nova.policy [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01b47defaba840e1ba8f91603d99caac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20349a873f4ec7a0f72a7d64c636e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:16:21 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:16:21 user nova-compute[72874]: INFO nova.compute.claims [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Claim successful on node user
Aug 17 18:16:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22.part --force-share --output=json" returned: 0 in 0.191s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:21 user nova-compute[72874]: DEBUG nova.virt.images [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] 7fe37517-c232-4d7a-939d-c3edde21bc31 was qcow2, converting to raw {{(pid=72874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 18:16:21 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:16:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22.part /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22.converted {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22.part /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22.converted" returned: 0 in 0.179s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22.converted --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:21 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:16:21 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:16:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:16:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22.converted --force-share --output=json" returned: 0 in 0.224s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.505s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:22 user nova-compute[72874]: INFO oslo.privsep.daemon [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpe2s_8k9m/privsep.sock']
Aug 17 18:16:22 user sudo[82157]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpe2s_8k9m/privsep.sock
Aug 17 18:16:22 user sudo[82157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 18:16:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:16:22 user nova-compute[72874]: DEBUG nova.network.neutron [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:16:22 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:16:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:16:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:16:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:16:22 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Creating image(s)
Aug 17 18:16:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Acquiring lock "/opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "/opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "/opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:22 user nova-compute[72874]: DEBUG nova.policy [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94ac7a3f57014c2594905b75fb46b3c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21222da070874ea8b635ed3178821402', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:16:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "f027045c-d121-45ec-af61-e1a2399c4a43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:16:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.006s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:22 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:16:22 user nova-compute[72874]: INFO nova.compute.claims [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Claim successful on node user
Aug 17 18:16:23 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:16:23 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:16:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:16:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:16:23 user nova-compute[72874]: DEBUG nova.network.neutron [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:16:23 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:16:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:16:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:16:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:16:23 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Creating image(s)
Aug 17 18:16:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "/opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "/opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "/opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:23 user nova-compute[72874]: DEBUG nova.policy [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f824595c9ce4775bc021075a7eb7047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '010744e63b35476d85e61945c50dc586', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:16:23 user sudo[82157]: pam_unix(sudo:session): session closed for user root
Aug 17 18:16:23 user nova-compute[72874]: INFO oslo.privsep.daemon [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Spawned new privsep daemon via rootwrap
Aug 17 18:16:23 user nova-compute[72874]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 18:16:23 user nova-compute[72874]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 18:16:23 user nova-compute[72874]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 17 18:16:23 user nova-compute[72874]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82187
Aug 17 18:16:23 user nova-compute[72874]: WARNING oslo_privsep.priv_context [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] privsep daemon already running
Aug 17 18:16:23 user nova-compute[72874]: WARNING oslo_privsep.priv_context [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] privsep daemon already running
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.194s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.203s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.207s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk 1073741824" returned: 0 in 0.050s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.256s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Successfully created port: 63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Successfully created port: 854fd839-b199-4430-a240-29ab1c0a3700 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.194s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.211s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk 1073741824" returned: 0 in 0.053s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.521s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Cannot resize image /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG nova.objects.instance [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'migration_context' on Instance uuid c27fc8b6-cc8c-426a-859d-04722c569cd4 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Ensure instance console log exists: /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.210s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.210s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk 1073741824" returned: 0 in 0.047s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Cannot resize image /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG nova.objects.instance [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lazy-loading 'migration_context' on Instance uuid 3bf88e4a-ee43-471a-b375-30684f09c3e3 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Ensure instance console log exists: /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.187s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Cannot resize image /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG nova.objects.instance [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lazy-loading 'migration_context' on Instance uuid f027045c-d121-45ec-af61-e1a2399c4a43 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Ensure instance console log exists: /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:26 user nova-compute[72874]: DEBUG nova.network.neutron [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Successfully created port: b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:16:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "b143e572-9116-4dc0-8fc3-ba586b290ddd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:27 user nova-compute[72874]: DEBUG nova.compute.manager [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:16:27 user nova-compute[72874]: DEBUG nova.network.neutron [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Successfully updated port: 63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:16:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:16:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquired lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:16:27 user nova-compute[72874]: DEBUG nova.network.neutron [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:16:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:27 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:16:27 user nova-compute[72874]: INFO nova.compute.claims [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Claim successful on node user
Aug 17 18:16:27 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG nova.network.neutron [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG nova.network.neutron [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:16:28 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:16:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:16:28 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Creating image(s)
Aug 17 18:16:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "/opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "/opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "/opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG nova.policy [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aaaa47a37543427eaa1712d29c419dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa04d3ed68a4542b32e2efeca25222a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG nova.compute.manager [req-a5f2e868-50e9-4a1d-9964-7644958dfb21 req-a7644169-da7c-4466-a5ed-c34794162a2f service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received event network-changed-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG nova.compute.manager [req-a5f2e868-50e9-4a1d-9964-7644958dfb21 req-a7644169-da7c-4466-a5ed-c34794162a2f service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Refreshing instance network info cache due to event network-changed-63ec6fca-872d-4e61-b76a-c39215266088. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a5f2e868-50e9-4a1d-9964-7644958dfb21 req-a7644169-da7c-4466-a5ed-c34794162a2f service nova] Acquiring lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.169s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk 1073741824" returned: 0 in 0.051s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:28 user nova-compute[72874]: DEBUG nova.network.neutron [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Updating instance_info_cache with network_info: [{"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Releasing lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Instance network_info: |[{"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a5f2e868-50e9-4a1d-9964-7644958dfb21 req-a7644169-da7c-4466-a5ed-c34794162a2f service nova] Acquired lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.network.neutron [req-a5f2e868-50e9-4a1d-9964-7644958dfb21 req-a7644169-da7c-4466-a5ed-c34794162a2f service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Refreshing network info cache for port 63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Start _get_guest_xml network_info=[{"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:16:29 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:16:29 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-432713260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-432713260',id=1,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtzSGb/RTg0RRgVw0I27O9/BIQT9JNqUYiaCVzRF/ZiyzbxLbQ3ogj5i0iMmVI1YnyWXTX4BFGtidL7oy3scdKgIgmM9URa5HU3gOM2Lg8cRYOCgIsNeC1jsau2L7myZA==',key_name='tempest-keypair-271521945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c20349a873f4ec7a0f72a7d64c636e4',ramdisk_id='',reservation_id='r-xtamjwzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1376162523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1376162523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b47defaba840e1ba8f91603d99caac',uuid=c27fc8b6-cc8c-426a-859d-04722c569cd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converting VIF {"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:fb:6f,bridge_name='br-int',has_traffic_filtering=True,id=63ec6fca-872d-4e61-b76a-c39215266088,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ec6fca-87') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.objects.instance [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'pci_devices' on Instance uuid c27fc8b6-cc8c-426a-859d-04722c569cd4 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.217s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.network.neutron [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Successfully updated port: 854fd839-b199-4430-a240-29ab1c0a3700 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:16:29 user nova-compute[72874]:   <uuid>c27fc8b6-cc8c-426a-859d-04722c569cd4</uuid>
Aug 17 18:16:29 user nova-compute[72874]:   <name>instance-00000001</name>
Aug 17 18:16:29 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:16:29 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:16:29 user nova-compute[72874]:   <metadata>
Aug 17 18:16:29 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:16:29 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:16:29 user nova-compute[72874]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-432713260</nova:name>
Aug 17 18:16:29 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:16:29</nova:creationTime>
Aug 17 18:16:29 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:16:29 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:16:29 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:16:29 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:16:29 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:16:29 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:16:29 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:16:29 user nova-compute[72874]:       <nova:owner>
Aug 17 18:16:29 user nova-compute[72874]:         <nova:user uuid="01b47defaba840e1ba8f91603d99caac">tempest-AttachVolumeShelveTestJSON-1376162523-project-member</nova:user>
Aug 17 18:16:29 user nova-compute[72874]:         <nova:project uuid="5c20349a873f4ec7a0f72a7d64c636e4">tempest-AttachVolumeShelveTestJSON-1376162523</nova:project>
Aug 17 18:16:29 user nova-compute[72874]:       </nova:owner>
Aug 17 18:16:29 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:16:29 user nova-compute[72874]:       <nova:ports>
Aug 17 18:16:29 user nova-compute[72874]:         <nova:port uuid="63ec6fca-872d-4e61-b76a-c39215266088">
Aug 17 18:16:29 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 18:16:29 user nova-compute[72874]:         </nova:port>
Aug 17 18:16:29 user nova-compute[72874]:       </nova:ports>
Aug 17 18:16:29 user nova-compute[72874]:     </nova:instance>
Aug 17 18:16:29 user nova-compute[72874]:   </metadata>
Aug 17 18:16:29 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:16:29 user nova-compute[72874]:     <system>
Aug 17 18:16:29 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:16:29 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:16:29 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:16:29 user nova-compute[72874]:       <entry name="serial">c27fc8b6-cc8c-426a-859d-04722c569cd4</entry>
Aug 17 18:16:29 user nova-compute[72874]:       <entry name="uuid">c27fc8b6-cc8c-426a-859d-04722c569cd4</entry>
Aug 17 18:16:29 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:16:29 user nova-compute[72874]:     </system>
Aug 17 18:16:29 user nova-compute[72874]:   </sysinfo>
Aug 17 18:16:29 user nova-compute[72874]:   <os>
Aug 17 18:16:29 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:16:29 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:16:29 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:16:29 user nova-compute[72874]:   </os>
Aug 17 18:16:29 user nova-compute[72874]:   <features>
Aug 17 18:16:29 user nova-compute[72874]:     <acpi/>
Aug 17 18:16:29 user nova-compute[72874]:     <apic/>
Aug 17 18:16:29 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:16:29 user nova-compute[72874]:   </features>
Aug 17 18:16:29 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:16:29 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:16:29 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:16:29 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:16:29 user nova-compute[72874]:   </clock>
Aug 17 18:16:29 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:16:29 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:16:29 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:16:29 user nova-compute[72874]:   </cpu>
Aug 17 18:16:29 user nova-compute[72874]:   <devices>
Aug 17 18:16:29 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:16:29 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:16:29 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk"/>
Aug 17 18:16:29 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:16:29 user nova-compute[72874]:     </disk>
Aug 17 18:16:29 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:16:29 user nova-compute[72874]:       <mac address="fa:16:3e:1d:fb:6f"/>
Aug 17 18:16:29 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:16:29 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:16:29 user nova-compute[72874]:       <target dev="tap63ec6fca-87"/>
Aug 17 18:16:29 user nova-compute[72874]:     </interface>
Aug 17 18:16:29 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:16:29 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/console.log" append="off"/>
Aug 17 18:16:29 user nova-compute[72874]:     </serial>
Aug 17 18:16:29 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:16:29 user nova-compute[72874]:     <video>
Aug 17 18:16:29 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:16:29 user nova-compute[72874]:     </video>
Aug 17 18:16:29 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:16:29 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:16:29 user nova-compute[72874]:     </rng>
Aug 17 18:16:29 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:16:29 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:16:29 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:16:29 user nova-compute[72874]:     </memballoon>
Aug 17 18:16:29 user nova-compute[72874]:   </devices>
Aug 17 18:16:29 user nova-compute[72874]: </domain>
Aug 17 18:16:29 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-432713260',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-432713260',id=1,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtzSGb/RTg0RRgVw0I27O9/BIQT9JNqUYiaCVzRF/ZiyzbxLbQ3ogj5i0iMmVI1YnyWXTX4BFGtidL7oy3scdKgIgmM9URa5HU3gOM2Lg8cRYOCgIsNeC1jsau2L7myZA==',key_name='tempest-keypair-271521945',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c20349a873f4ec7a0f72a7d64c636e4',ramdisk_id='',reservation_id='r-xtamjwzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1376162523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1376162523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:16:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b47defaba840e1ba8f91603d99caac',uuid=c27fc8b6-cc8c-426a-859d-04722c569cd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converting VIF {"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:fb:6f,bridge_name='br-int',has_traffic_filtering=True,id=63ec6fca-872d-4e61-b76a-c39215266088,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ec6fca-87') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG os_vif [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:fb:6f,bridge_name='br-int',has_traffic_filtering=True,id=63ec6fca-872d-4e61-b76a-c39215266088,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ec6fca-87') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Created schema index Interface.name {{(pid=72874) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Created schema index Port.name {{(pid=72874) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Created schema index Bridge.name {{(pid=72874) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Acquiring lock "refresh_cache-3bf88e4a-ee43-471a-b375-30684f09c3e3" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Acquired lock "refresh_cache-3bf88e4a-ee43-471a-b375-30684f09c3e3" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.network.neutron [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [POLLOUT] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Cannot resize image /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.objects.instance [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'migration_context' on Instance uuid b143e572-9116-4dc0-8fc3-ba586b290ddd {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:16:29 user nova-compute[72874]: INFO oslo.privsep.daemon [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp66l72vph/privsep.sock']
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Ensure instance console log exists: /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:29 user sudo[82266]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp66l72vph/privsep.sock
Aug 17 18:16:29 user sudo[82266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.network.neutron [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Successfully updated port: b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquired lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.network.neutron [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-7ff89855-b1e6-4dec-be81-f4b021117baf req-13a420f7-221c-49e3-851d-f0e45a379157 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Received event network-changed-854fd839-b199-4430-a240-29ab1c0a3700 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-7ff89855-b1e6-4dec-be81-f4b021117baf req-13a420f7-221c-49e3-851d-f0e45a379157 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Refreshing instance network info cache due to event network-changed-854fd839-b199-4430-a240-29ab1c0a3700. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7ff89855-b1e6-4dec-be81-f4b021117baf req-13a420f7-221c-49e3-851d-f0e45a379157 service nova] Acquiring lock "refresh_cache-3bf88e4a-ee43-471a-b375-30684f09c3e3" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.network.neutron [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-7b7f8902-6bcc-497d-8596-db6e090b9119 req-b3911828-81dc-45be-9f52-f14cd68706b7 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-changed-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-7b7f8902-6bcc-497d-8596-db6e090b9119 req-b3911828-81dc-45be-9f52-f14cd68706b7 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Refreshing instance network info cache due to event network-changed-b3598a27-6f66-4999-8ed8-835ffb3d6cae. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7b7f8902-6bcc-497d-8596-db6e090b9119 req-b3911828-81dc-45be-9f52-f14cd68706b7 service nova] Acquiring lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:16:29 user nova-compute[72874]: DEBUG nova.network.neutron [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.network.neutron [req-a5f2e868-50e9-4a1d-9964-7644958dfb21 req-a7644169-da7c-4466-a5ed-c34794162a2f service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Updated VIF entry in instance network info cache for port 63ec6fca-872d-4e61-b76a-c39215266088. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.network.neutron [req-a5f2e868-50e9-4a1d-9964-7644958dfb21 req-a7644169-da7c-4466-a5ed-c34794162a2f service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Updating instance_info_cache with network_info: [{"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a5f2e868-50e9-4a1d-9964-7644958dfb21 req-a7644169-da7c-4466-a5ed-c34794162a2f service nova] Releasing lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.network.neutron [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updating instance_info_cache with network_info: [{"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Releasing lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.compute.manager [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Instance network_info: |[{"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7b7f8902-6bcc-497d-8596-db6e090b9119 req-b3911828-81dc-45be-9f52-f14cd68706b7 service nova] Acquired lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.network.neutron [req-7b7f8902-6bcc-497d-8596-db6e090b9119 req-b3911828-81dc-45be-9f52-f14cd68706b7 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Refreshing network info cache for port b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Start _get_guest_xml network_info=[{"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:16:30 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:16:30 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1822661416',display_name='tempest-ServerStableDeviceRescueTest-server-1822661416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1822661416',id=3,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOelasHdGoL+Cq5kCerVY3gWowEdYqles28HBqmjG9V1QMXJ5MTrhbBjfmX+uWP1TCA19y7eC/lFWOzs/7uQdIP7uyNX9gKjvHQlPelnMJ6yDDVVohaqn7Usr0KYj2/rw==',key_name='tempest-keypair-1229666427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='010744e63b35476d85e61945c50dc586',ramdisk_id='',reservation_id='r-ie3dxk98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1978576596',owner_user_name='tempest-ServerStableDeviceRescueTest-1978576596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:16:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f824595c9ce4775bc021075a7eb7047',uuid=f027045c-d121-45ec-af61-e1a2399c4a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Converting VIF {"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:ac:00,bridge_name='br-int',has_traffic_filtering=True,id=b3598a27-6f66-4999-8ed8-835ffb3d6cae,network=Network(6d517d31-387e-4eff-a4ec-a4d9b046ff16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3598a27-6f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.objects.instance [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lazy-loading 'pci_devices' on Instance uuid f027045c-d121-45ec-af61-e1a2399c4a43 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:16:30 user nova-compute[72874]:   <uuid>f027045c-d121-45ec-af61-e1a2399c4a43</uuid>
Aug 17 18:16:30 user nova-compute[72874]:   <name>instance-00000003</name>
Aug 17 18:16:30 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:16:30 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:16:30 user nova-compute[72874]:   <metadata>
Aug 17 18:16:30 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:16:30 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:16:30 user nova-compute[72874]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1822661416</nova:name>
Aug 17 18:16:30 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:16:30</nova:creationTime>
Aug 17 18:16:30 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:16:30 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:16:30 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:16:30 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:16:30 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:16:30 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:16:30 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:16:30 user nova-compute[72874]:       <nova:owner>
Aug 17 18:16:30 user nova-compute[72874]:         <nova:user uuid="8f824595c9ce4775bc021075a7eb7047">tempest-ServerStableDeviceRescueTest-1978576596-project-member</nova:user>
Aug 17 18:16:30 user nova-compute[72874]:         <nova:project uuid="010744e63b35476d85e61945c50dc586">tempest-ServerStableDeviceRescueTest-1978576596</nova:project>
Aug 17 18:16:30 user nova-compute[72874]:       </nova:owner>
Aug 17 18:16:30 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:16:30 user nova-compute[72874]:       <nova:ports>
Aug 17 18:16:30 user nova-compute[72874]:         <nova:port uuid="b3598a27-6f66-4999-8ed8-835ffb3d6cae">
Aug 17 18:16:30 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 18:16:30 user nova-compute[72874]:         </nova:port>
Aug 17 18:16:30 user nova-compute[72874]:       </nova:ports>
Aug 17 18:16:30 user nova-compute[72874]:     </nova:instance>
Aug 17 18:16:30 user nova-compute[72874]:   </metadata>
Aug 17 18:16:30 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:16:30 user nova-compute[72874]:     <system>
Aug 17 18:16:30 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:16:30 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:16:30 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:16:30 user nova-compute[72874]:       <entry name="serial">f027045c-d121-45ec-af61-e1a2399c4a43</entry>
Aug 17 18:16:30 user nova-compute[72874]:       <entry name="uuid">f027045c-d121-45ec-af61-e1a2399c4a43</entry>
Aug 17 18:16:30 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:16:30 user nova-compute[72874]:     </system>
Aug 17 18:16:30 user nova-compute[72874]:   </sysinfo>
Aug 17 18:16:30 user nova-compute[72874]:   <os>
Aug 17 18:16:30 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:16:30 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:16:30 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:16:30 user nova-compute[72874]:   </os>
Aug 17 18:16:30 user nova-compute[72874]:   <features>
Aug 17 18:16:30 user nova-compute[72874]:     <acpi/>
Aug 17 18:16:30 user nova-compute[72874]:     <apic/>
Aug 17 18:16:30 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:16:30 user nova-compute[72874]:   </features>
Aug 17 18:16:30 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:16:30 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:16:30 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:16:30 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:16:30 user nova-compute[72874]:   </clock>
Aug 17 18:16:30 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:16:30 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:16:30 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:16:30 user nova-compute[72874]:   </cpu>
Aug 17 18:16:30 user nova-compute[72874]:   <devices>
Aug 17 18:16:30 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:16:30 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:16:30 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk"/>
Aug 17 18:16:30 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:16:30 user nova-compute[72874]:     </disk>
Aug 17 18:16:30 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:16:30 user nova-compute[72874]:       <mac address="fa:16:3e:50:ac:00"/>
Aug 17 18:16:30 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:16:30 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:16:30 user nova-compute[72874]:       <target dev="tapb3598a27-6f"/>
Aug 17 18:16:30 user nova-compute[72874]:     </interface>
Aug 17 18:16:30 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:16:30 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/console.log" append="off"/>
Aug 17 18:16:30 user nova-compute[72874]:     </serial>
Aug 17 18:16:30 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:16:30 user nova-compute[72874]:     <video>
Aug 17 18:16:30 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:16:30 user nova-compute[72874]:     </video>
Aug 17 18:16:30 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:16:30 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:16:30 user nova-compute[72874]:     </rng>
Aug 17 18:16:30 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:16:30 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:16:30 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:16:30 user nova-compute[72874]:     </memballoon>
Aug 17 18:16:30 user nova-compute[72874]:   </devices>
Aug 17 18:16:30 user nova-compute[72874]: </domain>
Aug 17 18:16:30 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1822661416',display_name='tempest-ServerStableDeviceRescueTest-server-1822661416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1822661416',id=3,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOelasHdGoL+Cq5kCerVY3gWowEdYqles28HBqmjG9V1QMXJ5MTrhbBjfmX+uWP1TCA19y7eC/lFWOzs/7uQdIP7uyNX9gKjvHQlPelnMJ6yDDVVohaqn7Usr0KYj2/rw==',key_name='tempest-keypair-1229666427',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='010744e63b35476d85e61945c50dc586',ramdisk_id='',reservation_id='r-ie3dxk98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1978576596',owner_user_name='tempest-ServerStableDeviceRescueTest-1978576596-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:16:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f824595c9ce4775bc021075a7eb7047',uuid=f027045c-d121-45ec-af61-e1a2399c4a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Converting VIF {"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:ac:00,bridge_name='br-int',has_traffic_filtering=True,id=b3598a27-6f66-4999-8ed8-835ffb3d6cae,network=Network(6d517d31-387e-4eff-a4ec-a4d9b046ff16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3598a27-6f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG os_vif [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:ac:00,bridge_name='br-int',has_traffic_filtering=True,id=b3598a27-6f66-4999-8ed8-835ffb3d6cae,network=Network(6d517d31-387e-4eff-a4ec-a4d9b046ff16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3598a27-6f') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.network.neutron [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Updating instance_info_cache with network_info: [{"id": "854fd839-b199-4430-a240-29ab1c0a3700", "address": "fa:16:3e:3d:e8:ab", "network": {"id": "6a1d5756-c29e-4f96-aa83-0ad17d8bb48e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1496281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21222da070874ea8b635ed3178821402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fd839-b1", "ovs_interfaceid": "854fd839-b199-4430-a240-29ab1c0a3700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Releasing lock "refresh_cache-3bf88e4a-ee43-471a-b375-30684f09c3e3" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.compute.manager [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Instance network_info: |[{"id": "854fd839-b199-4430-a240-29ab1c0a3700", "address": "fa:16:3e:3d:e8:ab", "network": {"id": "6a1d5756-c29e-4f96-aa83-0ad17d8bb48e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1496281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21222da070874ea8b635ed3178821402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fd839-b1", "ovs_interfaceid": "854fd839-b199-4430-a240-29ab1c0a3700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7ff89855-b1e6-4dec-be81-f4b021117baf req-13a420f7-221c-49e3-851d-f0e45a379157 service nova] Acquired lock "refresh_cache-3bf88e4a-ee43-471a-b375-30684f09c3e3" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.network.neutron [req-7ff89855-b1e6-4dec-be81-f4b021117baf req-13a420f7-221c-49e3-851d-f0e45a379157 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Refreshing network info cache for port 854fd839-b199-4430-a240-29ab1c0a3700 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Start _get_guest_xml network_info=[{"id": "854fd839-b199-4430-a240-29ab1c0a3700", "address": "fa:16:3e:3d:e8:ab", "network": {"id": "6a1d5756-c29e-4f96-aa83-0ad17d8bb48e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1496281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21222da070874ea8b635ed3178821402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fd839-b1", "ovs_interfaceid": "854fd839-b199-4430-a240-29ab1c0a3700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:16:31 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:16:31 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1668685489',display_name='tempest-DeleteServersTestJSON-server-1668685489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1668685489',id=2,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21222da070874ea8b635ed3178821402',ramdisk_id='',reservation_id='r-fwy00061',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-19213421',owner_user_name='tempest-DeleteServersTestJSON-19213421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:16:22Z,user_data=None,user_id='94ac7a3f57014c2594905b75fb46b3c4',uuid=3bf88e4a-ee43-471a-b375-30684f09c3e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "854fd839-b199-4430-a240-29ab1c0a3700", "address": "fa:16:3e:3d:e8:ab", "network": {"id": "6a1d5756-c29e-4f96-aa83-0ad17d8bb48e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1496281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21222da070874ea8b635ed3178821402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fd839-b1", "ovs_interfaceid": "854fd839-b199-4430-a240-29ab1c0a3700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Converting VIF {"id": "854fd839-b199-4430-a240-29ab1c0a3700", "address": "fa:16:3e:3d:e8:ab", "network": {"id": "6a1d5756-c29e-4f96-aa83-0ad17d8bb48e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1496281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21222da070874ea8b635ed3178821402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fd839-b1", "ovs_interfaceid": "854fd839-b199-4430-a240-29ab1c0a3700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e8:ab,bridge_name='br-int',has_traffic_filtering=True,id=854fd839-b199-4430-a240-29ab1c0a3700,network=Network(6a1d5756-c29e-4f96-aa83-0ad17d8bb48e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fd839-b1') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.objects.instance [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bf88e4a-ee43-471a-b375-30684f09c3e3 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:16:31 user nova-compute[72874]:   <uuid>3bf88e4a-ee43-471a-b375-30684f09c3e3</uuid>
Aug 17 18:16:31 user nova-compute[72874]:   <name>instance-00000002</name>
Aug 17 18:16:31 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:16:31 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:16:31 user nova-compute[72874]:   <metadata>
Aug 17 18:16:31 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:16:31 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:16:31 user nova-compute[72874]:       <nova:name>tempest-DeleteServersTestJSON-server-1668685489</nova:name>
Aug 17 18:16:31 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:16:31</nova:creationTime>
Aug 17 18:16:31 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:16:31 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:16:31 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:16:31 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:16:31 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:16:31 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:16:31 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:16:31 user nova-compute[72874]:       <nova:owner>
Aug 17 18:16:31 user nova-compute[72874]:         <nova:user uuid="94ac7a3f57014c2594905b75fb46b3c4">tempest-DeleteServersTestJSON-19213421-project-member</nova:user>
Aug 17 18:16:31 user nova-compute[72874]:         <nova:project uuid="21222da070874ea8b635ed3178821402">tempest-DeleteServersTestJSON-19213421</nova:project>
Aug 17 18:16:31 user nova-compute[72874]:       </nova:owner>
Aug 17 18:16:31 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:16:31 user nova-compute[72874]:       <nova:ports>
Aug 17 18:16:31 user nova-compute[72874]:         <nova:port uuid="854fd839-b199-4430-a240-29ab1c0a3700">
Aug 17 18:16:31 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 18:16:31 user nova-compute[72874]:         </nova:port>
Aug 17 18:16:31 user nova-compute[72874]:       </nova:ports>
Aug 17 18:16:31 user nova-compute[72874]:     </nova:instance>
Aug 17 18:16:31 user nova-compute[72874]:   </metadata>
Aug 17 18:16:31 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:16:31 user nova-compute[72874]:     <system>
Aug 17 18:16:31 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:16:31 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:16:31 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:16:31 user nova-compute[72874]:       <entry name="serial">3bf88e4a-ee43-471a-b375-30684f09c3e3</entry>
Aug 17 18:16:31 user nova-compute[72874]:       <entry name="uuid">3bf88e4a-ee43-471a-b375-30684f09c3e3</entry>
Aug 17 18:16:31 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:16:31 user nova-compute[72874]:     </system>
Aug 17 18:16:31 user nova-compute[72874]:   </sysinfo>
Aug 17 18:16:31 user nova-compute[72874]:   <os>
Aug 17 18:16:31 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:16:31 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:16:31 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:16:31 user nova-compute[72874]:   </os>
Aug 17 18:16:31 user nova-compute[72874]:   <features>
Aug 17 18:16:31 user nova-compute[72874]:     <acpi/>
Aug 17 18:16:31 user nova-compute[72874]:     <apic/>
Aug 17 18:16:31 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:16:31 user nova-compute[72874]:   </features>
Aug 17 18:16:31 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:16:31 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:16:31 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:16:31 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:16:31 user nova-compute[72874]:   </clock>
Aug 17 18:16:31 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:16:31 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:16:31 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:16:31 user nova-compute[72874]:   </cpu>
Aug 17 18:16:31 user nova-compute[72874]:   <devices>
Aug 17 18:16:31 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:16:31 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:16:31 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk"/>
Aug 17 18:16:31 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:16:31 user nova-compute[72874]:     </disk>
Aug 17 18:16:31 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:16:31 user nova-compute[72874]:       <mac address="fa:16:3e:3d:e8:ab"/>
Aug 17 18:16:31 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:16:31 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:16:31 user nova-compute[72874]:       <target dev="tap854fd839-b1"/>
Aug 17 18:16:31 user nova-compute[72874]:     </interface>
Aug 17 18:16:31 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:16:31 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/console.log" append="off"/>
Aug 17 18:16:31 user nova-compute[72874]:     </serial>
Aug 17 18:16:31 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:16:31 user nova-compute[72874]:     <video>
Aug 17 18:16:31 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:16:31 user nova-compute[72874]:     </video>
Aug 17 18:16:31 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:16:31 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:16:31 user nova-compute[72874]:     </rng>
Aug 17 18:16:31 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:16:31 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:16:31 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:16:31 user nova-compute[72874]:     </memballoon>
Aug 17 18:16:31 user nova-compute[72874]:   </devices>
Aug 17 18:16:31 user nova-compute[72874]: </domain>
Aug 17 18:16:31 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1668685489',display_name='tempest-DeleteServersTestJSON-server-1668685489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1668685489',id=2,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21222da070874ea8b635ed3178821402',ramdisk_id='',reservation_id='r-fwy00061',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-19213421',owner_user_name='tempest-DeleteServersTestJSON-19213421-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:16:22Z,user_data=None,user_id='94ac7a3f57014c2594905b75fb46b3c4',uuid=3bf88e4a-ee43-471a-b375-30684f09c3e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "854fd839-b199-4430-a240-29ab1c0a3700", "address": "fa:16:3e:3d:e8:ab", "network": {"id": "6a1d5756-c29e-4f96-aa83-0ad17d8bb48e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1496281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21222da070874ea8b635ed3178821402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fd839-b1", "ovs_interfaceid": "854fd839-b199-4430-a240-29ab1c0a3700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Converting VIF {"id": "854fd839-b199-4430-a240-29ab1c0a3700", "address": "fa:16:3e:3d:e8:ab", "network": {"id": "6a1d5756-c29e-4f96-aa83-0ad17d8bb48e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1496281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21222da070874ea8b635ed3178821402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fd839-b1", "ovs_interfaceid": "854fd839-b199-4430-a240-29ab1c0a3700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e8:ab,bridge_name='br-int',has_traffic_filtering=True,id=854fd839-b199-4430-a240-29ab1c0a3700,network=Network(6a1d5756-c29e-4f96-aa83-0ad17d8bb48e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fd839-b1') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG os_vif [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e8:ab,bridge_name='br-int',has_traffic_filtering=True,id=854fd839-b199-4430-a240-29ab1c0a3700,network=Network(6a1d5756-c29e-4f96-aa83-0ad17d8bb48e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fd839-b1') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:16:31 user nova-compute[72874]: INFO oslo.privsep.daemon [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Spawned new privsep daemon via rootwrap
Aug 17 18:16:31 user nova-compute[72874]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 18:16:31 user nova-compute[72874]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 18:16:31 user sudo[82266]: pam_unix(sudo:session): session closed for user root
Aug 17 18:16:31 user nova-compute[72874]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 17 18:16:31 user nova-compute[72874]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82280
Aug 17 18:16:31 user nova-compute[72874]: WARNING oslo_privsep.priv_context [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] privsep daemon already running
Aug 17 18:16:31 user nova-compute[72874]: WARNING oslo_privsep.priv_context [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] privsep daemon already running
Aug 17 18:16:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3598a27-6f, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3598a27-6f, col_values=(('external_ids', {'iface-id': 'b3598a27-6f66-4999-8ed8-835ffb3d6cae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:ac:00', 'vm-uuid': 'f027045c-d121-45ec-af61-e1a2399c4a43'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:32 user nova-compute[72874]: INFO os_vif [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:ac:00,bridge_name='br-int',has_traffic_filtering=True,id=b3598a27-6f66-4999-8ed8-835ffb3d6cae,network=Network(6d517d31-387e-4eff-a4ec-a4d9b046ff16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3598a27-6f')
Aug 17 18:16:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63ec6fca-87, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63ec6fca-87, col_values=(('external_ids', {'iface-id': '63ec6fca-872d-4e61-b76a-c39215266088', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:fb:6f', 'vm-uuid': 'c27fc8b6-cc8c-426a-859d-04722c569cd4'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:32 user nova-compute[72874]: INFO os_vif [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:fb:6f,bridge_name='br-int',has_traffic_filtering=True,id=63ec6fca-872d-4e61-b76a-c39215266088,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ec6fca-87')
Aug 17 18:16:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap854fd839-b1, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap854fd839-b1, col_values=(('external_ids', {'iface-id': '854fd839-b199-4430-a240-29ab1c0a3700', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:e8:ab', 'vm-uuid': '3bf88e4a-ee43-471a-b375-30684f09c3e3'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:32 user nova-compute[72874]: INFO os_vif [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:e8:ab,bridge_name='br-int',has_traffic_filtering=True,id=854fd839-b199-4430-a240-29ab1c0a3700,network=Network(6a1d5756-c29e-4f96-aa83-0ad17d8bb48e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fd839-b1')
Aug 17 18:16:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] No VIF found with MAC fa:16:3e:50:ac:00, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] No VIF found with MAC fa:16:3e:1d:fb:6f, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] No VIF found with MAC fa:16:3e:3d:e8:ab, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG nova.network.neutron [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Successfully created port: 17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG nova.network.neutron [req-7b7f8902-6bcc-497d-8596-db6e090b9119 req-b3911828-81dc-45be-9f52-f14cd68706b7 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updated VIF entry in instance network info cache for port b3598a27-6f66-4999-8ed8-835ffb3d6cae. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG nova.network.neutron [req-7b7f8902-6bcc-497d-8596-db6e090b9119 req-b3911828-81dc-45be-9f52-f14cd68706b7 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updating instance_info_cache with network_info: [{"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:16:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7b7f8902-6bcc-497d-8596-db6e090b9119 req-b3911828-81dc-45be-9f52-f14cd68706b7 service nova] Releasing lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:16:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:33 user nova-compute[72874]: DEBUG nova.network.neutron [req-7ff89855-b1e6-4dec-be81-f4b021117baf req-13a420f7-221c-49e3-851d-f0e45a379157 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Updated VIF entry in instance network info cache for port 854fd839-b199-4430-a240-29ab1c0a3700. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:16:33 user nova-compute[72874]: DEBUG nova.network.neutron [req-7ff89855-b1e6-4dec-be81-f4b021117baf req-13a420f7-221c-49e3-851d-f0e45a379157 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Updating instance_info_cache with network_info: [{"id": "854fd839-b199-4430-a240-29ab1c0a3700", "address": "fa:16:3e:3d:e8:ab", "network": {"id": "6a1d5756-c29e-4f96-aa83-0ad17d8bb48e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1496281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21222da070874ea8b635ed3178821402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fd839-b1", "ovs_interfaceid": "854fd839-b199-4430-a240-29ab1c0a3700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:16:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7ff89855-b1e6-4dec-be81-f4b021117baf req-13a420f7-221c-49e3-851d-f0e45a379157 service nova] Releasing lock "refresh_cache-3bf88e4a-ee43-471a-b375-30684f09c3e3" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:16:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:34 user nova-compute[72874]: DEBUG nova.network.neutron [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Successfully updated port: 17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:16:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:16:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquired lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:16:34 user nova-compute[72874]: DEBUG nova.network.neutron [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-e3980b8b-6c06-404c-a472-7940f98bbb10 req-638a6798-a9a1-4db1-9516-217fec857647 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Received event network-changed-17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-e3980b8b-6c06-404c-a472-7940f98bbb10 req-638a6798-a9a1-4db1-9516-217fec857647 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Refreshing instance network info cache due to event network-changed-17265426-d5a6-4028-8c1c-2f84dfa2ac21. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e3980b8b-6c06-404c-a472-7940f98bbb10 req-638a6798-a9a1-4db1-9516-217fec857647 service nova] Acquiring lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.network.neutron [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.network.neutron [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Updating instance_info_cache with network_info: [{"id": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "address": "fa:16:3e:3a:30:bb", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17265426-d5", "ovs_interfaceid": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Releasing lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.compute.manager [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Instance network_info: |[{"id": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "address": "fa:16:3e:3a:30:bb", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17265426-d5", "ovs_interfaceid": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e3980b8b-6c06-404c-a472-7940f98bbb10 req-638a6798-a9a1-4db1-9516-217fec857647 service nova] Acquired lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.network.neutron [req-e3980b8b-6c06-404c-a472-7940f98bbb10 req-638a6798-a9a1-4db1-9516-217fec857647 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Refreshing network info cache for port 17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Start _get_guest_xml network_info=[{"id": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "address": "fa:16:3e:3a:30:bb", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17265426-d5", "ovs_interfaceid": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:16:35 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:16:35 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1169162450',display_name='tempest-ServerActionsTestOtherA-server-1169162450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1169162450',id=4,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFP6ue+/z3wt8xhCWBOe29hsvUkf+UOWUkfgnV2VGRCWOmbw8F+9gEiC1B84s9ElkFdDnqMgWD7dJiORZ3oQy2cYRrKsSD3Z6YMcgGnOy3TRveU5TvjItrEcSVSb9w9jg==',key_name='tempest-keypair-1711897531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4aa04d3ed68a4542b32e2efeca25222a',ramdisk_id='',reservation_id='r-3fp9w07k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1332351935',owner_user_name='tempest-ServerActionsTestOtherA-1332351935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaaa47a37543427eaa1712d29c419dd9',uuid=b143e572-9116-4dc0-8fc3-ba586b290ddd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "address": "fa:16:3e:3a:30:bb", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17265426-d5", "ovs_interfaceid": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converting VIF {"id": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "address": "fa:16:3e:3a:30:bb", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17265426-d5", "ovs_interfaceid": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:30:bb,bridge_name='br-int',has_traffic_filtering=True,id=17265426-d5a6-4028-8c1c-2f84dfa2ac21,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17265426-d5') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.objects.instance [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'pci_devices' on Instance uuid b143e572-9116-4dc0-8fc3-ba586b290ddd {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:16:35 user nova-compute[72874]:   <uuid>b143e572-9116-4dc0-8fc3-ba586b290ddd</uuid>
Aug 17 18:16:35 user nova-compute[72874]:   <name>instance-00000004</name>
Aug 17 18:16:35 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:16:35 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:16:35 user nova-compute[72874]:   <metadata>
Aug 17 18:16:35 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:16:35 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:16:35 user nova-compute[72874]:       <nova:name>tempest-ServerActionsTestOtherA-server-1169162450</nova:name>
Aug 17 18:16:35 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:16:35</nova:creationTime>
Aug 17 18:16:35 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:16:35 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:16:35 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:16:35 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:16:35 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:16:35 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:16:35 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:16:35 user nova-compute[72874]:       <nova:owner>
Aug 17 18:16:35 user nova-compute[72874]:         <nova:user uuid="aaaa47a37543427eaa1712d29c419dd9">tempest-ServerActionsTestOtherA-1332351935-project-member</nova:user>
Aug 17 18:16:35 user nova-compute[72874]:         <nova:project uuid="4aa04d3ed68a4542b32e2efeca25222a">tempest-ServerActionsTestOtherA-1332351935</nova:project>
Aug 17 18:16:35 user nova-compute[72874]:       </nova:owner>
Aug 17 18:16:35 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:16:35 user nova-compute[72874]:       <nova:ports>
Aug 17 18:16:35 user nova-compute[72874]:         <nova:port uuid="17265426-d5a6-4028-8c1c-2f84dfa2ac21">
Aug 17 18:16:35 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 18:16:35 user nova-compute[72874]:         </nova:port>
Aug 17 18:16:35 user nova-compute[72874]:       </nova:ports>
Aug 17 18:16:35 user nova-compute[72874]:     </nova:instance>
Aug 17 18:16:35 user nova-compute[72874]:   </metadata>
Aug 17 18:16:35 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:16:35 user nova-compute[72874]:     <system>
Aug 17 18:16:35 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:16:35 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:16:35 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:16:35 user nova-compute[72874]:       <entry name="serial">b143e572-9116-4dc0-8fc3-ba586b290ddd</entry>
Aug 17 18:16:35 user nova-compute[72874]:       <entry name="uuid">b143e572-9116-4dc0-8fc3-ba586b290ddd</entry>
Aug 17 18:16:35 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:16:35 user nova-compute[72874]:     </system>
Aug 17 18:16:35 user nova-compute[72874]:   </sysinfo>
Aug 17 18:16:35 user nova-compute[72874]:   <os>
Aug 17 18:16:35 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:16:35 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:16:35 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:16:35 user nova-compute[72874]:   </os>
Aug 17 18:16:35 user nova-compute[72874]:   <features>
Aug 17 18:16:35 user nova-compute[72874]:     <acpi/>
Aug 17 18:16:35 user nova-compute[72874]:     <apic/>
Aug 17 18:16:35 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:16:35 user nova-compute[72874]:   </features>
Aug 17 18:16:35 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:16:35 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:16:35 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:16:35 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:16:35 user nova-compute[72874]:   </clock>
Aug 17 18:16:35 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:16:35 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:16:35 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:16:35 user nova-compute[72874]:   </cpu>
Aug 17 18:16:35 user nova-compute[72874]:   <devices>
Aug 17 18:16:35 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:16:35 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:16:35 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk"/>
Aug 17 18:16:35 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:16:35 user nova-compute[72874]:     </disk>
Aug 17 18:16:35 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:16:35 user nova-compute[72874]:       <mac address="fa:16:3e:3a:30:bb"/>
Aug 17 18:16:35 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:16:35 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:16:35 user nova-compute[72874]:       <target dev="tap17265426-d5"/>
Aug 17 18:16:35 user nova-compute[72874]:     </interface>
Aug 17 18:16:35 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:16:35 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/console.log" append="off"/>
Aug 17 18:16:35 user nova-compute[72874]:     </serial>
Aug 17 18:16:35 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:16:35 user nova-compute[72874]:     <video>
Aug 17 18:16:35 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:16:35 user nova-compute[72874]:     </video>
Aug 17 18:16:35 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:16:35 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:16:35 user nova-compute[72874]:     </rng>
Aug 17 18:16:35 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:16:35 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:16:35 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:16:35 user nova-compute[72874]:     </memballoon>
Aug 17 18:16:35 user nova-compute[72874]:   </devices>
Aug 17 18:16:35 user nova-compute[72874]: </domain>
Aug 17 18:16:35 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1169162450',display_name='tempest-ServerActionsTestOtherA-server-1169162450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1169162450',id=4,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFP6ue+/z3wt8xhCWBOe29hsvUkf+UOWUkfgnV2VGRCWOmbw8F+9gEiC1B84s9ElkFdDnqMgWD7dJiORZ3oQy2cYRrKsSD3Z6YMcgGnOy3TRveU5TvjItrEcSVSb9w9jg==',key_name='tempest-keypair-1711897531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4aa04d3ed68a4542b32e2efeca25222a',ramdisk_id='',reservation_id='r-3fp9w07k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1332351935',owner_user_name='tempest-ServerActionsTestOtherA-1332351935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaaa47a37543427eaa1712d29c419dd9',uuid=b143e572-9116-4dc0-8fc3-ba586b290ddd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "address": "fa:16:3e:3a:30:bb", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17265426-d5", "ovs_interfaceid": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converting VIF {"id": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "address": "fa:16:3e:3a:30:bb", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17265426-d5", "ovs_interfaceid": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:30:bb,bridge_name='br-int',has_traffic_filtering=True,id=17265426-d5a6-4028-8c1c-2f84dfa2ac21,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17265426-d5') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG os_vif [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:30:bb,bridge_name='br-int',has_traffic_filtering=True,id=17265426-d5a6-4028-8c1c-2f84dfa2ac21,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17265426-d5') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17265426-d5, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap17265426-d5, col_values=(('external_ids', {'iface-id': '17265426-d5a6-4028-8c1c-2f84dfa2ac21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:30:bb', 'vm-uuid': 'b143e572-9116-4dc0-8fc3-ba586b290ddd'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:35 user nova-compute[72874]: INFO os_vif [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:30:bb,bridge_name='br-int',has_traffic_filtering=True,id=17265426-d5a6-4028-8c1c-2f84dfa2ac21,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17265426-d5')
Aug 17 18:16:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:16:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] No VIF found with MAC fa:16:3e:3a:30:bb, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:16:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:37 user nova-compute[72874]: DEBUG nova.network.neutron [req-e3980b8b-6c06-404c-a472-7940f98bbb10 req-638a6798-a9a1-4db1-9516-217fec857647 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Updated VIF entry in instance network info cache for port 17265426-d5a6-4028-8c1c-2f84dfa2ac21. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:16:37 user nova-compute[72874]: DEBUG nova.network.neutron [req-e3980b8b-6c06-404c-a472-7940f98bbb10 req-638a6798-a9a1-4db1-9516-217fec857647 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Updating instance_info_cache with network_info: [{"id": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "address": "fa:16:3e:3a:30:bb", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17265426-d5", "ovs_interfaceid": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:16:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e3980b8b-6c06-404c-a472-7940f98bbb10 req-638a6798-a9a1-4db1-9516-217fec857647 service nova] Releasing lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:16:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:39 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296199.7537208, 3bf88e4a-ee43-471a-b375-30684f09c3e3 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:16:39 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] VM Resumed (Lifecycle Event)
Aug 17 18:16:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:16:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:16:39 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Instance spawned successfully.
Aug 17 18:16:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:16:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:16:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:16:39 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:16:39 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296199.7648852, 3bf88e4a-ee43-471a-b375-30684f09c3e3 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:16:39 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] VM Started (Lifecycle Event)
Aug 17 18:16:39 user nova-compute[72874]: INFO nova.compute.manager [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Took 17.46 seconds to spawn the instance on the hypervisor.
Aug 17 18:16:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:16:40 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:16:40 user nova-compute[72874]: INFO nova.compute.manager [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Took 19.14 seconds to build instance.
Aug 17 18:16:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-541ef7f7-1b38-43c9-a2d4-d3ba2ef0f447 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.357s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296200.2234013, f027045c-d121-45ec-af61-e1a2399c4a43 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:16:40 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] VM Resumed (Lifecycle Event)
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:16:40 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Instance spawned successfully.
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:16:40 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296200.2303236, f027045c-d121-45ec-af61-e1a2399c4a43 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:16:40 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] VM Started (Lifecycle Event)
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:16:40 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Instance spawned successfully.
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:16:40 user nova-compute[72874]: INFO nova.compute.manager [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Took 16.84 seconds to spawn the instance on the hypervisor.
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:40 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296200.3942003, c27fc8b6-cc8c-426a-859d-04722c569cd4 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:16:40 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] VM Resumed (Lifecycle Event)
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:16:40 user nova-compute[72874]: INFO nova.compute.manager [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Took 17.81 seconds to build instance.
Aug 17 18:16:40 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296200.3988838, c27fc8b6-cc8c-426a-859d-04722c569cd4 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:16:40 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] VM Started (Lifecycle Event)
Aug 17 18:16:40 user nova-compute[72874]: INFO nova.compute.manager [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Took 20.14 seconds to spawn the instance on the hypervisor.
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-06ef1440-2ce3-4f7c-9587-5a9a82b0a151 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "f027045c-d121-45ec-af61-e1a2399c4a43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.959s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:16:40 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:16:40 user nova-compute[72874]: INFO nova.compute.manager [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Took 21.33 seconds to build instance.
Aug 17 18:16:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b44c6b8-fd08-4589-9114-cbc493126df9 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.732s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:41 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296201.5759242, b143e572-9116-4dc0-8fc3-ba586b290ddd => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:16:41 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] VM Resumed (Lifecycle Event)
Aug 17 18:16:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:16:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:16:41 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Instance spawned successfully.
Aug 17 18:16:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:16:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:16:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:16:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:16:41 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:16:41 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296201.5802655, b143e572-9116-4dc0-8fc3-ba586b290ddd => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:16:41 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] VM Started (Lifecycle Event)
Aug 17 18:16:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:16:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:16:41 user nova-compute[72874]: INFO nova.compute.manager [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Took 13.33 seconds to spawn the instance on the hypervisor.
Aug 17 18:16:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:16:41 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:16:42 user nova-compute[72874]: INFO nova.compute.manager [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Took 14.27 seconds to build instance.
Aug 17 18:16:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a6685f40-e74e-4ee3-b181-e5b6189994a0 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.405s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquiring lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:43 user nova-compute[72874]: DEBUG nova.compute.manager [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:16:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:44 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:16:44 user nova-compute[72874]: INFO nova.compute.claims [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Claim successful on node user
Aug 17 18:16:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:44 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:16:44 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:16:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.745s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:16:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:16:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:16:45 user nova-compute[72874]: DEBUG nova.network.neutron [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:16:45 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 17 18:16:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:16:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:45 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:16:45 user nova-compute[72874]: INFO nova.compute.claims [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Claim successful on node user
Aug 17 18:16:45 user nova-compute[72874]: DEBUG nova.policy [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77a438e1dcd042359928a363076698c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '817d1715984649a68c2ef734ba21feeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:16:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:16:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:16:45 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Creating image(s)
Aug 17 18:16:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "/opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "/opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquiring lock "b0d3b085f79b171fa991e817f72e3e3551487f62" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "b0d3b085f79b171fa991e817f72e3e3551487f62" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62.part --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:16:46 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:16:46 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:16:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.512s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:16:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62.part --force-share --output=json" returned: 0 in 0.369s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:46 user nova-compute[72874]: DEBUG nova.virt.images [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] af8b3b0f-e5f5-4fed-8032-bd71520911ba was qcow2, converting to raw {{(pid=72874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 18:16:46 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:16:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62.part /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62.converted {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:16:46 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:16:46 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:16:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:16:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62.part /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62.converted" returned: 0 in 0.327s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62.converted --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG nova.policy [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f400334282b4272a8f78d682f3816d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe8a83be9b440b95aa258c4dff6af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG nova.network.neutron [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Successfully created port: a5c80e92-7939-4713-bace-452403c97c47 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:16:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Creating image(s)
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "/opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "/opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62.converted --force-share --output=json" returned: 0 in 0.418s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "b0d3b085f79b171fa991e817f72e3e3551487f62" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.083s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.248s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62 --force-share --output=json" returned: 0 in 0.279s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquiring lock "b0d3b085f79b171fa991e817f72e3e3551487f62" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "b0d3b085f79b171fa991e817f72e3e3551487f62" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Acquiring lock "544005af-7312-4bd4-a086-7d255ca7c479" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lock "544005af-7312-4bd4-a086-7d255ca7c479" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.223s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk 1073741824" returned: 0 in 0.068s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62 --force-share --output=json" returned: 0 in 0.264s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62,backing_fmt=raw /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62,backing_fmt=raw /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk 1073741824" returned: 0 in 0.068s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "b0d3b085f79b171fa991e817f72e3e3551487f62" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.343s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:16:48 user nova-compute[72874]: INFO nova.compute.claims [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Claim successful on node user
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.313s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62 --force-share --output=json" returned: 0 in 0.297s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json" returned: 0 in 0.337s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Cannot resize image /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lazy-loading 'migration_context' on Instance uuid 8c2eb160-5b94-4d53-bd36-b712c62d9100 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Ensure instance console log exists: /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Cannot resize image /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG nova.objects.instance [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lazy-loading 'migration_context' on Instance uuid ef6c7125-8a47-4e3f-bb6d-b6aa5254116c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Ensure instance console log exists: /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Successfully created port: 99361343-b109-451a-9ce9-50e5fd738b0e {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.760s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG nova.network.neutron [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:16:49 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:16:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG nova.policy [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4e59123017b14ec6a802d6051e7c7f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48a69ad5e8854703abf0ec2fefbc0f49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:16:49 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Creating image(s)
Aug 17 18:16:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Acquiring lock "/opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lock "/opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lock "/opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.232s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-cb47c986-f8d2-49ed-ba62-98838030e7b9 req-47f022be-962f-4f18-a835-e1c4b8deef73 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Received event network-vif-plugged-854fd839-b199-4430-a240-29ab1c0a3700 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cb47c986-f8d2-49ed-ba62-98838030e7b9 req-47f022be-962f-4f18-a835-e1c4b8deef73 service nova] Acquiring lock "3bf88e4a-ee43-471a-b375-30684f09c3e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cb47c986-f8d2-49ed-ba62-98838030e7b9 req-47f022be-962f-4f18-a835-e1c4b8deef73 service nova] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cb47c986-f8d2-49ed-ba62-98838030e7b9 req-47f022be-962f-4f18-a835-e1c4b8deef73 service nova] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-cb47c986-f8d2-49ed-ba62-98838030e7b9 req-47f022be-962f-4f18-a835-e1c4b8deef73 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] No waiting events found dispatching network-vif-plugged-854fd839-b199-4430-a240-29ab1c0a3700 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:16:49 user nova-compute[72874]: WARNING nova.compute.manager [req-cb47c986-f8d2-49ed-ba62-98838030e7b9 req-47f022be-962f-4f18-a835-e1c4b8deef73 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Received unexpected event network-vif-plugged-854fd839-b199-4430-a240-29ab1c0a3700 for instance with vm_state active and task_state None.
Aug 17 18:16:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.294s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk 1073741824" returned: 0 in 0.161s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.467s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG nova.network.neutron [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Successfully updated port: a5c80e92-7939-4713-bace-452403c97c47 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquiring lock "refresh_cache-ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquired lock "refresh_cache-ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG nova.network.neutron [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-c062740d-0636-475d-94fb-1e58e319bf3a req-815e2e3d-39e1-46b1-be6f-b3e7a1e93f91 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Received event network-changed-a5c80e92-7939-4713-bace-452403c97c47 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-c062740d-0636-475d-94fb-1e58e319bf3a req-815e2e3d-39e1-46b1-be6f-b3e7a1e93f91 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Refreshing instance network info cache due to event network-changed-a5c80e92-7939-4713-bace-452403c97c47. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c062740d-0636-475d-94fb-1e58e319bf3a req-815e2e3d-39e1-46b1-be6f-b3e7a1e93f91 service nova] Acquiring lock "refresh_cache-ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.338s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Checking if we can resize image /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG nova.network.neutron [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Successfully created port: fed725fd-dbf1-4c2b-bccc-5cd012a23c8e {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG nova.network.neutron [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Cannot resize image /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG nova.objects.instance [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lazy-loading 'migration_context' on Instance uuid 544005af-7312-4bd4-a086-7d255ca7c479 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Ensure instance console log exists: /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Updating instance_info_cache with network_info: [{"id": "a5c80e92-7939-4713-bace-452403c97c47", "address": "fa:16:3e:31:0e:3b", "network": {"id": "245fda49-a954-49cd-a901-d91753fa07f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-715260708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "817d1715984649a68c2ef734ba21feeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c80e92-79", "ovs_interfaceid": "a5c80e92-7939-4713-bace-452403c97c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Releasing lock "refresh_cache-ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Instance network_info: |[{"id": "a5c80e92-7939-4713-bace-452403c97c47", "address": "fa:16:3e:31:0e:3b", "network": {"id": "245fda49-a954-49cd-a901-d91753fa07f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-715260708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "817d1715984649a68c2ef734ba21feeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c80e92-79", "ovs_interfaceid": "a5c80e92-7939-4713-bace-452403c97c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c062740d-0636-475d-94fb-1e58e319bf3a req-815e2e3d-39e1-46b1-be6f-b3e7a1e93f91 service nova] Acquired lock "refresh_cache-ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.network.neutron [req-c062740d-0636-475d-94fb-1e58e319bf3a req-815e2e3d-39e1-46b1-be6f-b3e7a1e93f91 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Refreshing network info cache for port a5c80e92-7939-4713-bace-452403c97c47 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Start _get_guest_xml network_info=[{"id": "a5c80e92-7939-4713-bace-452403c97c47", "address": "fa:16:3e:31:0e:3b", "network": {"id": "245fda49-a954-49cd-a901-d91753fa07f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-715260708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "817d1715984649a68c2ef734ba21feeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c80e92-79", "ovs_interfaceid": "a5c80e92-7939-4713-bace-452403c97c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:16:36Z,direct_url=<?>,disk_format='qcow2',id=af8b3b0f-e5f5-4fed-8032-bd71520911ba,min_disk=0,min_ram=0,name='',owner='5b4e609021b7498d9c943fe89ac63dad',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:16:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'scsi', 'boot_index': 0, 'device_name': '/dev/sda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'af8b3b0f-e5f5-4fed-8032-bd71520911ba'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:16:51 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:16:51 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:16:36Z,direct_url=<?>,disk_format='qcow2',id=af8b3b0f-e5f5-4fed-8032-bd71520911ba,min_disk=0,min_ram=0,name='',owner='5b4e609021b7498d9c943fe89ac63dad',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:16:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1307787176',display_name='tempest-AttachSCSIVolumeTestJSON-server-1307787176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1307787176',id=5,image_ref='af8b3b0f-e5f5-4fed-8032-bd71520911ba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgq8m1UMVqSQ1fdxo15VBhjBk7eD8qG2VAUCa4AdbjeWQN9WeG7dxfld44gY4zGetKe/GumwEmjXguF6hFQ0OdSaJ5CB4c4/ZOpvejTyynV/WVt/7mvMIZbc3ebM08egA==',key_name='tempest-keypair-989698209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='817d1715984649a68c2ef734ba21feeb',ramdisk_id='',reservation_id='r-yiz3swib',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='af8b3b0f-e5f5-4fed-8032-bd71520911ba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-7029085',owner_user_name='tempest-AttachSCSIVolumeTestJSON-7029085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a438e1dcd042359928a363076698c2',uuid=ef6c7125-8a47-4e3f-bb6d-b6aa5254116c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5c80e92-7939-4713-bace-452403c97c47", "address": "fa:16:3e:31:0e:3b", "network": {"id": "245fda49-a954-49cd-a901-d91753fa07f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-715260708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "817d1715984649a68c2ef734ba21feeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c80e92-79", "ovs_interfaceid": "a5c80e92-7939-4713-bace-452403c97c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Converting VIF {"id": "a5c80e92-7939-4713-bace-452403c97c47", "address": "fa:16:3e:31:0e:3b", "network": {"id": "245fda49-a954-49cd-a901-d91753fa07f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-715260708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "817d1715984649a68c2ef734ba21feeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c80e92-79", "ovs_interfaceid": "a5c80e92-7939-4713-bace-452403c97c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=a5c80e92-7939-4713-bace-452403c97c47,network=Network(245fda49-a954-49cd-a901-d91753fa07f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c80e92-79') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.objects.instance [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lazy-loading 'pci_devices' on Instance uuid ef6c7125-8a47-4e3f-bb6d-b6aa5254116c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Successfully updated port: 99361343-b109-451a-9ce9-50e5fd738b0e {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:16:51 user nova-compute[72874]:   <uuid>ef6c7125-8a47-4e3f-bb6d-b6aa5254116c</uuid>
Aug 17 18:16:51 user nova-compute[72874]:   <name>instance-00000005</name>
Aug 17 18:16:51 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:16:51 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:16:51 user nova-compute[72874]:   <metadata>
Aug 17 18:16:51 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:16:51 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:16:51 user nova-compute[72874]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1307787176</nova:name>
Aug 17 18:16:51 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:16:51</nova:creationTime>
Aug 17 18:16:51 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:16:51 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:16:51 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:16:51 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:16:51 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:16:51 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:16:51 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:16:51 user nova-compute[72874]:       <nova:owner>
Aug 17 18:16:51 user nova-compute[72874]:         <nova:user uuid="77a438e1dcd042359928a363076698c2">tempest-AttachSCSIVolumeTestJSON-7029085-project-member</nova:user>
Aug 17 18:16:51 user nova-compute[72874]:         <nova:project uuid="817d1715984649a68c2ef734ba21feeb">tempest-AttachSCSIVolumeTestJSON-7029085</nova:project>
Aug 17 18:16:51 user nova-compute[72874]:       </nova:owner>
Aug 17 18:16:51 user nova-compute[72874]:       <nova:root type="image" uuid="af8b3b0f-e5f5-4fed-8032-bd71520911ba"/>
Aug 17 18:16:51 user nova-compute[72874]:       <nova:ports>
Aug 17 18:16:51 user nova-compute[72874]:         <nova:port uuid="a5c80e92-7939-4713-bace-452403c97c47">
Aug 17 18:16:51 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 18:16:51 user nova-compute[72874]:         </nova:port>
Aug 17 18:16:51 user nova-compute[72874]:       </nova:ports>
Aug 17 18:16:51 user nova-compute[72874]:     </nova:instance>
Aug 17 18:16:51 user nova-compute[72874]:   </metadata>
Aug 17 18:16:51 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:16:51 user nova-compute[72874]:     <system>
Aug 17 18:16:51 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:16:51 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:16:51 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:16:51 user nova-compute[72874]:       <entry name="serial">ef6c7125-8a47-4e3f-bb6d-b6aa5254116c</entry>
Aug 17 18:16:51 user nova-compute[72874]:       <entry name="uuid">ef6c7125-8a47-4e3f-bb6d-b6aa5254116c</entry>
Aug 17 18:16:51 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:16:51 user nova-compute[72874]:     </system>
Aug 17 18:16:51 user nova-compute[72874]:   </sysinfo>
Aug 17 18:16:51 user nova-compute[72874]:   <os>
Aug 17 18:16:51 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:16:51 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:16:51 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:16:51 user nova-compute[72874]:   </os>
Aug 17 18:16:51 user nova-compute[72874]:   <features>
Aug 17 18:16:51 user nova-compute[72874]:     <acpi/>
Aug 17 18:16:51 user nova-compute[72874]:     <apic/>
Aug 17 18:16:51 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:16:51 user nova-compute[72874]:   </features>
Aug 17 18:16:51 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:16:51 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:16:51 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:16:51 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:16:51 user nova-compute[72874]:   </clock>
Aug 17 18:16:51 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:16:51 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:16:51 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:16:51 user nova-compute[72874]:   </cpu>
Aug 17 18:16:51 user nova-compute[72874]:   <devices>
Aug 17 18:16:51 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:16:51 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:16:51 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk"/>
Aug 17 18:16:51 user nova-compute[72874]:       <target dev="sda" bus="scsi"/>
Aug 17 18:16:51 user nova-compute[72874]:       <address type="drive" controller="0" unit="0"/>
Aug 17 18:16:51 user nova-compute[72874]:     </disk>
Aug 17 18:16:51 user nova-compute[72874]:     <disk type="file" device="cdrom">
Aug 17 18:16:51 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 18:16:51 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk.config"/>
Aug 17 18:16:51 user nova-compute[72874]:       <target dev="sdb" bus="scsi"/>
Aug 17 18:16:51 user nova-compute[72874]:       <address type="drive" controller="0" unit="1"/>
Aug 17 18:16:51 user nova-compute[72874]:     </disk>
Aug 17 18:16:51 user nova-compute[72874]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 17 18:16:51 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:16:51 user nova-compute[72874]:       <mac address="fa:16:3e:31:0e:3b"/>
Aug 17 18:16:51 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:16:51 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:16:51 user nova-compute[72874]:       <target dev="tapa5c80e92-79"/>
Aug 17 18:16:51 user nova-compute[72874]:     </interface>
Aug 17 18:16:51 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:16:51 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/console.log" append="off"/>
Aug 17 18:16:51 user nova-compute[72874]:     </serial>
Aug 17 18:16:51 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:16:51 user nova-compute[72874]:     <video>
Aug 17 18:16:51 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:16:51 user nova-compute[72874]:     </video>
Aug 17 18:16:51 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:16:51 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:16:51 user nova-compute[72874]:     </rng>
Aug 17 18:16:51 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:16:51 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:16:51 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:16:51 user nova-compute[72874]:     </memballoon>
Aug 17 18:16:51 user nova-compute[72874]:   </devices>
Aug 17 18:16:51 user nova-compute[72874]: </domain>
Aug 17 18:16:51 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1307787176',display_name='tempest-AttachSCSIVolumeTestJSON-server-1307787176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1307787176',id=5,image_ref='af8b3b0f-e5f5-4fed-8032-bd71520911ba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgq8m1UMVqSQ1fdxo15VBhjBk7eD8qG2VAUCa4AdbjeWQN9WeG7dxfld44gY4zGetKe/GumwEmjXguF6hFQ0OdSaJ5CB4c4/ZOpvejTyynV/WVt/7mvMIZbc3ebM08egA==',key_name='tempest-keypair-989698209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='817d1715984649a68c2ef734ba21feeb',ramdisk_id='',reservation_id='r-yiz3swib',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='af8b3b0f-e5f5-4fed-8032-bd71520911ba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-7029085',owner_user_name='tempest-AttachSCSIVolumeTestJSON-7029085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:16:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a438e1dcd042359928a363076698c2',uuid=ef6c7125-8a47-4e3f-bb6d-b6aa5254116c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5c80e92-7939-4713-bace-452403c97c47", "address": "fa:16:3e:31:0e:3b", "network": {"id": "245fda49-a954-49cd-a901-d91753fa07f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-715260708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "817d1715984649a68c2ef734ba21feeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c80e92-79", "ovs_interfaceid": "a5c80e92-7939-4713-bace-452403c97c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Converting VIF {"id": "a5c80e92-7939-4713-bace-452403c97c47", "address": "fa:16:3e:31:0e:3b", "network": {"id": "245fda49-a954-49cd-a901-d91753fa07f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-715260708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "817d1715984649a68c2ef734ba21feeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c80e92-79", "ovs_interfaceid": "a5c80e92-7939-4713-bace-452403c97c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=a5c80e92-7939-4713-bace-452403c97c47,network=Network(245fda49-a954-49cd-a901-d91753fa07f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c80e92-79') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG os_vif [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=a5c80e92-7939-4713-bace-452403c97c47,network=Network(245fda49-a954-49cd-a901-d91753fa07f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c80e92-79') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5c80e92-79, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa5c80e92-79, col_values=(('external_ids', {'iface-id': 'a5c80e92-7939-4713-bace-452403c97c47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:0e:3b', 'vm-uuid': 'ef6c7125-8a47-4e3f-bb6d-b6aa5254116c'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:51 user nova-compute[72874]: INFO os_vif [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=a5c80e92-7939-4713-bace-452403c97c47,network=Network(245fda49-a954-49cd-a901-d91753fa07f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c80e92-79')
Aug 17 18:16:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "refresh_cache-8c2eb160-5b94-4d53-bd36-b712c62d9100" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquired lock "refresh_cache-8c2eb160-5b94-4d53-bd36-b712c62d9100" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:16:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:16:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] No BDM found with device name sda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:16:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:16:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] No VIF found with MAC fa:16:3e:31:0e:3b, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:16:52 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Using config drive
Aug 17 18:16:52 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:16:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-8913b7f2-c907-4abe-81e2-8e0413ed5d23 req-8cf62890-6e25-4867-a359-060b4c49ff06 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Received event network-vif-plugged-854fd839-b199-4430-a240-29ab1c0a3700 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:16:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8913b7f2-c907-4abe-81e2-8e0413ed5d23 req-8cf62890-6e25-4867-a359-060b4c49ff06 service nova] Acquiring lock "3bf88e4a-ee43-471a-b375-30684f09c3e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8913b7f2-c907-4abe-81e2-8e0413ed5d23 req-8cf62890-6e25-4867-a359-060b4c49ff06 service nova] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8913b7f2-c907-4abe-81e2-8e0413ed5d23 req-8cf62890-6e25-4867-a359-060b4c49ff06 service nova] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-8913b7f2-c907-4abe-81e2-8e0413ed5d23 req-8cf62890-6e25-4867-a359-060b4c49ff06 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] No waiting events found dispatching network-vif-plugged-854fd839-b199-4430-a240-29ab1c0a3700 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:16:52 user nova-compute[72874]: WARNING nova.compute.manager [req-8913b7f2-c907-4abe-81e2-8e0413ed5d23 req-8cf62890-6e25-4867-a359-060b4c49ff06 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Received unexpected event network-vif-plugged-854fd839-b199-4430-a240-29ab1c0a3700 for instance with vm_state active and task_state None.
Aug 17 18:16:52 user nova-compute[72874]: DEBUG nova.network.neutron [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Successfully updated port: fed725fd-dbf1-4c2b-bccc-5cd012a23c8e {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:16:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Acquiring lock "refresh_cache-544005af-7312-4bd4-a086-7d255ca7c479" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:16:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Acquired lock "refresh_cache-544005af-7312-4bd4-a086-7d255ca7c479" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:16:52 user nova-compute[72874]: DEBUG nova.network.neutron [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:16:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-9224c93e-efd6-429f-990a-17a2500f6faf req-01e2ec58-ded3-4771-bccd-81453b22b072 service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Received event network-changed-99361343-b109-451a-9ce9-50e5fd738b0e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:16:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-9224c93e-efd6-429f-990a-17a2500f6faf req-01e2ec58-ded3-4771-bccd-81453b22b072 service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Refreshing instance network info cache due to event network-changed-99361343-b109-451a-9ce9-50e5fd738b0e. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:16:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9224c93e-efd6-429f-990a-17a2500f6faf req-01e2ec58-ded3-4771-bccd-81453b22b072 service nova] Acquiring lock "refresh_cache-8c2eb160-5b94-4d53-bd36-b712c62d9100" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:16:52 user nova-compute[72874]: DEBUG nova.network.neutron [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:16:52 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Creating config drive at /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk.config
Aug 17 18:16:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpegff1xvl {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpegff1xvl" returned: 0 in 0.080s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Updating instance_info_cache with network_info: [{"id": "99361343-b109-451a-9ce9-50e5fd738b0e", "address": "fa:16:3e:a7:7a:4b", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99361343-b1", "ovs_interfaceid": "99361343-b109-451a-9ce9-50e5fd738b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Updating instance_info_cache with network_info: [{"id": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "address": "fa:16:3e:18:f7:a8", "network": {"id": "769ce42c-9237-4e57-8e6d-e62ed20ec619", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1230971768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a69ad5e8854703abf0ec2fefbc0f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed725fd-db", "ovs_interfaceid": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Releasing lock "refresh_cache-8c2eb160-5b94-4d53-bd36-b712c62d9100" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Instance network_info: |[{"id": "99361343-b109-451a-9ce9-50e5fd738b0e", "address": "fa:16:3e:a7:7a:4b", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99361343-b1", "ovs_interfaceid": "99361343-b109-451a-9ce9-50e5fd738b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9224c93e-efd6-429f-990a-17a2500f6faf req-01e2ec58-ded3-4771-bccd-81453b22b072 service nova] Acquired lock "refresh_cache-8c2eb160-5b94-4d53-bd36-b712c62d9100" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.network.neutron [req-9224c93e-efd6-429f-990a-17a2500f6faf req-01e2ec58-ded3-4771-bccd-81453b22b072 service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Refreshing network info cache for port 99361343-b109-451a-9ce9-50e5fd738b0e {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Start _get_guest_xml network_info=[{"id": "99361343-b109-451a-9ce9-50e5fd738b0e", "address": "fa:16:3e:a7:7a:4b", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99361343-b1", "ovs_interfaceid": "99361343-b109-451a-9ce9-50e5fd738b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Releasing lock "refresh_cache-544005af-7312-4bd4-a086-7d255ca7c479" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Instance network_info: |[{"id": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "address": "fa:16:3e:18:f7:a8", "network": {"id": "769ce42c-9237-4e57-8e6d-e62ed20ec619", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1230971768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a69ad5e8854703abf0ec2fefbc0f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed725fd-db", "ovs_interfaceid": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Start _get_guest_xml network_info=[{"id": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "address": "fa:16:3e:18:f7:a8", "network": {"id": "769ce42c-9237-4e57-8e6d-e62ed20ec619", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1230971768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a69ad5e8854703abf0ec2fefbc0f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed725fd-db", "ovs_interfaceid": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.network.neutron [req-c062740d-0636-475d-94fb-1e58e319bf3a req-815e2e3d-39e1-46b1-be6f-b3e7a1e93f91 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Updated VIF entry in instance network info cache for port a5c80e92-7939-4713-bace-452403c97c47. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.network.neutron [req-c062740d-0636-475d-94fb-1e58e319bf3a req-815e2e3d-39e1-46b1-be6f-b3e7a1e93f91 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Updating instance_info_cache with network_info: [{"id": "a5c80e92-7939-4713-bace-452403c97c47", "address": "fa:16:3e:31:0e:3b", "network": {"id": "245fda49-a954-49cd-a901-d91753fa07f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-715260708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "817d1715984649a68c2ef734ba21feeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c80e92-79", "ovs_interfaceid": "a5c80e92-7939-4713-bace-452403c97c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:16:53 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:16:53 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:16:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c062740d-0636-475d-94fb-1e58e319bf3a req-815e2e3d-39e1-46b1-be6f-b3e7a1e93f91 service nova] Releasing lock "refresh_cache-ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:16:53 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:16:53 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-322280',display_name='tempest-VolumesAdminNegativeTest-server-322280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-322280',id=6,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDpEOaoYo26PEfZFcqO9UOHlaIdiRVW3+dfCfmTHSW2OBiXiZ3nIGXG5JNWP8Mcrm33TV4w7LWhBbwwdrS1phsUEawsqL5zB9iaOi4MzvWZ8AYr4Lbs8ZvmgF404b+F9g==',key_name='tempest-keypair-1361343294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3fe8a83be9b440b95aa258c4dff6af4',ramdisk_id='',reservation_id='r-jkv7g83t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1606846933',owner_user_name='tempest-VolumesAdminNegativeTest-1606846933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:16:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f400334282b4272a8f78d682f3816d0',uuid=8c2eb160-5b94-4d53-bd36-b712c62d9100,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99361343-b109-451a-9ce9-50e5fd738b0e", "address": "fa:16:3e:a7:7a:4b", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99361343-b1", "ovs_interfaceid": "99361343-b109-451a-9ce9-50e5fd738b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Converting VIF {"id": "99361343-b109-451a-9ce9-50e5fd738b0e", "address": "fa:16:3e:a7:7a:4b", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99361343-b1", "ovs_interfaceid": "99361343-b109-451a-9ce9-50e5fd738b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:7a:4b,bridge_name='br-int',has_traffic_filtering=True,id=99361343-b109-451a-9ce9-50e5fd738b0e,network=Network(92a988c2-183c-41cc-9b97-59474938a618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99361343-b1') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c2eb160-5b94-4d53-bd36-b712c62d9100 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:16:53 user nova-compute[72874]:   <uuid>8c2eb160-5b94-4d53-bd36-b712c62d9100</uuid>
Aug 17 18:16:53 user nova-compute[72874]:   <name>instance-00000006</name>
Aug 17 18:16:53 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:16:53 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:16:53 user nova-compute[72874]:   <metadata>
Aug 17 18:16:53 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:16:53 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:16:53 user nova-compute[72874]:       <nova:name>tempest-VolumesAdminNegativeTest-server-322280</nova:name>
Aug 17 18:16:53 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:16:53</nova:creationTime>
Aug 17 18:16:53 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:16:53 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:16:53 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:16:53 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:16:53 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:16:53 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:16:53 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:16:53 user nova-compute[72874]:       <nova:owner>
Aug 17 18:16:53 user nova-compute[72874]:         <nova:user uuid="2f400334282b4272a8f78d682f3816d0">tempest-VolumesAdminNegativeTest-1606846933-project-member</nova:user>
Aug 17 18:16:53 user nova-compute[72874]:         <nova:project uuid="b3fe8a83be9b440b95aa258c4dff6af4">tempest-VolumesAdminNegativeTest-1606846933</nova:project>
Aug 17 18:16:53 user nova-compute[72874]:       </nova:owner>
Aug 17 18:16:53 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:16:53 user nova-compute[72874]:       <nova:ports>
Aug 17 18:16:53 user nova-compute[72874]:         <nova:port uuid="99361343-b109-451a-9ce9-50e5fd738b0e">
Aug 17 18:16:53 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 18:16:53 user nova-compute[72874]:         </nova:port>
Aug 17 18:16:53 user nova-compute[72874]:       </nova:ports>
Aug 17 18:16:53 user nova-compute[72874]:     </nova:instance>
Aug 17 18:16:53 user nova-compute[72874]:   </metadata>
Aug 17 18:16:53 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:16:53 user nova-compute[72874]:     <system>
Aug 17 18:16:53 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:16:53 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:16:53 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:16:53 user nova-compute[72874]:       <entry name="serial">8c2eb160-5b94-4d53-bd36-b712c62d9100</entry>
Aug 17 18:16:53 user nova-compute[72874]:       <entry name="uuid">8c2eb160-5b94-4d53-bd36-b712c62d9100</entry>
Aug 17 18:16:53 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:16:53 user nova-compute[72874]:     </system>
Aug 17 18:16:53 user nova-compute[72874]:   </sysinfo>
Aug 17 18:16:53 user nova-compute[72874]:   <os>
Aug 17 18:16:53 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:16:53 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:16:53 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:16:53 user nova-compute[72874]:   </os>
Aug 17 18:16:53 user nova-compute[72874]:   <features>
Aug 17 18:16:53 user nova-compute[72874]:     <acpi/>
Aug 17 18:16:53 user nova-compute[72874]:     <apic/>
Aug 17 18:16:53 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:16:53 user nova-compute[72874]:   </features>
Aug 17 18:16:53 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:16:53 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:16:53 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:16:53 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:16:53 user nova-compute[72874]:   </clock>
Aug 17 18:16:53 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:16:53 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:16:53 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:16:53 user nova-compute[72874]:   </cpu>
Aug 17 18:16:53 user nova-compute[72874]:   <devices>
Aug 17 18:16:53 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:16:53 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:16:53 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk"/>
Aug 17 18:16:53 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:16:53 user nova-compute[72874]:     </disk>
Aug 17 18:16:53 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:16:53 user nova-compute[72874]:       <mac address="fa:16:3e:a7:7a:4b"/>
Aug 17 18:16:53 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:16:53 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:16:53 user nova-compute[72874]:       <target dev="tap99361343-b1"/>
Aug 17 18:16:53 user nova-compute[72874]:     </interface>
Aug 17 18:16:53 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:16:53 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/console.log" append="off"/>
Aug 17 18:16:53 user nova-compute[72874]:     </serial>
Aug 17 18:16:53 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:16:53 user nova-compute[72874]:     <video>
Aug 17 18:16:53 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:16:53 user nova-compute[72874]:     </video>
Aug 17 18:16:53 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:16:53 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:16:53 user nova-compute[72874]:     </rng>
Aug 17 18:16:53 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:16:53 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:16:53 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:16:53 user nova-compute[72874]:     </memballoon>
Aug 17 18:16:53 user nova-compute[72874]:   </devices>
Aug 17 18:16:53 user nova-compute[72874]: </domain>
Aug 17 18:16:53 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-322280',display_name='tempest-VolumesAdminNegativeTest-server-322280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-322280',id=6,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDpEOaoYo26PEfZFcqO9UOHlaIdiRVW3+dfCfmTHSW2OBiXiZ3nIGXG5JNWP8Mcrm33TV4w7LWhBbwwdrS1phsUEawsqL5zB9iaOi4MzvWZ8AYr4Lbs8ZvmgF404b+F9g==',key_name='tempest-keypair-1361343294',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3fe8a83be9b440b95aa258c4dff6af4',ramdisk_id='',reservation_id='r-jkv7g83t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1606846933',owner_user_name='tempest-VolumesAdminNegativeTest-1606846933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:16:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f400334282b4272a8f78d682f3816d0',uuid=8c2eb160-5b94-4d53-bd36-b712c62d9100,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99361343-b109-451a-9ce9-50e5fd738b0e", "address": "fa:16:3e:a7:7a:4b", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99361343-b1", "ovs_interfaceid": "99361343-b109-451a-9ce9-50e5fd738b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Converting VIF {"id": "99361343-b109-451a-9ce9-50e5fd738b0e", "address": "fa:16:3e:a7:7a:4b", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99361343-b1", "ovs_interfaceid": "99361343-b109-451a-9ce9-50e5fd738b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:7a:4b,bridge_name='br-int',has_traffic_filtering=True,id=99361343-b109-451a-9ce9-50e5fd738b0e,network=Network(92a988c2-183c-41cc-9b97-59474938a618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99361343-b1') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG os_vif [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:7a:4b,bridge_name='br-int',has_traffic_filtering=True,id=99361343-b109-451a-9ce9-50e5fd738b0e,network=Network(92a988c2-183c-41cc-9b97-59474938a618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99361343-b1') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-631508979',display_name='tempest-VolumesAssistedSnapshotsTest-server-631508979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-631508979',id=7,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAh2YhduJk62HtHEmK1ZDWtrHnvGoC1PTQDcSJYbapFaJv6ZeDdbcBHjok35vX4vMQjiG0vW9oA6RVOoNuRyVp4Iv+XtjHbCRU50F7PU4cZtThtw/Iv13ddIDl9uuS0iw==',key_name='tempest-keypair-1831967697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48a69ad5e8854703abf0ec2fefbc0f49',ramdisk_id='',reservation_id='r-acqampfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-303606809',owner_user_name='tempest-VolumesAssistedSnapshotsTest-303606809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:16:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e59123017b14ec6a802d6051e7c7f65',uuid=544005af-7312-4bd4-a086-7d255ca7c479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "address": "fa:16:3e:18:f7:a8", "network": {"id": "769ce42c-9237-4e57-8e6d-e62ed20ec619", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1230971768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a69ad5e8854703abf0ec2fefbc0f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed725fd-db", "ovs_interfaceid": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Converting VIF {"id": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "address": "fa:16:3e:18:f7:a8", "network": {"id": "769ce42c-9237-4e57-8e6d-e62ed20ec619", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1230971768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a69ad5e8854703abf0ec2fefbc0f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed725fd-db", "ovs_interfaceid": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:f7:a8,bridge_name='br-int',has_traffic_filtering=True,id=fed725fd-dbf1-4c2b-bccc-5cd012a23c8e,network=Network(769ce42c-9237-4e57-8e6d-e62ed20ec619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfed725fd-db') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.objects.instance [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lazy-loading 'pci_devices' on Instance uuid 544005af-7312-4bd4-a086-7d255ca7c479 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99361343-b1, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99361343-b1, col_values=(('external_ids', {'iface-id': '99361343-b109-451a-9ce9-50e5fd738b0e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:7a:4b', 'vm-uuid': '8c2eb160-5b94-4d53-bd36-b712c62d9100'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:16:53 user nova-compute[72874]:   <uuid>544005af-7312-4bd4-a086-7d255ca7c479</uuid>
Aug 17 18:16:53 user nova-compute[72874]:   <name>instance-00000007</name>
Aug 17 18:16:53 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:16:53 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:16:53 user nova-compute[72874]:   <metadata>
Aug 17 18:16:53 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:16:53 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:16:53 user nova-compute[72874]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-631508979</nova:name>
Aug 17 18:16:53 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:16:53</nova:creationTime>
Aug 17 18:16:53 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:16:53 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:16:53 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:16:53 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:16:53 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:16:53 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:16:53 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:16:53 user nova-compute[72874]:       <nova:owner>
Aug 17 18:16:53 user nova-compute[72874]:         <nova:user uuid="4e59123017b14ec6a802d6051e7c7f65">tempest-VolumesAssistedSnapshotsTest-303606809-project-member</nova:user>
Aug 17 18:16:53 user nova-compute[72874]:         <nova:project uuid="48a69ad5e8854703abf0ec2fefbc0f49">tempest-VolumesAssistedSnapshotsTest-303606809</nova:project>
Aug 17 18:16:53 user nova-compute[72874]:       </nova:owner>
Aug 17 18:16:53 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:16:53 user nova-compute[72874]:       <nova:ports>
Aug 17 18:16:53 user nova-compute[72874]:         <nova:port uuid="fed725fd-dbf1-4c2b-bccc-5cd012a23c8e">
Aug 17 18:16:53 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 18:16:53 user nova-compute[72874]:         </nova:port>
Aug 17 18:16:53 user nova-compute[72874]:       </nova:ports>
Aug 17 18:16:53 user nova-compute[72874]:     </nova:instance>
Aug 17 18:16:53 user nova-compute[72874]:   </metadata>
Aug 17 18:16:53 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:16:53 user nova-compute[72874]:     <system>
Aug 17 18:16:53 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:16:53 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:16:53 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:16:53 user nova-compute[72874]:       <entry name="serial">544005af-7312-4bd4-a086-7d255ca7c479</entry>
Aug 17 18:16:53 user nova-compute[72874]:       <entry name="uuid">544005af-7312-4bd4-a086-7d255ca7c479</entry>
Aug 17 18:16:53 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:16:53 user nova-compute[72874]:     </system>
Aug 17 18:16:53 user nova-compute[72874]:   </sysinfo>
Aug 17 18:16:53 user nova-compute[72874]:   <os>
Aug 17 18:16:53 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:16:53 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:16:53 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:16:53 user nova-compute[72874]:   </os>
Aug 17 18:16:53 user nova-compute[72874]:   <features>
Aug 17 18:16:53 user nova-compute[72874]:     <acpi/>
Aug 17 18:16:53 user nova-compute[72874]:     <apic/>
Aug 17 18:16:53 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:16:53 user nova-compute[72874]:   </features>
Aug 17 18:16:53 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:16:53 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:16:53 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:16:53 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:16:53 user nova-compute[72874]:   </clock>
Aug 17 18:16:53 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:16:53 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:16:53 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:16:53 user nova-compute[72874]:   </cpu>
Aug 17 18:16:53 user nova-compute[72874]:   <devices>
Aug 17 18:16:53 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:16:53 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:16:53 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk"/>
Aug 17 18:16:53 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:16:53 user nova-compute[72874]:     </disk>
Aug 17 18:16:53 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:16:53 user nova-compute[72874]:       <mac address="fa:16:3e:18:f7:a8"/>
Aug 17 18:16:53 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:16:53 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:16:53 user nova-compute[72874]:       <target dev="tapfed725fd-db"/>
Aug 17 18:16:53 user nova-compute[72874]:     </interface>
Aug 17 18:16:53 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:16:53 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/console.log" append="off"/>
Aug 17 18:16:53 user nova-compute[72874]:     </serial>
Aug 17 18:16:53 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:16:53 user nova-compute[72874]:     <video>
Aug 17 18:16:53 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:16:53 user nova-compute[72874]:     </video>
Aug 17 18:16:53 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:16:53 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:16:53 user nova-compute[72874]:     </rng>
Aug 17 18:16:53 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:16:53 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:16:53 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:16:53 user nova-compute[72874]:     </memballoon>
Aug 17 18:16:53 user nova-compute[72874]:   </devices>
Aug 17 18:16:53 user nova-compute[72874]: </domain>
Aug 17 18:16:53 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-631508979',display_name='tempest-VolumesAssistedSnapshotsTest-server-631508979',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-631508979',id=7,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAh2YhduJk62HtHEmK1ZDWtrHnvGoC1PTQDcSJYbapFaJv6ZeDdbcBHjok35vX4vMQjiG0vW9oA6RVOoNuRyVp4Iv+XtjHbCRU50F7PU4cZtThtw/Iv13ddIDl9uuS0iw==',key_name='tempest-keypair-1831967697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48a69ad5e8854703abf0ec2fefbc0f49',ramdisk_id='',reservation_id='r-acqampfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-303606809',owner_user_name='tempest-VolumesAssistedSnapshotsTest-303606809-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:16:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e59123017b14ec6a802d6051e7c7f65',uuid=544005af-7312-4bd4-a086-7d255ca7c479,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "address": "fa:16:3e:18:f7:a8", "network": {"id": "769ce42c-9237-4e57-8e6d-e62ed20ec619", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1230971768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a69ad5e8854703abf0ec2fefbc0f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed725fd-db", "ovs_interfaceid": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Converting VIF {"id": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "address": "fa:16:3e:18:f7:a8", "network": {"id": "769ce42c-9237-4e57-8e6d-e62ed20ec619", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1230971768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a69ad5e8854703abf0ec2fefbc0f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed725fd-db", "ovs_interfaceid": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:f7:a8,bridge_name='br-int',has_traffic_filtering=True,id=fed725fd-dbf1-4c2b-bccc-5cd012a23c8e,network=Network(769ce42c-9237-4e57-8e6d-e62ed20ec619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfed725fd-db') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG os_vif [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:f7:a8,bridge_name='br-int',has_traffic_filtering=True,id=fed725fd-dbf1-4c2b-bccc-5cd012a23c8e,network=Network(769ce42c-9237-4e57-8e6d-e62ed20ec619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfed725fd-db') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:53 user nova-compute[72874]: INFO os_vif [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:7a:4b,bridge_name='br-int',has_traffic_filtering=True,id=99361343-b109-451a-9ce9-50e5fd738b0e,network=Network(92a988c2-183c-41cc-9b97-59474938a618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99361343-b1')
Aug 17 18:16:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfed725fd-db, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfed725fd-db, col_values=(('external_ids', {'iface-id': 'fed725fd-dbf1-4c2b-bccc-5cd012a23c8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:f7:a8', 'vm-uuid': '544005af-7312-4bd4-a086-7d255ca7c479'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:53 user nova-compute[72874]: INFO os_vif [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:f7:a8,bridge_name='br-int',has_traffic_filtering=True,id=fed725fd-dbf1-4c2b-bccc-5cd012a23c8e,network=Network(769ce42c-9237-4e57-8e6d-e62ed20ec619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfed725fd-db')
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] No VIF found with MAC fa:16:3e:a7:7a:4b, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:16:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] No VIF found with MAC fa:16:3e:18:f7:a8, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:16:54 user nova-compute[72874]: DEBUG nova.network.neutron [req-9224c93e-efd6-429f-990a-17a2500f6faf req-01e2ec58-ded3-4771-bccd-81453b22b072 service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Updated VIF entry in instance network info cache for port 99361343-b109-451a-9ce9-50e5fd738b0e. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:16:54 user nova-compute[72874]: DEBUG nova.network.neutron [req-9224c93e-efd6-429f-990a-17a2500f6faf req-01e2ec58-ded3-4771-bccd-81453b22b072 service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Updating instance_info_cache with network_info: [{"id": "99361343-b109-451a-9ce9-50e5fd738b0e", "address": "fa:16:3e:a7:7a:4b", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99361343-b1", "ovs_interfaceid": "99361343-b109-451a-9ce9-50e5fd738b0e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:16:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9224c93e-efd6-429f-990a-17a2500f6faf req-01e2ec58-ded3-4771-bccd-81453b22b072 service nova] Releasing lock "refresh_cache-8c2eb160-5b94-4d53-bd36-b712c62d9100" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:16:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-affcf9de-bd90-4d3f-99a6-643e2d44f800 req-45374563-87e5-44cd-b2ce-e297172af5ad service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Received event network-changed-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:16:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-affcf9de-bd90-4d3f-99a6-643e2d44f800 req-45374563-87e5-44cd-b2ce-e297172af5ad service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Refreshing instance network info cache due to event network-changed-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:16:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-affcf9de-bd90-4d3f-99a6-643e2d44f800 req-45374563-87e5-44cd-b2ce-e297172af5ad service nova] Acquiring lock "refresh_cache-544005af-7312-4bd4-a086-7d255ca7c479" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:16:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-affcf9de-bd90-4d3f-99a6-643e2d44f800 req-45374563-87e5-44cd-b2ce-e297172af5ad service nova] Acquired lock "refresh_cache-544005af-7312-4bd4-a086-7d255ca7c479" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:16:54 user nova-compute[72874]: DEBUG nova.network.neutron [req-affcf9de-bd90-4d3f-99a6-643e2d44f800 req-45374563-87e5-44cd-b2ce-e297172af5ad service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Refreshing network info cache for port fed725fd-dbf1-4c2b-bccc-5cd012a23c8e {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:16:54 user nova-compute[72874]: DEBUG nova.network.neutron [req-affcf9de-bd90-4d3f-99a6-643e2d44f800 req-45374563-87e5-44cd-b2ce-e297172af5ad service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Updated VIF entry in instance network info cache for port fed725fd-dbf1-4c2b-bccc-5cd012a23c8e. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:16:54 user nova-compute[72874]: DEBUG nova.network.neutron [req-affcf9de-bd90-4d3f-99a6-643e2d44f800 req-45374563-87e5-44cd-b2ce-e297172af5ad service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Updating instance_info_cache with network_info: [{"id": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "address": "fa:16:3e:18:f7:a8", "network": {"id": "769ce42c-9237-4e57-8e6d-e62ed20ec619", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1230971768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a69ad5e8854703abf0ec2fefbc0f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed725fd-db", "ovs_interfaceid": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:16:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-affcf9de-bd90-4d3f-99a6-643e2d44f800 req-45374563-87e5-44cd-b2ce-e297172af5ad service nova] Releasing lock "refresh_cache-544005af-7312-4bd4-a086-7d255ca7c479" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:16:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Acquiring lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:16:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:56 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:16:56 user nova-compute[72874]: INFO nova.compute.claims [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Claim successful on node user
Aug 17 18:16:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-d82695da-07e9-4cf3-a743-0c54b59fe320 req-9a180142-001b-4691-915e-dc34aa4733b9 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d82695da-07e9-4cf3-a743-0c54b59fe320 req-9a180142-001b-4691-915e-dc34aa4733b9 service nova] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d82695da-07e9-4cf3-a743-0c54b59fe320 req-9a180142-001b-4691-915e-dc34aa4733b9 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d82695da-07e9-4cf3-a743-0c54b59fe320 req-9a180142-001b-4691-915e-dc34aa4733b9 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-d82695da-07e9-4cf3-a743-0c54b59fe320 req-9a180142-001b-4691-915e-dc34aa4733b9 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] No waiting events found dispatching network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:16:57 user nova-compute[72874]: WARNING nova.compute.manager [req-d82695da-07e9-4cf3-a743-0c54b59fe320 req-9a180142-001b-4691-915e-dc34aa4733b9 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received unexpected event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae for instance with vm_state active and task_state None.
Aug 17 18:16:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.830s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:16:57 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:16:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:58 user nova-compute[72874]: DEBUG nova.policy [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aa17f84da4e6430db62f92577b12d231', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bee00afddbd47ada0661d599605f8b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:16:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-7a749f6d-ad67-490c-ae2a-96eaac4ac565 req-28cef5a0-0407-4a40-b3b7-3ffee2fcd7fa service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Received event network-vif-plugged-17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:16:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7a749f6d-ad67-490c-ae2a-96eaac4ac565 req-28cef5a0-0407-4a40-b3b7-3ffee2fcd7fa service nova] Acquiring lock "b143e572-9116-4dc0-8fc3-ba586b290ddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7a749f6d-ad67-490c-ae2a-96eaac4ac565 req-28cef5a0-0407-4a40-b3b7-3ffee2fcd7fa service nova] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7a749f6d-ad67-490c-ae2a-96eaac4ac565 req-28cef5a0-0407-4a40-b3b7-3ffee2fcd7fa service nova] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-7a749f6d-ad67-490c-ae2a-96eaac4ac565 req-28cef5a0-0407-4a40-b3b7-3ffee2fcd7fa service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] No waiting events found dispatching network-vif-plugged-17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:16:58 user nova-compute[72874]: WARNING nova.compute.manager [req-7a749f6d-ad67-490c-ae2a-96eaac4ac565 req-28cef5a0-0407-4a40-b3b7-3ffee2fcd7fa service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Received unexpected event network-vif-plugged-17265426-d5a6-4028-8c1c-2f84dfa2ac21 for instance with vm_state active and task_state None.
Aug 17 18:16:58 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:16:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:16:58 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Creating image(s)
Aug 17 18:16:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "/opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "/opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.357s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.316s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk 1073741824" returned: 0 in 0.064s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.385s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] No waiting events found dispatching network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:16:59 user nova-compute[72874]: WARNING nova.compute.manager [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received unexpected event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae for instance with vm_state active and task_state None.
Aug 17 18:16:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received event network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] Acquiring lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] No waiting events found dispatching network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:16:59 user nova-compute[72874]: WARNING nova.compute.manager [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received unexpected event network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 for instance with vm_state active and task_state None.
Aug 17 18:16:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received event network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] Acquiring lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] No waiting events found dispatching network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:16:59 user nova-compute[72874]: WARNING nova.compute.manager [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received unexpected event network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 for instance with vm_state active and task_state None.
Aug 17 18:16:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Received event network-vif-plugged-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] Acquiring lock "544005af-7312-4bd4-a086-7d255ca7c479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] Lock "544005af-7312-4bd4-a086-7d255ca7c479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] Lock "544005af-7312-4bd4-a086-7d255ca7c479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] No waiting events found dispatching network-vif-plugged-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:16:59 user nova-compute[72874]: WARNING nova.compute.manager [req-a314023e-f5df-4acb-87b5-8a2c7e8d1c93 req-c32be5b9-ca08-456c-a829-a2bafda09059 service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Received unexpected event network-vif-plugged-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e for instance with vm_state building and task_state spawning.
Aug 17 18:16:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.321s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Cannot resize image /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lazy-loading 'migration_context' on Instance uuid 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Ensure instance console log exists: /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:16:59 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Successfully created port: 1293a9a4-696a-41b5-a2f4-10b40e30f85b {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Received event network-vif-plugged-17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] Acquiring lock "b143e572-9116-4dc0-8fc3-ba586b290ddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] No waiting events found dispatching network-vif-plugged-17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:17:00 user nova-compute[72874]: WARNING nova.compute.manager [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Received unexpected event network-vif-plugged-17265426-d5a6-4028-8c1c-2f84dfa2ac21 for instance with vm_state active and task_state None.
Aug 17 18:17:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Received event network-vif-plugged-a5c80e92-7939-4713-bace-452403c97c47 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] Acquiring lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] No waiting events found dispatching network-vif-plugged-a5c80e92-7939-4713-bace-452403c97c47 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:17:00 user nova-compute[72874]: WARNING nova.compute.manager [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Received unexpected event network-vif-plugged-a5c80e92-7939-4713-bace-452403c97c47 for instance with vm_state building and task_state spawning.
Aug 17 18:17:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Received event network-vif-plugged-a5c80e92-7939-4713-bace-452403c97c47 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] Acquiring lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] No waiting events found dispatching network-vif-plugged-a5c80e92-7939-4713-bace-452403c97c47 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:17:00 user nova-compute[72874]: WARNING nova.compute.manager [req-a2571707-1c10-4048-8e92-0afdfdc85608 req-00f6f5e7-e21d-4935-b391-ba8590ede5d3 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Received unexpected event network-vif-plugged-a5c80e92-7939-4713-bace-452403c97c47 for instance with vm_state building and task_state spawning.
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296221.1579714, 544005af-7312-4bd4-a086-7d255ca7c479 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] VM Resumed (Lifecycle Event)
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-e96f9f0b-c545-4160-b6da-ac7dedb12645 req-7737b2f3-92b1-473f-86bb-83c33e521cad service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Received event network-vif-plugged-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e96f9f0b-c545-4160-b6da-ac7dedb12645 req-7737b2f3-92b1-473f-86bb-83c33e521cad service nova] Acquiring lock "544005af-7312-4bd4-a086-7d255ca7c479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e96f9f0b-c545-4160-b6da-ac7dedb12645 req-7737b2f3-92b1-473f-86bb-83c33e521cad service nova] Lock "544005af-7312-4bd4-a086-7d255ca7c479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e96f9f0b-c545-4160-b6da-ac7dedb12645 req-7737b2f3-92b1-473f-86bb-83c33e521cad service nova] Lock "544005af-7312-4bd4-a086-7d255ca7c479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-e96f9f0b-c545-4160-b6da-ac7dedb12645 req-7737b2f3-92b1-473f-86bb-83c33e521cad service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] No waiting events found dispatching network-vif-plugged-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:17:01 user nova-compute[72874]: WARNING nova.compute.manager [req-e96f9f0b-c545-4160-b6da-ac7dedb12645 req-7737b2f3-92b1-473f-86bb-83c33e521cad service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Received unexpected event network-vif-plugged-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e for instance with vm_state building and task_state spawning.
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Instance spawned successfully.
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Successfully updated port: 1293a9a4-696a-41b5-a2f4-10b40e30f85b {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Instance spawned successfully.
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Acquiring lock "refresh_cache-8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Acquired lock "refresh_cache-8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Instance spawned successfully.
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296221.1584306, 544005af-7312-4bd4-a086-7d255ca7c479 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] VM Started (Lifecycle Event)
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296221.196965, 8c2eb160-5b94-4d53-bd36-b712c62d9100 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] VM Resumed (Lifecycle Event)
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Took 14.03 seconds to spawn the instance on the hypervisor.
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296221.1973724, 8c2eb160-5b94-4d53-bd36-b712c62d9100 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] VM Started (Lifecycle Event)
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Took 12.05 seconds to spawn the instance on the hypervisor.
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Took 16.17 seconds to spawn the instance on the hypervisor.
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296221.2216246, ef6c7125-8a47-4e3f-bb6d-b6aa5254116c => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] VM Resumed (Lifecycle Event)
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Took 16.48 seconds to build instance.
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3a3bb1e7-f6e0-4e88-a69e-9fbc886b21d6 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.653s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Took 13.58 seconds to build instance.
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296221.2220268, ef6c7125-8a47-4e3f-bb6d-b6aa5254116c => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] VM Started (Lifecycle Event)
Aug 17 18:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-84c041b9-138c-40e0-8ef4-f0425d37f767 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lock "544005af-7312-4bd4-a086-7d255ca7c479" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.848s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:01 user nova-compute[72874]: INFO nova.compute.manager [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Took 17.63 seconds to build instance.
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c3c12562-86d5-499b-b614-321a0b6f6d0b tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.828s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Updating instance_info_cache with network_info: [{"id": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "address": "fa:16:3e:87:05:5f", "network": {"id": "d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1596285574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bee00afddbd47ada0661d599605f8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1293a9a4-69", "ovs_interfaceid": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Releasing lock "refresh_cache-8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Instance network_info: |[{"id": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "address": "fa:16:3e:87:05:5f", "network": {"id": "d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1596285574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bee00afddbd47ada0661d599605f8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1293a9a4-69", "ovs_interfaceid": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Start _get_guest_xml network_info=[{"id": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "address": "fa:16:3e:87:05:5f", "network": {"id": "d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1596285574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bee00afddbd47ada0661d599605f8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1293a9a4-69", "ovs_interfaceid": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:17:01 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:17:01 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1703735447',display_name='tempest-TestVolumeSwap-server-1703735447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1703735447',id=8,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgxhUqL/RVhNWMpw6tH6d+vjG9BaoFvtB+Cui1yC9ibU2ztgzVNc4L407KrrlG2qmZuRp66c6WTEmuLIjw1exJY4cy1+b8YjbEmAj+VXuHET8NYNask/FDwqHxzTrUgZQ==',key_name='tempest-keypair-1567981108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bee00afddbd47ada0661d599605f8b5',ramdisk_id='',reservation_id='r-ylcq1hn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1434373281',owner_user_name='tempest-TestVolumeSwap-1434373281-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa17f84da4e6430db62f92577b12d231',uuid=8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "address": "fa:16:3e:87:05:5f", "network": {"id": "d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1596285574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bee00afddbd47ada0661d599605f8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1293a9a4-69", "ovs_interfaceid": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Converting VIF {"id": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "address": "fa:16:3e:87:05:5f", "network": {"id": "d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1596285574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bee00afddbd47ada0661d599605f8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1293a9a4-69", "ovs_interfaceid": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:05:5f,bridge_name='br-int',has_traffic_filtering=True,id=1293a9a4-696a-41b5-a2f4-10b40e30f85b,network=Network(d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1293a9a4-69') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:17:01 user nova-compute[72874]:   <uuid>8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83</uuid>
Aug 17 18:17:01 user nova-compute[72874]:   <name>instance-00000008</name>
Aug 17 18:17:01 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:17:01 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:17:01 user nova-compute[72874]:   <metadata>
Aug 17 18:17:01 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:17:01 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:17:01 user nova-compute[72874]:       <nova:name>tempest-TestVolumeSwap-server-1703735447</nova:name>
Aug 17 18:17:01 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:17:01</nova:creationTime>
Aug 17 18:17:01 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:17:01 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:17:01 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:17:01 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:17:01 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:17:01 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:17:01 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:17:01 user nova-compute[72874]:       <nova:owner>
Aug 17 18:17:01 user nova-compute[72874]:         <nova:user uuid="aa17f84da4e6430db62f92577b12d231">tempest-TestVolumeSwap-1434373281-project-member</nova:user>
Aug 17 18:17:01 user nova-compute[72874]:         <nova:project uuid="7bee00afddbd47ada0661d599605f8b5">tempest-TestVolumeSwap-1434373281</nova:project>
Aug 17 18:17:01 user nova-compute[72874]:       </nova:owner>
Aug 17 18:17:01 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:17:01 user nova-compute[72874]:       <nova:ports>
Aug 17 18:17:01 user nova-compute[72874]:         <nova:port uuid="1293a9a4-696a-41b5-a2f4-10b40e30f85b">
Aug 17 18:17:01 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 18:17:01 user nova-compute[72874]:         </nova:port>
Aug 17 18:17:01 user nova-compute[72874]:       </nova:ports>
Aug 17 18:17:01 user nova-compute[72874]:     </nova:instance>
Aug 17 18:17:01 user nova-compute[72874]:   </metadata>
Aug 17 18:17:01 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:17:01 user nova-compute[72874]:     <system>
Aug 17 18:17:01 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:17:01 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:17:01 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:17:01 user nova-compute[72874]:       <entry name="serial">8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83</entry>
Aug 17 18:17:01 user nova-compute[72874]:       <entry name="uuid">8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83</entry>
Aug 17 18:17:01 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:17:01 user nova-compute[72874]:     </system>
Aug 17 18:17:01 user nova-compute[72874]:   </sysinfo>
Aug 17 18:17:01 user nova-compute[72874]:   <os>
Aug 17 18:17:01 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:17:01 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:17:01 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:17:01 user nova-compute[72874]:   </os>
Aug 17 18:17:01 user nova-compute[72874]:   <features>
Aug 17 18:17:01 user nova-compute[72874]:     <acpi/>
Aug 17 18:17:01 user nova-compute[72874]:     <apic/>
Aug 17 18:17:01 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:17:01 user nova-compute[72874]:   </features>
Aug 17 18:17:01 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:17:01 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:17:01 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:17:01 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:17:01 user nova-compute[72874]:   </clock>
Aug 17 18:17:01 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:17:01 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:17:01 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:17:01 user nova-compute[72874]:   </cpu>
Aug 17 18:17:01 user nova-compute[72874]:   <devices>
Aug 17 18:17:01 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:17:01 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:17:01 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk"/>
Aug 17 18:17:01 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:17:01 user nova-compute[72874]:     </disk>
Aug 17 18:17:01 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:17:01 user nova-compute[72874]:       <mac address="fa:16:3e:87:05:5f"/>
Aug 17 18:17:01 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:17:01 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:17:01 user nova-compute[72874]:       <target dev="tap1293a9a4-69"/>
Aug 17 18:17:01 user nova-compute[72874]:     </interface>
Aug 17 18:17:01 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:17:01 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/console.log" append="off"/>
Aug 17 18:17:01 user nova-compute[72874]:     </serial>
Aug 17 18:17:01 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:17:01 user nova-compute[72874]:     <video>
Aug 17 18:17:01 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:17:01 user nova-compute[72874]:     </video>
Aug 17 18:17:01 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:17:01 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:17:01 user nova-compute[72874]:     </rng>
Aug 17 18:17:01 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:17:01 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:17:01 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:17:01 user nova-compute[72874]:     </memballoon>
Aug 17 18:17:01 user nova-compute[72874]:   </devices>
Aug 17 18:17:01 user nova-compute[72874]: </domain>
Aug 17 18:17:01 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1703735447',display_name='tempest-TestVolumeSwap-server-1703735447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1703735447',id=8,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgxhUqL/RVhNWMpw6tH6d+vjG9BaoFvtB+Cui1yC9ibU2ztgzVNc4L407KrrlG2qmZuRp66c6WTEmuLIjw1exJY4cy1+b8YjbEmAj+VXuHET8NYNask/FDwqHxzTrUgZQ==',key_name='tempest-keypair-1567981108',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7bee00afddbd47ada0661d599605f8b5',ramdisk_id='',reservation_id='r-ylcq1hn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1434373281',owner_user_name='tempest-TestVolumeSwap-1434373281-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:16:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa17f84da4e6430db62f92577b12d231',uuid=8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "address": "fa:16:3e:87:05:5f", "network": {"id": "d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1596285574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bee00afddbd47ada0661d599605f8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1293a9a4-69", "ovs_interfaceid": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Converting VIF {"id": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "address": "fa:16:3e:87:05:5f", "network": {"id": "d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1596285574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bee00afddbd47ada0661d599605f8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1293a9a4-69", "ovs_interfaceid": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:05:5f,bridge_name='br-int',has_traffic_filtering=True,id=1293a9a4-696a-41b5-a2f4-10b40e30f85b,network=Network(d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1293a9a4-69') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG os_vif [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:05:5f,bridge_name='br-int',has_traffic_filtering=True,id=1293a9a4-696a-41b5-a2f4-10b40e30f85b,network=Network(d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1293a9a4-69') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1293a9a4-69, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1293a9a4-69, col_values=(('external_ids', {'iface-id': '1293a9a4-696a-41b5-a2f4-10b40e30f85b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:05:5f', 'vm-uuid': '8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:17:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:01 user nova-compute[72874]: INFO os_vif [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:05:5f,bridge_name='br-int',has_traffic_filtering=True,id=1293a9a4-696a-41b5-a2f4-10b40e30f85b,network=Network(d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1293a9a4-69')
Aug 17 18:17:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:17:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] No VIF found with MAC fa:16:3e:87:05:5f, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:17:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Received event network-vif-plugged-99361343-b109-451a-9ce9-50e5fd738b0e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] Acquiring lock "8c2eb160-5b94-4d53-bd36-b712c62d9100-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] No waiting events found dispatching network-vif-plugged-99361343-b109-451a-9ce9-50e5fd738b0e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:17:02 user nova-compute[72874]: WARNING nova.compute.manager [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Received unexpected event network-vif-plugged-99361343-b109-451a-9ce9-50e5fd738b0e for instance with vm_state active and task_state None.
Aug 17 18:17:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Received event network-vif-plugged-99361343-b109-451a-9ce9-50e5fd738b0e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] Acquiring lock "8c2eb160-5b94-4d53-bd36-b712c62d9100-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] No waiting events found dispatching network-vif-plugged-99361343-b109-451a-9ce9-50e5fd738b0e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:17:02 user nova-compute[72874]: WARNING nova.compute.manager [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Received unexpected event network-vif-plugged-99361343-b109-451a-9ce9-50e5fd738b0e for instance with vm_state active and task_state None.
Aug 17 18:17:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Received event network-changed-1293a9a4-696a-41b5-a2f4-10b40e30f85b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Refreshing instance network info cache due to event network-changed-1293a9a4-696a-41b5-a2f4-10b40e30f85b. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:17:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] Acquiring lock "refresh_cache-8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:17:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] Acquired lock "refresh_cache-8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:17:02 user nova-compute[72874]: DEBUG nova.network.neutron [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Refreshing network info cache for port 1293a9a4-696a-41b5-a2f4-10b40e30f85b {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:17:03 user nova-compute[72874]: DEBUG nova.network.neutron [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Updated VIF entry in instance network info cache for port 1293a9a4-696a-41b5-a2f4-10b40e30f85b. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:17:03 user nova-compute[72874]: DEBUG nova.network.neutron [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Updating instance_info_cache with network_info: [{"id": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "address": "fa:16:3e:87:05:5f", "network": {"id": "d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1596285574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bee00afddbd47ada0661d599605f8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1293a9a4-69", "ovs_interfaceid": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:17:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-729f82c2-9633-49fa-aca8-a264e9830b89 req-97f693e6-1b0f-4edc-8be3-ee78f4246237 service nova] Releasing lock "refresh_cache-8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:17:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:04 user nova-compute[72874]: DEBUG nova.compute.manager [req-0181c98f-4da3-4e71-8372-d8c2a3166c29 req-a48e73cf-b597-48e4-a56c-3b1e1058f0fa service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Received event network-vif-plugged-1293a9a4-696a-41b5-a2f4-10b40e30f85b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0181c98f-4da3-4e71-8372-d8c2a3166c29 req-a48e73cf-b597-48e4-a56c-3b1e1058f0fa service nova] Acquiring lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0181c98f-4da3-4e71-8372-d8c2a3166c29 req-a48e73cf-b597-48e4-a56c-3b1e1058f0fa service nova] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0181c98f-4da3-4e71-8372-d8c2a3166c29 req-a48e73cf-b597-48e4-a56c-3b1e1058f0fa service nova] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:04 user nova-compute[72874]: DEBUG nova.compute.manager [req-0181c98f-4da3-4e71-8372-d8c2a3166c29 req-a48e73cf-b597-48e4-a56c-3b1e1058f0fa service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] No waiting events found dispatching network-vif-plugged-1293a9a4-696a-41b5-a2f4-10b40e30f85b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:17:04 user nova-compute[72874]: WARNING nova.compute.manager [req-0181c98f-4da3-4e71-8372-d8c2a3166c29 req-a48e73cf-b597-48e4-a56c-3b1e1058f0fa service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Received unexpected event network-vif-plugged-1293a9a4-696a-41b5-a2f4-10b40e30f85b for instance with vm_state building and task_state spawning.
Aug 17 18:17:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296226.422865, 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:17:06 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] VM Resumed (Lifecycle Event)
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:17:06 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Instance spawned successfully.
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:17:06 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296226.4248297, 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:17:06 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] VM Started (Lifecycle Event)
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:06 user nova-compute[72874]: INFO nova.compute.manager [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Took 8.30 seconds to spawn the instance on the hypervisor.
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:17:06 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-a4767889-d1e5-465b-b2a0-6ea8e75a7fac req-c7544d70-3c31-4486-b573-0115c14d7bf0 service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Received event network-vif-plugged-1293a9a4-696a-41b5-a2f4-10b40e30f85b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a4767889-d1e5-465b-b2a0-6ea8e75a7fac req-c7544d70-3c31-4486-b573-0115c14d7bf0 service nova] Acquiring lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a4767889-d1e5-465b-b2a0-6ea8e75a7fac req-c7544d70-3c31-4486-b573-0115c14d7bf0 service nova] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a4767889-d1e5-465b-b2a0-6ea8e75a7fac req-c7544d70-3c31-4486-b573-0115c14d7bf0 service nova] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-a4767889-d1e5-465b-b2a0-6ea8e75a7fac req-c7544d70-3c31-4486-b573-0115c14d7bf0 service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] No waiting events found dispatching network-vif-plugged-1293a9a4-696a-41b5-a2f4-10b40e30f85b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:17:06 user nova-compute[72874]: WARNING nova.compute.manager [req-a4767889-d1e5-465b-b2a0-6ea8e75a7fac req-c7544d70-3c31-4486-b573-0115c14d7bf0 service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Received unexpected event network-vif-plugged-1293a9a4-696a-41b5-a2f4-10b40e30f85b for instance with vm_state building and task_state spawning.
Aug 17 18:17:06 user nova-compute[72874]: INFO nova.compute.manager [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Took 9.98 seconds to build instance.
Aug 17 18:17:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9001ce0-38e0-453c-a6eb-8ffb82d69de2 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.102s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:17:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:17:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 18:17:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] There are 0 instances to clean {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 18:17:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:17:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 18:17:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:17:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:17:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:17:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:09 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:17:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "7c486f7d-bcad-4c83-98bf-f08559259d33" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:17:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:09 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:17:09 user nova-compute[72874]: INFO nova.compute.claims [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Claim successful on node user
Aug 17 18:17:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:10 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:17:10 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:17:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.852s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:17:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:17:10 user nova-compute[72874]: DEBUG nova.network.neutron [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:17:10 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:17:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:17:10 user nova-compute[72874]: INFO nova.virt.block_device [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Booting with volume 44d2d09e-f58b-4287-a79b-73f2c406e0a5 at /dev/vda
Aug 17 18:17:10 user nova-compute[72874]: DEBUG nova.policy [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bb6178a9238a4c6ca4f80eea57962534', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0ce530e304a47e49163e5e16a07af5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:17:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:11 user nova-compute[72874]: DEBUG os_brick.utils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:17:11 user nova-compute[72874]: INFO oslo.privsep.daemon [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpz7p8wf0i/privsep.sock']
Aug 17 18:17:11 user sudo[83567]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpz7p8wf0i/privsep.sock
Aug 17 18:17:11 user sudo[83567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 18:17:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:12 user nova-compute[72874]: DEBUG nova.network.neutron [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Successfully created port: 82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:17:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk --force-share --output=json" returned: 0 in 0.315s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:13 user sudo[83567]: pam_unix(sudo:session): session closed for user root
Aug 17 18:17:13 user nova-compute[72874]: INFO oslo.privsep.daemon [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Spawned new privsep daemon via rootwrap
Aug 17 18:17:13 user nova-compute[72874]: DEBUG nova.network.neutron [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Successfully updated port: 82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:17:13 user nova-compute[72874]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 18:17:13 user nova-compute[72874]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 18:17:13 user nova-compute[72874]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 17 18:17:13 user nova-compute[72874]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83588
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5715886-3987-4d6b-961d-bf80fae40f84]: (2,) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "refresh_cache-7c486f7d-bcad-4c83-98bf-f08559259d33" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquired lock "refresh_cache-7c486f7d-bcad-4c83-98bf-f08559259d33" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG nova.network.neutron [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG nova.compute.manager [req-c3ec32ec-a2dd-483b-9b0f-6bf8c9f745de req-1738548e-a966-4bb5-8234-b00162e1742b service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received event network-changed-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG nova.compute.manager [req-c3ec32ec-a2dd-483b-9b0f-6bf8c9f745de req-1738548e-a966-4bb5-8234-b00162e1742b service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Refreshing instance network info cache due to event network-changed-82fadf6c-c99c-4db9-8f9c-f05d33415d5c. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c3ec32ec-a2dd-483b-9b0f-6bf8c9f745de req-1738548e-a966-4bb5-8234-b00162e1742b service nova] Acquiring lock "refresh_cache-7c486f7d-bcad-4c83-98bf-f08559259d33" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG nova.network.neutron [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1001ae5d-c710-49a1-ac48-2d70852c46b5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:13 user nova-compute[72874]: WARNING os_brick.initiator.connectors.nvmeof [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.032s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8477043-fa63-4cb6-9919-2c776785e836]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a59f9d-dae3-47af-bda4-df59409751b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5847c94-2bdb-44a4-913a-53e8fb92cd31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:17:13 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eaf5985-0e3c-499d-8461-177cdfcb408a]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG os_brick.utils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] <== get_connector_properties: return (2789ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Updating existing volume attachment record: 666120b5-1116-4569-8bf5-60593e67c86c {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:17:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG nova.network.neutron [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Updating instance_info_cache with network_info: [{"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:17:14 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:17:14 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:17:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7580MB free_disk=25.785778045654297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Releasing lock "refresh_cache-7c486f7d-bcad-4c83-98bf-f08559259d33" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Instance network_info: |[{"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c3ec32ec-a2dd-483b-9b0f-6bf8c9f745de req-1738548e-a966-4bb5-8234-b00162e1742b service nova] Acquired lock "refresh_cache-7c486f7d-bcad-4c83-98bf-f08559259d33" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG nova.network.neutron [req-c3ec32ec-a2dd-483b-9b0f-6bf8c9f745de req-1738548e-a966-4bb5-8234-b00162e1742b service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Refreshing network info cache for port 82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance c27fc8b6-cc8c-426a-859d-04722c569cd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 3bf88e4a-ee43-471a-b375-30684f09c3e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance f027045c-d121-45ec-af61-e1a2399c4a43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance ef6c7125-8a47-4e3f-bb6d-b6aa5254116c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c2eb160-5b94-4d53-bd36-b712c62d9100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 544005af-7312-4bd4-a086-7d255ca7c479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 7c486f7d-bcad-4c83-98bf-f08559259d33 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:17:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:17:15 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:17:15 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:17:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:17:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:15 user nova-compute[72874]: DEBUG nova.network.neutron [req-c3ec32ec-a2dd-483b-9b0f-6bf8c9f745de req-1738548e-a966-4bb5-8234-b00162e1742b service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Updated VIF entry in instance network info cache for port 82fadf6c-c99c-4db9-8f9c-f05d33415d5c. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:17:15 user nova-compute[72874]: DEBUG nova.network.neutron [req-c3ec32ec-a2dd-483b-9b0f-6bf8c9f745de req-1738548e-a966-4bb5-8234-b00162e1742b service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Updating instance_info_cache with network_info: [{"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:17:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c3ec32ec-a2dd-483b-9b0f-6bf8c9f745de req-1738548e-a966-4bb5-8234-b00162e1742b service nova] Releasing lock "refresh_cache-7c486f7d-bcad-4c83-98bf-f08559259d33" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:17:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:17:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:17:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:17:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Skipping network cache update for instance because it is Building. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 18:17:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:17:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:17:16 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:17:16 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid c27fc8b6-cc8c-426a-859d-04722c569cd4 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:17:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:17 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Updating instance_info_cache with network_info: [{"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:17:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:17:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:17:17 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:17:17 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:17:17 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:17:17 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:17:17 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:17:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:17:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:17:26 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Creating image(s)
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Ensure instance console log exists: /opt/stack/data/nova/instances/7c486f7d-bcad-4c83-98bf-f08559259d33/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Start _get_guest_xml network_info=[{"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sakPJxrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c486f7d-bcad-4c83-98bf-f08559259d33', 'attached_at': '', 'detached_at': '', 'volume_id': '44d2d09e-f58b-4287-a79b-73f2c406e0a5', 'serial': '44d2d09e-f58b-4287-a79b-73f2c406e0a5'}, 'delete_on_termination': True, 'attachment_id': '666120b5-1116-4569-8bf5-60593e67c86c', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:17:26 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:17:26 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connector [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Factory for ISCSI on None {{(pid=72874) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sakPJxrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:17:26 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:17:26 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:17:26 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d68cd5f-1862-4fbe-b6c8-dd4f5d54f465]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:17:26 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e720aa6-53b7-4ae6-872b-1ae3153452e4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5] added
Aug 17 18:17:26 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cd5888-fe03-4617-b30a-7edb8cba4f48]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b924371-5008-401f-aa78-34b0daf4ea20]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sakPJxrD {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sakPJxrD" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d553c06-581a-4700-bc85-57bfc2c35f2d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sakPJxrD'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6451ee3-50fe-4dad-8daf-0bb8ac08b4ab]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5737f223-e188-436f-8c2f-7db0fe69182a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 18:17:26 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 18:17:26 user nova-compute[72874]:  {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:17:26 user nova-compute[72874]: WARNING os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 18:17:26 user nova-compute[72874]: 
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1efbeec-d678-4bf4-97d8-4c90b6c6d829]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5, portal: 172.16.0.220,3260]
Aug 17 18:17:26 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5, portal: 172.16.0.220,3260] successful.
Aug 17 18:17:26 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42d82b0-a960-4148-831a-1ca5425fd173]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d709fa-07fe-4194-b3db-913298c09658]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:17:26 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:17:26 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3706b1-5b8e-4575-9ddb-f3db2bf5ed17]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sakPJxrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:17:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23630353666643437', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630353666643437', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2121101201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2121101201',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHO7rkeC9pzXuKB0SzBYgruoGhDzERqiJUXWtIfbrLLf7ig2/MHev5D+kN1SaVM8QqD4bJCvdEFBeAQxW3jsr31paoEijftB74Jxx/L7jR166vAUYf/FeWQK16Y3ojsdFg==',key_name='tempest-keypair-809304444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0ce530e304a47e49163e5e16a07af5a',ramdisk_id='',reservation_id='r-9lpxt6gu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-423641309',owner_user_name='tempest-ServerActionsV293TestJSON-423641309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb6178a9238a4c6ca4f80eea57962534',uuid=7c486f7d-bcad-4c83-98bf-f08559259d33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Converting VIF {"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:12:45,bridge_name='br-int',has_traffic_filtering=True,id=82fadf6c-c99c-4db9-8f9c-f05d33415d5c,network=Network(cce89dc3-ea6a-4e83-94a1-6bc08392b565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82fadf6c-c9') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG nova.objects.instance [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c486f7d-bcad-4c83-98bf-f08559259d33 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:17:27 user nova-compute[72874]:   <uuid>7c486f7d-bcad-4c83-98bf-f08559259d33</uuid>
Aug 17 18:17:27 user nova-compute[72874]:   <name>instance-00000009</name>
Aug 17 18:17:27 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:17:27 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:17:27 user nova-compute[72874]:   <metadata>
Aug 17 18:17:27 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:17:27 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:17:27 user nova-compute[72874]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2121101201</nova:name>
Aug 17 18:17:27 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:17:26</nova:creationTime>
Aug 17 18:17:27 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:17:27 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:17:27 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:17:27 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:17:27 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:17:27 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:17:27 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:17:27 user nova-compute[72874]:       <nova:owner>
Aug 17 18:17:27 user nova-compute[72874]:         <nova:user uuid="bb6178a9238a4c6ca4f80eea57962534">tempest-ServerActionsV293TestJSON-423641309-project-member</nova:user>
Aug 17 18:17:27 user nova-compute[72874]:         <nova:project uuid="b0ce530e304a47e49163e5e16a07af5a">tempest-ServerActionsV293TestJSON-423641309</nova:project>
Aug 17 18:17:27 user nova-compute[72874]:       </nova:owner>
Aug 17 18:17:27 user nova-compute[72874]:       <nova:ports>
Aug 17 18:17:27 user nova-compute[72874]:         <nova:port uuid="82fadf6c-c99c-4db9-8f9c-f05d33415d5c">
Aug 17 18:17:27 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 18:17:27 user nova-compute[72874]:         </nova:port>
Aug 17 18:17:27 user nova-compute[72874]:       </nova:ports>
Aug 17 18:17:27 user nova-compute[72874]:     </nova:instance>
Aug 17 18:17:27 user nova-compute[72874]:   </metadata>
Aug 17 18:17:27 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:17:27 user nova-compute[72874]:     <system>
Aug 17 18:17:27 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:17:27 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:17:27 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:17:27 user nova-compute[72874]:       <entry name="serial">7c486f7d-bcad-4c83-98bf-f08559259d33</entry>
Aug 17 18:17:27 user nova-compute[72874]:       <entry name="uuid">7c486f7d-bcad-4c83-98bf-f08559259d33</entry>
Aug 17 18:17:27 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:17:27 user nova-compute[72874]:     </system>
Aug 17 18:17:27 user nova-compute[72874]:   </sysinfo>
Aug 17 18:17:27 user nova-compute[72874]:   <os>
Aug 17 18:17:27 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:17:27 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:17:27 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:17:27 user nova-compute[72874]:   </os>
Aug 17 18:17:27 user nova-compute[72874]:   <features>
Aug 17 18:17:27 user nova-compute[72874]:     <acpi/>
Aug 17 18:17:27 user nova-compute[72874]:     <apic/>
Aug 17 18:17:27 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:17:27 user nova-compute[72874]:   </features>
Aug 17 18:17:27 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:17:27 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:17:27 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:17:27 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:17:27 user nova-compute[72874]:   </clock>
Aug 17 18:17:27 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:17:27 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:17:27 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:17:27 user nova-compute[72874]:   </cpu>
Aug 17 18:17:27 user nova-compute[72874]:   <devices>
Aug 17 18:17:27 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:17:27 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:17:27 user nova-compute[72874]:       <source dev="/dev/sdb"/>
Aug 17 18:17:27 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:17:27 user nova-compute[72874]:       <serial>44d2d09e-f58b-4287-a79b-73f2c406e0a5</serial>
Aug 17 18:17:27 user nova-compute[72874]:     </disk>
Aug 17 18:17:27 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:17:27 user nova-compute[72874]:       <mac address="fa:16:3e:44:12:45"/>
Aug 17 18:17:27 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:17:27 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:17:27 user nova-compute[72874]:       <target dev="tap82fadf6c-c9"/>
Aug 17 18:17:27 user nova-compute[72874]:     </interface>
Aug 17 18:17:27 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:17:27 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/7c486f7d-bcad-4c83-98bf-f08559259d33/console.log" append="off"/>
Aug 17 18:17:27 user nova-compute[72874]:     </serial>
Aug 17 18:17:27 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:17:27 user nova-compute[72874]:     <video>
Aug 17 18:17:27 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:17:27 user nova-compute[72874]:     </video>
Aug 17 18:17:27 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:17:27 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:17:27 user nova-compute[72874]:     </rng>
Aug 17 18:17:27 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:17:27 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:17:27 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:17:27 user nova-compute[72874]:     </memballoon>
Aug 17 18:17:27 user nova-compute[72874]:   </devices>
Aug 17 18:17:27 user nova-compute[72874]: </domain>
Aug 17 18:17:27 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2121101201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2121101201',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHO7rkeC9pzXuKB0SzBYgruoGhDzERqiJUXWtIfbrLLf7ig2/MHev5D+kN1SaVM8QqD4bJCvdEFBeAQxW3jsr31paoEijftB74Jxx/L7jR166vAUYf/FeWQK16Y3ojsdFg==',key_name='tempest-keypair-809304444',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0ce530e304a47e49163e5e16a07af5a',ramdisk_id='',reservation_id='r-9lpxt6gu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-423641309',owner_user_name='tempest-ServerActionsV293TestJSON-423641309-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb6178a9238a4c6ca4f80eea57962534',uuid=7c486f7d-bcad-4c83-98bf-f08559259d33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Converting VIF {"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:12:45,bridge_name='br-int',has_traffic_filtering=True,id=82fadf6c-c99c-4db9-8f9c-f05d33415d5c,network=Network(cce89dc3-ea6a-4e83-94a1-6bc08392b565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82fadf6c-c9') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG os_vif [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:12:45,bridge_name='br-int',has_traffic_filtering=True,id=82fadf6c-c99c-4db9-8f9c-f05d33415d5c,network=Network(cce89dc3-ea6a-4e83-94a1-6bc08392b565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82fadf6c-c9') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82fadf6c-c9, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap82fadf6c-c9, col_values=(('external_ids', {'iface-id': '82fadf6c-c99c-4db9-8f9c-f05d33415d5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:12:45', 'vm-uuid': '7c486f7d-bcad-4c83-98bf-f08559259d33'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:27 user nova-compute[72874]: INFO os_vif [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:12:45,bridge_name='br-int',has_traffic_filtering=True,id=82fadf6c-c99c-4db9-8f9c-f05d33415d5c,network=Network(cce89dc3-ea6a-4e83-94a1-6bc08392b565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82fadf6c-c9')
Aug 17 18:17:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:17:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] No VIF found with MAC fa:16:3e:44:12:45, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:17:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-3d595400-0cfd-4b03-8560-508f0c8b45da req-935646bc-265e-4c3f-9a33-07c8d3df1f68 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received event network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3d595400-0cfd-4b03-8560-508f0c8b45da req-935646bc-265e-4c3f-9a33-07c8d3df1f68 service nova] Acquiring lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3d595400-0cfd-4b03-8560-508f0c8b45da req-935646bc-265e-4c3f-9a33-07c8d3df1f68 service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3d595400-0cfd-4b03-8560-508f0c8b45da req-935646bc-265e-4c3f-9a33-07c8d3df1f68 service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-3d595400-0cfd-4b03-8560-508f0c8b45da req-935646bc-265e-4c3f-9a33-07c8d3df1f68 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] No waiting events found dispatching network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:17:29 user nova-compute[72874]: WARNING nova.compute.manager [req-3d595400-0cfd-4b03-8560-508f0c8b45da req-935646bc-265e-4c3f-9a33-07c8d3df1f68 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received unexpected event network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c for instance with vm_state building and task_state spawning.
Aug 17 18:17:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Acquiring lock "2b854f0d-7305-41d5-8188-12ae9050e213" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lock "2b854f0d-7305-41d5-8188-12ae9050e213" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:30 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:17:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:17:30 user nova-compute[72874]: INFO nova.compute.claims [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Claim successful on node user
Aug 17 18:17:30 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Refreshing inventories for resource provider b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 18:17:30 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Updating ProviderTree inventory for provider b677d836-b01b-4674-8972-53d526f1b5f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 18:17:30 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Updating inventory in ProviderTree for provider b677d836-b01b-4674-8972-53d526f1b5f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 18:17:30 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Refreshing aggregate associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, aggregates: None {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 18:17:30 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Refreshing trait associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, traits: HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296251.2382662, 7c486f7d-bcad-4c83-98bf-f08559259d33 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:17:31 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] VM Resumed (Lifecycle Event)
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:17:31 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Instance spawned successfully.
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.compute.manager [req-9be0a22d-7f49-4cd9-91dc-97d7ccec4125 req-22f53a80-da64-4d39-b184-3825ef5ac161 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received event network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9be0a22d-7f49-4cd9-91dc-97d7ccec4125 req-22f53a80-da64-4d39-b184-3825ef5ac161 service nova] Acquiring lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9be0a22d-7f49-4cd9-91dc-97d7ccec4125 req-22f53a80-da64-4d39-b184-3825ef5ac161 service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9be0a22d-7f49-4cd9-91dc-97d7ccec4125 req-22f53a80-da64-4d39-b184-3825ef5ac161 service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.compute.manager [req-9be0a22d-7f49-4cd9-91dc-97d7ccec4125 req-22f53a80-da64-4d39-b184-3825ef5ac161 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] No waiting events found dispatching network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:17:31 user nova-compute[72874]: WARNING nova.compute.manager [req-9be0a22d-7f49-4cd9-91dc-97d7ccec4125 req-22f53a80-da64-4d39-b184-3825ef5ac161 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received unexpected event network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c for instance with vm_state building and task_state spawning.
Aug 17 18:17:31 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296251.240436, 7c486f7d-bcad-4c83-98bf-f08559259d33 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:17:31 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] VM Started (Lifecycle Event)
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.665s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:17:31 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:17:31 user nova-compute[72874]: INFO nova.compute.manager [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Took 5.25 seconds to spawn the instance on the hypervisor.
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:17:31 user nova-compute[72874]: INFO nova.compute.manager [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Took 21.86 seconds to build instance.
Aug 17 18:17:31 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:17:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4e4a9f83-c2c2-401d-b213-9f154f93145e tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.996s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:17:31 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Creating image(s)
Aug 17 18:17:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lock "/opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lock "/opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG nova.policy [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5a612b21f8664e16901b38f3ba875604', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ebc374d01934c2980c5765ee2e4ba73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.209s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.184s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk 1073741824" returned: 0 in 0.049s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Cannot resize image /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG nova.objects.instance [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lazy-loading 'migration_context' on Instance uuid 2b854f0d-7305-41d5-8188-12ae9050e213 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Ensure instance console log exists: /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:32 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Successfully created port: 8f985466-eea4-4ddd-b005-4f3533dff86b {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Successfully updated port: 8f985466-eea4-4ddd-b005-4f3533dff86b {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Acquiring lock "refresh_cache-2b854f0d-7305-41d5-8188-12ae9050e213" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Acquired lock "refresh_cache-2b854f0d-7305-41d5-8188-12ae9050e213" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-ff657c15-6a24-443b-8223-bdb3926bd0fb req-cc1841e5-f968-4c15-ae9c-065cf79e8f3f service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Received event network-changed-8f985466-eea4-4ddd-b005-4f3533dff86b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-ff657c15-6a24-443b-8223-bdb3926bd0fb req-cc1841e5-f968-4c15-ae9c-065cf79e8f3f service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Refreshing instance network info cache due to event network-changed-8f985466-eea4-4ddd-b005-4f3533dff86b. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ff657c15-6a24-443b-8223-bdb3926bd0fb req-cc1841e5-f968-4c15-ae9c-065cf79e8f3f service nova] Acquiring lock "refresh_cache-2b854f0d-7305-41d5-8188-12ae9050e213" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Updating instance_info_cache with network_info: [{"id": "8f985466-eea4-4ddd-b005-4f3533dff86b", "address": "fa:16:3e:c4:73:fb", "network": {"id": "1d7ab6e9-a793-455f-9932-8a7dbec20dcb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861987999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebc374d01934c2980c5765ee2e4ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f985466-ee", "ovs_interfaceid": "8f985466-eea4-4ddd-b005-4f3533dff86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Releasing lock "refresh_cache-2b854f0d-7305-41d5-8188-12ae9050e213" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Instance network_info: |[{"id": "8f985466-eea4-4ddd-b005-4f3533dff86b", "address": "fa:16:3e:c4:73:fb", "network": {"id": "1d7ab6e9-a793-455f-9932-8a7dbec20dcb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861987999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebc374d01934c2980c5765ee2e4ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f985466-ee", "ovs_interfaceid": "8f985466-eea4-4ddd-b005-4f3533dff86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ff657c15-6a24-443b-8223-bdb3926bd0fb req-cc1841e5-f968-4c15-ae9c-065cf79e8f3f service nova] Acquired lock "refresh_cache-2b854f0d-7305-41d5-8188-12ae9050e213" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.network.neutron [req-ff657c15-6a24-443b-8223-bdb3926bd0fb req-cc1841e5-f968-4c15-ae9c-065cf79e8f3f service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Refreshing network info cache for port 8f985466-eea4-4ddd-b005-4f3533dff86b {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Start _get_guest_xml network_info=[{"id": "8f985466-eea4-4ddd-b005-4f3533dff86b", "address": "fa:16:3e:c4:73:fb", "network": {"id": "1d7ab6e9-a793-455f-9932-8a7dbec20dcb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861987999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebc374d01934c2980c5765ee2e4ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f985466-ee", "ovs_interfaceid": "8f985466-eea4-4ddd-b005-4f3533dff86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:17:34 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:17:34 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2111298094',display_name='tempest-VolumesActionsTest-instance-2111298094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2111298094',id=10,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ebc374d01934c2980c5765ee2e4ba73',ramdisk_id='',reservation_id='r-k3yrz9cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-507325747',owner_user_name='tempest-VolumesActionsTest-507325747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:32Z,user_data=None,user_id='5a612b21f8664e16901b38f3ba875604',uuid=2b854f0d-7305-41d5-8188-12ae9050e213,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f985466-eea4-4ddd-b005-4f3533dff86b", "address": "fa:16:3e:c4:73:fb", "network": {"id": "1d7ab6e9-a793-455f-9932-8a7dbec20dcb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861987999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebc374d01934c2980c5765ee2e4ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f985466-ee", "ovs_interfaceid": "8f985466-eea4-4ddd-b005-4f3533dff86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Converting VIF {"id": "8f985466-eea4-4ddd-b005-4f3533dff86b", "address": "fa:16:3e:c4:73:fb", "network": {"id": "1d7ab6e9-a793-455f-9932-8a7dbec20dcb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861987999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebc374d01934c2980c5765ee2e4ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f985466-ee", "ovs_interfaceid": "8f985466-eea4-4ddd-b005-4f3533dff86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:73:fb,bridge_name='br-int',has_traffic_filtering=True,id=8f985466-eea4-4ddd-b005-4f3533dff86b,network=Network(1d7ab6e9-a793-455f-9932-8a7dbec20dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f985466-ee') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.objects.instance [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b854f0d-7305-41d5-8188-12ae9050e213 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:17:34 user nova-compute[72874]:   <uuid>2b854f0d-7305-41d5-8188-12ae9050e213</uuid>
Aug 17 18:17:34 user nova-compute[72874]:   <name>instance-0000000a</name>
Aug 17 18:17:34 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:17:34 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:17:34 user nova-compute[72874]:   <metadata>
Aug 17 18:17:34 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:17:34 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:17:34 user nova-compute[72874]:       <nova:name>tempest-VolumesActionsTest-instance-2111298094</nova:name>
Aug 17 18:17:34 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:17:34</nova:creationTime>
Aug 17 18:17:34 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:17:34 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:17:34 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:17:34 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:17:34 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:17:34 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:17:34 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:17:34 user nova-compute[72874]:       <nova:owner>
Aug 17 18:17:34 user nova-compute[72874]:         <nova:user uuid="5a612b21f8664e16901b38f3ba875604">tempest-VolumesActionsTest-507325747-project-member</nova:user>
Aug 17 18:17:34 user nova-compute[72874]:         <nova:project uuid="1ebc374d01934c2980c5765ee2e4ba73">tempest-VolumesActionsTest-507325747</nova:project>
Aug 17 18:17:34 user nova-compute[72874]:       </nova:owner>
Aug 17 18:17:34 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:17:34 user nova-compute[72874]:       <nova:ports>
Aug 17 18:17:34 user nova-compute[72874]:         <nova:port uuid="8f985466-eea4-4ddd-b005-4f3533dff86b">
Aug 17 18:17:34 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 18:17:34 user nova-compute[72874]:         </nova:port>
Aug 17 18:17:34 user nova-compute[72874]:       </nova:ports>
Aug 17 18:17:34 user nova-compute[72874]:     </nova:instance>
Aug 17 18:17:34 user nova-compute[72874]:   </metadata>
Aug 17 18:17:34 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:17:34 user nova-compute[72874]:     <system>
Aug 17 18:17:34 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:17:34 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:17:34 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:17:34 user nova-compute[72874]:       <entry name="serial">2b854f0d-7305-41d5-8188-12ae9050e213</entry>
Aug 17 18:17:34 user nova-compute[72874]:       <entry name="uuid">2b854f0d-7305-41d5-8188-12ae9050e213</entry>
Aug 17 18:17:34 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:17:34 user nova-compute[72874]:     </system>
Aug 17 18:17:34 user nova-compute[72874]:   </sysinfo>
Aug 17 18:17:34 user nova-compute[72874]:   <os>
Aug 17 18:17:34 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:17:34 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:17:34 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:17:34 user nova-compute[72874]:   </os>
Aug 17 18:17:34 user nova-compute[72874]:   <features>
Aug 17 18:17:34 user nova-compute[72874]:     <acpi/>
Aug 17 18:17:34 user nova-compute[72874]:     <apic/>
Aug 17 18:17:34 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:17:34 user nova-compute[72874]:   </features>
Aug 17 18:17:34 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:17:34 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:17:34 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:17:34 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:17:34 user nova-compute[72874]:   </clock>
Aug 17 18:17:34 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:17:34 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:17:34 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:17:34 user nova-compute[72874]:   </cpu>
Aug 17 18:17:34 user nova-compute[72874]:   <devices>
Aug 17 18:17:34 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:17:34 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:17:34 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk"/>
Aug 17 18:17:34 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:17:34 user nova-compute[72874]:     </disk>
Aug 17 18:17:34 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:17:34 user nova-compute[72874]:       <mac address="fa:16:3e:c4:73:fb"/>
Aug 17 18:17:34 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:17:34 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:17:34 user nova-compute[72874]:       <target dev="tap8f985466-ee"/>
Aug 17 18:17:34 user nova-compute[72874]:     </interface>
Aug 17 18:17:34 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:17:34 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/console.log" append="off"/>
Aug 17 18:17:34 user nova-compute[72874]:     </serial>
Aug 17 18:17:34 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:17:34 user nova-compute[72874]:     <video>
Aug 17 18:17:34 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:17:34 user nova-compute[72874]:     </video>
Aug 17 18:17:34 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:17:34 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:17:34 user nova-compute[72874]:     </rng>
Aug 17 18:17:34 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:17:34 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:17:34 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:17:34 user nova-compute[72874]:     </memballoon>
Aug 17 18:17:34 user nova-compute[72874]:   </devices>
Aug 17 18:17:34 user nova-compute[72874]: </domain>
Aug 17 18:17:34 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2111298094',display_name='tempest-VolumesActionsTest-instance-2111298094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2111298094',id=10,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ebc374d01934c2980c5765ee2e4ba73',ramdisk_id='',reservation_id='r-k3yrz9cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-507325747',owner_user_name='tempest-VolumesActionsTest-507325747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:32Z,user_data=None,user_id='5a612b21f8664e16901b38f3ba875604',uuid=2b854f0d-7305-41d5-8188-12ae9050e213,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f985466-eea4-4ddd-b005-4f3533dff86b", "address": "fa:16:3e:c4:73:fb", "network": {"id": "1d7ab6e9-a793-455f-9932-8a7dbec20dcb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861987999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebc374d01934c2980c5765ee2e4ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f985466-ee", "ovs_interfaceid": "8f985466-eea4-4ddd-b005-4f3533dff86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Converting VIF {"id": "8f985466-eea4-4ddd-b005-4f3533dff86b", "address": "fa:16:3e:c4:73:fb", "network": {"id": "1d7ab6e9-a793-455f-9932-8a7dbec20dcb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861987999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebc374d01934c2980c5765ee2e4ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f985466-ee", "ovs_interfaceid": "8f985466-eea4-4ddd-b005-4f3533dff86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:73:fb,bridge_name='br-int',has_traffic_filtering=True,id=8f985466-eea4-4ddd-b005-4f3533dff86b,network=Network(1d7ab6e9-a793-455f-9932-8a7dbec20dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f985466-ee') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG os_vif [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:73:fb,bridge_name='br-int',has_traffic_filtering=True,id=8f985466-eea4-4ddd-b005-4f3533dff86b,network=Network(1d7ab6e9-a793-455f-9932-8a7dbec20dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f985466-ee') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f985466-ee, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8f985466-ee, col_values=(('external_ids', {'iface-id': '8f985466-eea4-4ddd-b005-4f3533dff86b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:73:fb', 'vm-uuid': '2b854f0d-7305-41d5-8188-12ae9050e213'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:17:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:34 user nova-compute[72874]: INFO os_vif [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:73:fb,bridge_name='br-int',has_traffic_filtering=True,id=8f985466-eea4-4ddd-b005-4f3533dff86b,network=Network(1d7ab6e9-a793-455f-9932-8a7dbec20dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f985466-ee')
Aug 17 18:17:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:17:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] No VIF found with MAC fa:16:3e:c4:73:fb, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:17:35 user nova-compute[72874]: DEBUG nova.network.neutron [req-ff657c15-6a24-443b-8223-bdb3926bd0fb req-cc1841e5-f968-4c15-ae9c-065cf79e8f3f service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Updated VIF entry in instance network info cache for port 8f985466-eea4-4ddd-b005-4f3533dff86b. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:17:35 user nova-compute[72874]: DEBUG nova.network.neutron [req-ff657c15-6a24-443b-8223-bdb3926bd0fb req-cc1841e5-f968-4c15-ae9c-065cf79e8f3f service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Updating instance_info_cache with network_info: [{"id": "8f985466-eea4-4ddd-b005-4f3533dff86b", "address": "fa:16:3e:c4:73:fb", "network": {"id": "1d7ab6e9-a793-455f-9932-8a7dbec20dcb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861987999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebc374d01934c2980c5765ee2e4ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f985466-ee", "ovs_interfaceid": "8f985466-eea4-4ddd-b005-4f3533dff86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:17:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ff657c15-6a24-443b-8223-bdb3926bd0fb req-cc1841e5-f968-4c15-ae9c-065cf79e8f3f service nova] Releasing lock "refresh_cache-2b854f0d-7305-41d5-8188-12ae9050e213" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:17:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-a6a4bcb7-9a33-4919-a47a-7b03645075f0 req-9936da2f-da32-4b7d-95b2-a766f9cac172 service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Received event network-vif-plugged-8f985466-eea4-4ddd-b005-4f3533dff86b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a6a4bcb7-9a33-4919-a47a-7b03645075f0 req-9936da2f-da32-4b7d-95b2-a766f9cac172 service nova] Acquiring lock "2b854f0d-7305-41d5-8188-12ae9050e213-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a6a4bcb7-9a33-4919-a47a-7b03645075f0 req-9936da2f-da32-4b7d-95b2-a766f9cac172 service nova] Lock "2b854f0d-7305-41d5-8188-12ae9050e213-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a6a4bcb7-9a33-4919-a47a-7b03645075f0 req-9936da2f-da32-4b7d-95b2-a766f9cac172 service nova] Lock "2b854f0d-7305-41d5-8188-12ae9050e213-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-a6a4bcb7-9a33-4919-a47a-7b03645075f0 req-9936da2f-da32-4b7d-95b2-a766f9cac172 service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] No waiting events found dispatching network-vif-plugged-8f985466-eea4-4ddd-b005-4f3533dff86b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:17:36 user nova-compute[72874]: WARNING nova.compute.manager [req-a6a4bcb7-9a33-4919-a47a-7b03645075f0 req-9936da2f-da32-4b7d-95b2-a766f9cac172 service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Received unexpected event network-vif-plugged-8f985466-eea4-4ddd-b005-4f3533dff86b for instance with vm_state building and task_state spawning.
Aug 17 18:17:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296258.6827142, 2b854f0d-7305-41d5-8188-12ae9050e213 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:17:38 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] VM Resumed (Lifecycle Event)
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:17:38 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Instance spawned successfully.
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:17:38 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296258.6848307, 2b854f0d-7305-41d5-8188-12ae9050e213 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:17:38 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] VM Started (Lifecycle Event)
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:17:38 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:17:38 user nova-compute[72874]: INFO nova.compute.manager [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Took 7.30 seconds to spawn the instance on the hypervisor.
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-3d9d1100-ebc6-4981-95d5-130b8cf25fd8 req-c6121b51-cb06-48ec-b23e-9f2ab3eb4b6f service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Received event network-vif-plugged-8f985466-eea4-4ddd-b005-4f3533dff86b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3d9d1100-ebc6-4981-95d5-130b8cf25fd8 req-c6121b51-cb06-48ec-b23e-9f2ab3eb4b6f service nova] Acquiring lock "2b854f0d-7305-41d5-8188-12ae9050e213-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3d9d1100-ebc6-4981-95d5-130b8cf25fd8 req-c6121b51-cb06-48ec-b23e-9f2ab3eb4b6f service nova] Lock "2b854f0d-7305-41d5-8188-12ae9050e213-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3d9d1100-ebc6-4981-95d5-130b8cf25fd8 req-c6121b51-cb06-48ec-b23e-9f2ab3eb4b6f service nova] Lock "2b854f0d-7305-41d5-8188-12ae9050e213-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-3d9d1100-ebc6-4981-95d5-130b8cf25fd8 req-c6121b51-cb06-48ec-b23e-9f2ab3eb4b6f service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] No waiting events found dispatching network-vif-plugged-8f985466-eea4-4ddd-b005-4f3533dff86b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:17:38 user nova-compute[72874]: WARNING nova.compute.manager [req-3d9d1100-ebc6-4981-95d5-130b8cf25fd8 req-c6121b51-cb06-48ec-b23e-9f2ab3eb4b6f service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Received unexpected event network-vif-plugged-8f985466-eea4-4ddd-b005-4f3533dff86b for instance with vm_state building and task_state spawning.
Aug 17 18:17:39 user nova-compute[72874]: INFO nova.compute.manager [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Took 8.54 seconds to build instance.
Aug 17 18:17:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cbf2bc26-0cdf-4a7c-a222-3dde10152afc tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lock "2b854f0d-7305-41d5-8188-12ae9050e213" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.669s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "147a0117-749d-4aff-8a4d-9ea91238278b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:17:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:17:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:17:40 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:17:40 user nova-compute[72874]: INFO nova.compute.claims [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Claim successful on node user
Aug 17 18:17:40 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:17:40 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:17:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:17:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:17:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:17:40 user nova-compute[72874]: DEBUG nova.network.neutron [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:17:40 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:17:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:17:41 user nova-compute[72874]: INFO nova.virt.block_device [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Booting with volume 3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 at /dev/vda
Aug 17 18:17:41 user nova-compute[72874]: DEBUG nova.policy [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c54f23024e2040adaf80571db2b39067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39622ec42f1941888eba707de58d580f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG os_brick.utils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[47caf380-b22c-441e-b6d7-5dd65c06a02a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9475fd-d3d1-43c2-8906-7b106caa5efb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9014fa76-0bf3-4a46-8447-c8780b5451c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8218771d-15fa-4b42-af55-5e02525ce361]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:17:41 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:17:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4089d96f-daf4-4119-8768-830018860216]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG os_brick.utils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:17:41 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Updating existing volume attachment record: f097d60b-410a-4108-8c36-390f82d6ffb9 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:17:42 user nova-compute[72874]: DEBUG nova.network.neutron [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Successfully created port: 3d6f0247-0483-4fad-9551-30b7ea4933cd {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:17:43 user nova-compute[72874]: DEBUG nova.network.neutron [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Successfully created port: 350d5856-a681-4266-b9c0-670a99cbd2a2 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:17:43 user nova-compute[72874]: DEBUG nova.network.neutron [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Successfully created port: 4447fb91-c7dc-4014-a316-fcc684f2a1d7 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:17:44 user nova-compute[72874]: DEBUG nova.network.neutron [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Successfully created port: 6ed88fc4-fcd1-415d-a1fe-779f77394c9e {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:17:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:45 user nova-compute[72874]: DEBUG nova.network.neutron [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Successfully created port: e4ef743f-f417-446a-adcd-10b699018f21 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:17:45 user nova-compute[72874]: DEBUG nova.network.neutron [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Successfully updated port: 3d6f0247-0483-4fad-9551-30b7ea4933cd {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:17:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-7715c260-7cd5-4071-b2ae-6dd7625a4115 req-e5eb1bf1-040b-4c6b-87de-78e6212a8f4c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-changed-3d6f0247-0483-4fad-9551-30b7ea4933cd {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-7715c260-7cd5-4071-b2ae-6dd7625a4115 req-e5eb1bf1-040b-4c6b-87de-78e6212a8f4c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Refreshing instance network info cache due to event network-changed-3d6f0247-0483-4fad-9551-30b7ea4933cd. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:17:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7715c260-7cd5-4071-b2ae-6dd7625a4115 req-e5eb1bf1-040b-4c6b-87de-78e6212a8f4c service nova] Acquiring lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:17:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7715c260-7cd5-4071-b2ae-6dd7625a4115 req-e5eb1bf1-040b-4c6b-87de-78e6212a8f4c service nova] Acquired lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:17:45 user nova-compute[72874]: DEBUG nova.network.neutron [req-7715c260-7cd5-4071-b2ae-6dd7625a4115 req-e5eb1bf1-040b-4c6b-87de-78e6212a8f4c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Refreshing network info cache for port 3d6f0247-0483-4fad-9551-30b7ea4933cd {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:17:46 user nova-compute[72874]: DEBUG nova.network.neutron [req-7715c260-7cd5-4071-b2ae-6dd7625a4115 req-e5eb1bf1-040b-4c6b-87de-78e6212a8f4c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:17:46 user nova-compute[72874]: DEBUG nova.network.neutron [req-7715c260-7cd5-4071-b2ae-6dd7625a4115 req-e5eb1bf1-040b-4c6b-87de-78e6212a8f4c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:17:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7715c260-7cd5-4071-b2ae-6dd7625a4115 req-e5eb1bf1-040b-4c6b-87de-78e6212a8f4c service nova] Releasing lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:17:46 user nova-compute[72874]: DEBUG nova.network.neutron [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Successfully updated port: b65a4e99-e008-4dd1-9db2-25dfb8d19317 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:17:47 user nova-compute[72874]: DEBUG nova.network.neutron [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Successfully updated port: 3e811baf-1a7c-4c5d-bd92-6812e7ab3375 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-1f75dad6-c05f-429c-b897-b33f331d3dcd req-3d127569-7477-4f31-afce-30aa39342105 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-changed-b65a4e99-e008-4dd1-9db2-25dfb8d19317 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-1f75dad6-c05f-429c-b897-b33f331d3dcd req-3d127569-7477-4f31-afce-30aa39342105 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Refreshing instance network info cache due to event network-changed-b65a4e99-e008-4dd1-9db2-25dfb8d19317. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1f75dad6-c05f-429c-b897-b33f331d3dcd req-3d127569-7477-4f31-afce-30aa39342105 service nova] Acquiring lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1f75dad6-c05f-429c-b897-b33f331d3dcd req-3d127569-7477-4f31-afce-30aa39342105 service nova] Acquired lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-1f75dad6-c05f-429c-b897-b33f331d3dcd req-3d127569-7477-4f31-afce-30aa39342105 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Refreshing network info cache for port b65a4e99-e008-4dd1-9db2-25dfb8d19317 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-1f75dad6-c05f-429c-b897-b33f331d3dcd req-3d127569-7477-4f31-afce-30aa39342105 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-1f75dad6-c05f-429c-b897-b33f331d3dcd req-3d127569-7477-4f31-afce-30aa39342105 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1f75dad6-c05f-429c-b897-b33f331d3dcd req-3d127569-7477-4f31-afce-30aa39342105 service nova] Releasing lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-1f75dad6-c05f-429c-b897-b33f331d3dcd req-3d127569-7477-4f31-afce-30aa39342105 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-changed-3e811baf-1a7c-4c5d-bd92-6812e7ab3375 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-1f75dad6-c05f-429c-b897-b33f331d3dcd req-3d127569-7477-4f31-afce-30aa39342105 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Refreshing instance network info cache due to event network-changed-3e811baf-1a7c-4c5d-bd92-6812e7ab3375. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1f75dad6-c05f-429c-b897-b33f331d3dcd req-3d127569-7477-4f31-afce-30aa39342105 service nova] Acquiring lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1f75dad6-c05f-429c-b897-b33f331d3dcd req-3d127569-7477-4f31-afce-30aa39342105 service nova] Acquired lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-1f75dad6-c05f-429c-b897-b33f331d3dcd req-3d127569-7477-4f31-afce-30aa39342105 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Refreshing network info cache for port 3e811baf-1a7c-4c5d-bd92-6812e7ab3375 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-1f75dad6-c05f-429c-b897-b33f331d3dcd req-3d127569-7477-4f31-afce-30aa39342105 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG nova.network.neutron [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Successfully updated port: 350d5856-a681-4266-b9c0-670a99cbd2a2 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-1f75dad6-c05f-429c-b897-b33f331d3dcd req-3d127569-7477-4f31-afce-30aa39342105 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:17:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1f75dad6-c05f-429c-b897-b33f331d3dcd req-3d127569-7477-4f31-afce-30aa39342105 service nova] Releasing lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:17:49 user nova-compute[72874]: DEBUG nova.network.neutron [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Successfully updated port: 4447fb91-c7dc-4014-a316-fcc684f2a1d7 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:17:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:49 user nova-compute[72874]: DEBUG nova.network.neutron [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Successfully updated port: 6ed88fc4-fcd1-415d-a1fe-779f77394c9e {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-changed-350d5856-a681-4266-b9c0-670a99cbd2a2 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Refreshing instance network info cache due to event network-changed-350d5856-a681-4266-b9c0-670a99cbd2a2. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] Acquiring lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] Acquired lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG nova.network.neutron [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Refreshing network info cache for port 350d5856-a681-4266-b9c0-670a99cbd2a2 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG nova.network.neutron [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG nova.network.neutron [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] Releasing lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-changed-4447fb91-c7dc-4014-a316-fcc684f2a1d7 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Refreshing instance network info cache due to event network-changed-4447fb91-c7dc-4014-a316-fcc684f2a1d7. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] Acquiring lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] Acquired lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG nova.network.neutron [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Refreshing network info cache for port 4447fb91-c7dc-4014-a316-fcc684f2a1d7 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG nova.network.neutron [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG nova.network.neutron [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Successfully updated port: e4ef743f-f417-446a-adcd-10b699018f21 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquiring lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG nova.network.neutron [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] Releasing lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-changed-6ed88fc4-fcd1-415d-a1fe-779f77394c9e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Refreshing instance network info cache due to event network-changed-6ed88fc4-fcd1-415d-a1fe-779f77394c9e. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] Acquiring lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] Acquired lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG nova.network.neutron [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Refreshing network info cache for port 6ed88fc4-fcd1-415d-a1fe-779f77394c9e {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:17:50 user nova-compute[72874]: DEBUG nova.network.neutron [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:17:51 user nova-compute[72874]: DEBUG nova.network.neutron [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:17:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-362c8128-4d27-4ab7-9dd4-ebc4e12b7e86 req-47c9853d-af24-4d5f-a3fe-56463dfddbfd service nova] Releasing lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:17:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquired lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:17:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:17:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-34876ee7-f1dd-4cf4-9498-eb003118927f req-a6eb63dd-47cb-44f0-9d66-582d024df7ac service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-changed-e4ef743f-f417-446a-adcd-10b699018f21 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-34876ee7-f1dd-4cf4-9498-eb003118927f req-a6eb63dd-47cb-44f0-9d66-582d024df7ac service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Refreshing instance network info cache due to event network-changed-e4ef743f-f417-446a-adcd-10b699018f21. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-34876ee7-f1dd-4cf4-9498-eb003118927f req-a6eb63dd-47cb-44f0-9d66-582d024df7ac service nova] Acquiring lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:17:52 user nova-compute[72874]: INFO nova.virt.block_device [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Booting with volume 1fd775ed-8af7-48df-8684-9c68ef6b62fe at /dev/vdb
Aug 17 18:17:52 user nova-compute[72874]: DEBUG os_brick.utils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74a61f6-e36c-4fcb-95d9-41ed4c8fb0e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5aa376-34be-4eb9-b5c7-eba0d340ef50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c8a0bc-3f83-4cfd-99ae-ebf1976a871d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d1e662-c855-403e-a5fb-98891a526f83]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:17:52 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:17:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c13a56-8683-4483-98ca-ec4c788d9c1d]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG os_brick.utils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:17:52 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Updating existing volume attachment record: 0117bda8-d1e0-46d9-8559-c074696d792a {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:17:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Updating instance_info_cache with network_info: [{"id": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "address": "fa:16:3e:1f:e4:9d", "network": {"id": "2a24259a-abcc-4676-b0ac-5421ac2a6885", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1205067213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6f0247-04", "ovs_interfaceid": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "address": "fa:16:3e:d0:31:5f", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65a4e99-e0", "ovs_interfaceid": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "address": "fa:16:3e:46:71:d4", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e811baf-1a", "ovs_interfaceid": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "350d5856-a681-4266-b9c0-670a99cbd2a2", "address": "fa:16:3e:82:93:6c", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350d5856-a6", "ovs_interfaceid": "350d5856-a681-4266-b9c0-670a99cbd2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "address": "fa:16:3e:3c:28:8e", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447fb91-c7", "ovs_interfaceid": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "address": "fa:16:3e:cc:81:9c", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed88fc4-fc", "ovs_interfaceid": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4ef743f-f417-446a-adcd-10b699018f21", "address": "fa:16:3e:c3:d8:a8", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ef743f-f4", "ovs_interfaceid": "e4ef743f-f417-446a-adcd-10b699018f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:17:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Releasing lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:17:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Instance network_info: |[{"id": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "address": "fa:16:3e:1f:e4:9d", "network": {"id": "2a24259a-abcc-4676-b0ac-5421ac2a6885", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1205067213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6f0247-04", "ovs_interfaceid": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "address": "fa:16:3e:d0:31:5f", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65a4e99-e0", "ovs_interfaceid": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "address": "fa:16:3e:46:71:d4", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e811baf-1a", "ovs_interfaceid": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "350d5856-a681-4266-b9c0-670a99cbd2a2", "address": "fa:16:3e:82:93:6c", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350d5856-a6", "ovs_interfaceid": "350d5856-a681-4266-b9c0-670a99cbd2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "address": "fa:16:3e:3c:28:8e", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447fb91-c7", "ovs_interfaceid": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "address": "fa:16:3e:cc:81:9c", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed88fc4-fc", "ovs_interfaceid": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4ef743f-f417-446a-adcd-10b699018f21", "address": "fa:16:3e:c3:d8:a8", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ef743f-f4", "ovs_interfaceid": "e4ef743f-f417-446a-adcd-10b699018f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:17:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-34876ee7-f1dd-4cf4-9498-eb003118927f req-a6eb63dd-47cb-44f0-9d66-582d024df7ac service nova] Acquired lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:17:53 user nova-compute[72874]: DEBUG nova.network.neutron [req-34876ee7-f1dd-4cf4-9498-eb003118927f req-a6eb63dd-47cb-44f0-9d66-582d024df7ac service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Refreshing network info cache for port e4ef743f-f417-446a-adcd-10b699018f21 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:17:53 user nova-compute[72874]: DEBUG nova.network.neutron [req-34876ee7-f1dd-4cf4-9498-eb003118927f req-a6eb63dd-47cb-44f0-9d66-582d024df7ac service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Updated VIF entry in instance network info cache for port e4ef743f-f417-446a-adcd-10b699018f21. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:17:53 user nova-compute[72874]: DEBUG nova.network.neutron [req-34876ee7-f1dd-4cf4-9498-eb003118927f req-a6eb63dd-47cb-44f0-9d66-582d024df7ac service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Updating instance_info_cache with network_info: [{"id": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "address": "fa:16:3e:1f:e4:9d", "network": {"id": "2a24259a-abcc-4676-b0ac-5421ac2a6885", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1205067213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6f0247-04", "ovs_interfaceid": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "address": "fa:16:3e:d0:31:5f", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65a4e99-e0", "ovs_interfaceid": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "address": "fa:16:3e:46:71:d4", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e811baf-1a", "ovs_interfaceid": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "350d5856-a681-4266-b9c0-670a99cbd2a2", "address": "fa:16:3e:82:93:6c", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350d5856-a6", "ovs_interfaceid": "350d5856-a681-4266-b9c0-670a99cbd2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "address": "fa:16:3e:3c:28:8e", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447fb91-c7", "ovs_interfaceid": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "address": "fa:16:3e:cc:81:9c", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed88fc4-fc", "ovs_interfaceid": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4ef743f-f417-446a-adcd-10b699018f21", "address": "fa:16:3e:c3:d8:a8", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ef743f-f4", "ovs_interfaceid": "e4ef743f-f417-446a-adcd-10b699018f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:17:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-34876ee7-f1dd-4cf4-9498-eb003118927f req-a6eb63dd-47cb-44f0-9d66-582d024df7ac service nova] Releasing lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:17:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:17:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:03 user nova-compute[72874]: INFO nova.virt.block_device [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Booting with volume df274d3a-8624-4817-8cc7-b2ea82d0df77 at /dev/vdc
Aug 17 18:18:03 user nova-compute[72874]: DEBUG os_brick.utils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[018be432-ad53-4682-a041-8aae3f3d6f0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f899a9-3886-4df6-a3b4-d283227e7af5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f3d778-0482-442b-9214-f7234eed33cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1577068f-8599-4885-a9a8-3677ef72a059]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:18:03 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:18:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4e708c-da37-47fe-a3f0-834e2252423e]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG os_brick.utils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:18:03 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Updating existing volume attachment record: 86f0ec10-7cb6-47d7-9003-e8819d7d1a8d {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:18:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:18:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:18:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-3bf88e4a-ee43-471a-b375-30684f09c3e3" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-3bf88e4a-ee43-471a-b375-30684f09c3e3" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-796a4451-3c78-47e1-a435-a1b1e4b2ce88 req-4afb483b-0a39-4b94-87d3-843fa6a9afae service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received event network-changed-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-796a4451-3c78-47e1-a435-a1b1e4b2ce88 req-4afb483b-0a39-4b94-87d3-843fa6a9afae service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Refreshing instance network info cache due to event network-changed-63ec6fca-872d-4e61-b76a-c39215266088. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-796a4451-3c78-47e1-a435-a1b1e4b2ce88 req-4afb483b-0a39-4b94-87d3-843fa6a9afae service nova] Acquiring lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-796a4451-3c78-47e1-a435-a1b1e4b2ce88 req-4afb483b-0a39-4b94-87d3-843fa6a9afae service nova] Acquired lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG nova.network.neutron [req-796a4451-3c78-47e1-a435-a1b1e4b2ce88 req-4afb483b-0a39-4b94-87d3-843fa6a9afae service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Refreshing network info cache for port 63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Updating instance_info_cache with network_info: [{"id": "854fd839-b199-4430-a240-29ab1c0a3700", "address": "fa:16:3e:3d:e8:ab", "network": {"id": "6a1d5756-c29e-4f96-aa83-0ad17d8bb48e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1496281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21222da070874ea8b635ed3178821402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fd839-b1", "ovs_interfaceid": "854fd839-b199-4430-a240-29ab1c0a3700", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-3bf88e4a-ee43-471a-b375-30684f09c3e3" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:10 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:18:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:11 user nova-compute[72874]: DEBUG nova.network.neutron [req-796a4451-3c78-47e1-a435-a1b1e4b2ce88 req-4afb483b-0a39-4b94-87d3-843fa6a9afae service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Updated VIF entry in instance network info cache for port 63ec6fca-872d-4e61-b76a-c39215266088. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:18:11 user nova-compute[72874]: DEBUG nova.network.neutron [req-796a4451-3c78-47e1-a435-a1b1e4b2ce88 req-4afb483b-0a39-4b94-87d3-843fa6a9afae service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Updating instance_info_cache with network_info: [{"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:18:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-796a4451-3c78-47e1-a435-a1b1e4b2ce88 req-4afb483b-0a39-4b94-87d3-843fa6a9afae service nova] Releasing lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:18:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:11 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:18:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG nova.compute.manager [req-fc7c5fdd-699c-418c-bdce-bc8bcb077b80 req-86d280ef-62b8-4e7a-b771-51212b50ca28 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-changed-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG nova.compute.manager [req-fc7c5fdd-699c-418c-bdce-bc8bcb077b80 req-86d280ef-62b8-4e7a-b771-51212b50ca28 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Refreshing instance network info cache due to event network-changed-b3598a27-6f66-4999-8ed8-835ffb3d6cae. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fc7c5fdd-699c-418c-bdce-bc8bcb077b80 req-86d280ef-62b8-4e7a-b771-51212b50ca28 service nova] Acquiring lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fc7c5fdd-699c-418c-bdce-bc8bcb077b80 req-86d280ef-62b8-4e7a-b771-51212b50ca28 service nova] Acquired lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG nova.network.neutron [req-fc7c5fdd-699c-418c-bdce-bc8bcb077b80 req-86d280ef-62b8-4e7a-b771-51212b50ca28 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Refreshing network info cache for port b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG nova.network.neutron [req-fc7c5fdd-699c-418c-bdce-bc8bcb077b80 req-86d280ef-62b8-4e7a-b771-51212b50ca28 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updated VIF entry in instance network info cache for port b3598a27-6f66-4999-8ed8-835ffb3d6cae. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG nova.network.neutron [req-fc7c5fdd-699c-418c-bdce-bc8bcb077b80 req-86d280ef-62b8-4e7a-b771-51212b50ca28 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updating instance_info_cache with network_info: [{"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fc7c5fdd-699c-418c-bdce-bc8bcb077b80 req-86d280ef-62b8-4e7a-b771-51212b50ca28 service nova] Releasing lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:15 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:18:15 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=6794MB free_disk=25.637393951416016GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance c27fc8b6-cc8c-426a-859d-04722c569cd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 3bf88e4a-ee43-471a-b375-30684f09c3e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance f027045c-d121-45ec-af61-e1a2399c4a43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance ef6c7125-8a47-4e3f-bb6d-b6aa5254116c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c2eb160-5b94-4d53-bd36-b712c62d9100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 544005af-7312-4bd4-a086-7d255ca7c479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 7c486f7d-bcad-4c83-98bf-f08559259d33 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2b854f0d-7305-41d5-8188-12ae9050e213 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 147a0117-749d-4aff-8a4d-9ea91238278b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Acquiring lock "3bf88e4a-ee43-471a-b375-30684f09c3e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.objects.instance [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lazy-loading 'flavor' on Instance uuid 3bf88e4a-ee43-471a-b375-30684f09c3e3 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.compute.manager [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:18:15 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Creating image(s)
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Ensure instance console log exists: /opt/stack/data/nova/instances/147a0117-749d-4aff-8a4d-9ea91238278b/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Start _get_guest_xml network_info=[{"id": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "address": "fa:16:3e:1f:e4:9d", "network": {"id": "2a24259a-abcc-4676-b0ac-5421ac2a6885", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1205067213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6f0247-04", "ovs_interfaceid": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "address": "fa:16:3e:d0:31:5f", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65a4e99-e0", "ovs_interfaceid": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "address": "fa:16:3e:46:71:d4", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e811baf-1a", "ovs_interfaceid": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "350d5856-a681-4266-b9c0-670a99cbd2a2", "address": "fa:16:3e:82:93:6c", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350d5856-a6", "ovs_interfaceid": "350d5856-a681-4266-b9c0-670a99cbd2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "address": "fa:16:3e:3c:28:8e", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447fb91-c7", "ovs_interfaceid": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "address": "fa:16:3e:cc:81:9c", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed88fc4-fc", "ovs_interfaceid": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4ef743f-f417-446a-adcd-10b699018f21", "address": "fa:16:3e:c3:d8:a8", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ef743f-f4", "ovs_interfaceid": "e4ef743f-f417-446a-adcd-10b699018f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqcKwsBl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '147a0117-749d-4aff-8a4d-9ea91238278b', 'attached_at': '', 'detached_at': '', 'volume_id': '3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600', 'serial': '3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600'}, 'delete_on_termination': False, 'attachment_id': 'f097d60b-410a-4108-8c36-390f82d6ffb9', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGCfLcug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '147a0117-749d-4aff-8a4d-9ea91238278b', 'attached_at': '', 'detached_at': '', 'volume_id': '1fd775ed-8af7-48df-8684-9c68ef6b62fe', 'serial': '1fd775ed-8af7-48df-8684-9c68ef6b62fe'}, 'delete_on_termination': False, 'attachment_id': '0117bda8-d1e0-46d9-8559-c074696d792a', 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVnFfUWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '147a0117-749d-4aff-8a4d-9ea91238278b', 'attached_at': '', 'detached_at': '', 'volume_id': 'df274d3a-8624-4817-8cc7-b2ea82d0df77', 'serial': 'df274d3a-8624-4817-8cc7-b2ea82d0df77'}, 'delete_on_termination': False, 'attachment_id': '86f0ec10-7cb6-47d7-9003-e8819d7d1a8d', 'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.compute.manager [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:18:15 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:18:15 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqcKwsBl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:18:15 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:15 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:15 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.127s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:15 user nova-compute[72874]: INFO nova.compute.manager [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] instance snapshotting
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e474155-4b8f-41c8-b26a-0831e3a50475]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:18:15 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8671a0-dcc1-478b-a3e1-70270dbfffb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600] added
Aug 17 18:18:15 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[303f39a0-540b-449e-8e93-680d8be60004]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:15 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Beginning live snapshot process
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42376a3-b4c9-42a1-9688-00b02aa315fa]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CqcKwsBl {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CqcKwsBl" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6401b2d3-b9cf-4700-a158-922abb015228]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CqcKwsBl'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a121456-c328-4254-a409-e75c63e26c6b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7747751f-feba-4b9d-b93f-f038253c3ecf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:15 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:15 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Acquiring lock "3bf88e4a-ee43-471a-b375-30684f09c3e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:15 user nova-compute[72874]: INFO nova.compute.manager [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Attaching volume b04679cd-f3aa-4ab1-8d41-1739b7890fb9 to /dev/vdb
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3419c816-a5dd-4e22-8540-d23c862aa713]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600, portal: 172.16.0.220,3260]
Aug 17 18:18:15 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600, portal: 172.16.0.220,3260] successful.
Aug 17 18:18:15 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3408e5c5-5959-4f09-93cd-e1aede0bfe6f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG os_brick.utils [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c42b93-3fbb-4726-a6be-37b27b7e4915]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:16 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:16 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:16 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:16 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3f9e25-5649-4d5c-8d9c-9ab35245ef5c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2667d0f1-ed03-4ea3-871b-25ac723ca949]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqcKwsBl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c68bad4-0d89-4cfc-be2a-5178991ecff3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.668s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json -f qcow2 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff27c5cc-b82f-40ca-a8eb-94c8efce3587]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4096913-0c3a-4291-9542-fa70b41c0dc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:18:16 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbf8323-6327-4899-8c20-85e467939820]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG os_brick.utils [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] <== get_connector_properties: return (201ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Updating existing volume attachment record: 9b5bd1aa-30b3-4e33-b4bd-d1e5f7cca60c {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json -f qcow2" returned: 0 in 0.208s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json -f qcow2 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json -f qcow2" returned: 0 in 0.216s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:16 user nova-compute[72874]: INFO nova.compute.manager [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Shelving
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.207s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6cvu4rqo/c804a0c47e914243bd4f85e909382597.delta 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6cvu4rqo/c804a0c47e914243bd4f85e909382597.delta 1073741824" returned: 0 in 0.051s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:16 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 18:18:16 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72874) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 17 18:18:16 user nova-compute[72874]: INFO nova.virt.libvirt.host [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] UEFI support detected
Aug 17 18:18:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23261636236303966', 'path': '/dev/sdc'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261636236303966', 'path': '/dev/sdc'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGCfLcug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:18:17 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:17 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:17 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd053d7c-52da-4891-9a18-c7aadab08fff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:18:17 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce5433b-b299-4160-b1c5-74b455d5565d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe] added
Aug 17 18:18:17 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc6938a-e80d-4d81-8c66-cb8dc42e6505]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG nova.compute.manager [req-7831a763-7f31-475f-901e-6ec5e5b0196a req-ecabd984-8a52-4d72-951d-684e7b64d4ab service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received event network-vif-unplugged-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7831a763-7f31-475f-901e-6ec5e5b0196a req-ecabd984-8a52-4d72-951d-684e7b64d4ab service nova] Acquiring lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7831a763-7f31-475f-901e-6ec5e5b0196a req-ecabd984-8a52-4d72-951d-684e7b64d4ab service nova] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7831a763-7f31-475f-901e-6ec5e5b0196a req-ecabd984-8a52-4d72-951d-684e7b64d4ab service nova] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG nova.compute.manager [req-7831a763-7f31-475f-901e-6ec5e5b0196a req-ecabd984-8a52-4d72-951d-684e7b64d4ab service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] No waiting events found dispatching network-vif-unplugged-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:17 user nova-compute[72874]: WARNING nova.compute.manager [req-7831a763-7f31-475f-901e-6ec5e5b0196a req-ecabd984-8a52-4d72-951d-684e7b64d4ab service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received unexpected event network-vif-unplugged-63ec6fca-872d-4e61-b76a-c39215266088 for instance with vm_state active and task_state shelving.
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.155s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5acdcc-d5d8-4982-ba45-a97a58acbea2]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGCfLcug {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xGCfLcug" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bac1c8-049e-4038-b9ab-e17b12f79861]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xGCfLcug'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75bcb72-729d-4e24-b46b-273d2ca497a6]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f47de6-fd28-4e4e-a1b0-dbfede3b2c0d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:17 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:17 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:17 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:17 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b93509-6392-45d8-8c08-f242e29e8954]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe, portal: 172.16.0.220,3260]
Aug 17 18:18:17 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe, portal: 172.16.0.220,3260] successful.
Aug 17 18:18:17 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cef10f-fc40-4dd5-9a23-bc64e2d75e08]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[373dac5d-32ee-4777-b0a0-12ff7d2553d0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:17 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:17 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:17 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:17 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:17 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:17 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.441s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d4f250-93bf-467f-a15b-3be59197050c]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGCfLcug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:18:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:18:18 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Instance destroyed successfully.
Aug 17 18:18:18 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Beginning cold snapshot process
Aug 17 18:18:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:18:18 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 18:18:18 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk /opt/stack/data/nova/instances/snapshots/tmpntuzii_f/913ebcc4e1bc4e4a825a2c19c74b834d {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6cvu4rqo/c804a0c47e914243bd4f85e909382597.delta /opt/stack/data/nova/instances/snapshots/tmp6cvu4rqo/c804a0c47e914243bd4f85e909382597 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.484s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] <== connect_volume: return (1488ms) {'type': 'block', 'scsi_wwn': '26635303561613634', 'path': '/dev/sdd'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635303561613634', 'path': '/dev/sdd'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVnFfUWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:18:18 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:18 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:18 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:18:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c381dbde-222c-4de7-81bf-14c07ae266d7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:18:18 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.121s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fbfccc-ab0f-4b7a-8e36-81a638238b85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77] added
Aug 17 18:18:18 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf781ba3-36b3-4097-9c4a-5d0da7f97852]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.096s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57d4be3-c74d-4597-8744-fe701b5a08a9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVnFfUWs {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mVnFfUWs" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c3634c-b010-4a0d-a0c1-f975d8787cfb]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mVnFfUWs'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.086s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[55979142-e8e3-48ac-aff5-13589962340e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[113c309a-1e31-4363-b496-369dc0c5953a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:19 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:19 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:19 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:19 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-6c407aa7-d58c-469b-9d52-cf16e6d7d357 req-37631356-8a72-4b99-8765-129e192cf9c0 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received event network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6c407aa7-d58c-469b-9d52-cf16e6d7d357 req-37631356-8a72-4b99-8765-129e192cf9c0 service nova] Acquiring lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6c407aa7-d58c-469b-9d52-cf16e6d7d357 req-37631356-8a72-4b99-8765-129e192cf9c0 service nova] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6c407aa7-d58c-469b-9d52-cf16e6d7d357 req-37631356-8a72-4b99-8765-129e192cf9c0 service nova] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-6c407aa7-d58c-469b-9d52-cf16e6d7d357 req-37631356-8a72-4b99-8765-129e192cf9c0 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] No waiting events found dispatching network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:19 user nova-compute[72874]: WARNING nova.compute.manager [req-6c407aa7-d58c-469b-9d52-cf16e6d7d357 req-37631356-8a72-4b99-8765-129e192cf9c0 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received unexpected event network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk /opt/stack/data/nova/instances/snapshots/tmpntuzii_f/913ebcc4e1bc4e4a825a2c19c74b834d" returned: 0 in 1.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:19 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Snapshot extracted, beginning image upload
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6cvu4rqo/c804a0c47e914243bd4f85e909382597.delta /opt/stack/data/nova/instances/snapshots/tmp6cvu4rqo/c804a0c47e914243bd4f85e909382597" returned: 0 in 1.154s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:19 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Snapshot extracted, beginning image upload
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --login" returned: 0 in 0.165s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[851aacc8-75f9-4ac4-a26f-d020d481ea72]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77, portal: 172.16.0.220,3260]
Aug 17 18:18:19 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77, portal: 172.16.0.220,3260] successful.
Aug 17 18:18:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4159c6f3-75e0-402d-aae6-60f8ca923006]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cd4f32-05c1-4c10-a24f-721f99430550]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:19 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:19 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:19 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:19 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:19 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:19 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.749s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6556a90b-5a58-4faa-8d88-9bfed05cd299]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVnFfUWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-d8efa438-6d64-48a4-9c4a-5595cc158717 req-4bf2894e-6a75-4de3-a2a7-961569f620d4 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Received event network-changed-17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-d8efa438-6d64-48a4-9c4a-5595cc158717 req-4bf2894e-6a75-4de3-a2a7-961569f620d4 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Refreshing instance network info cache due to event network-changed-17265426-d5a6-4028-8c1c-2f84dfa2ac21. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d8efa438-6d64-48a4-9c4a-5595cc158717 req-4bf2894e-6a75-4de3-a2a7-961569f620d4 service nova] Acquiring lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d8efa438-6d64-48a4-9c4a-5595cc158717 req-4bf2894e-6a75-4de3-a2a7-961569f620d4 service nova] Acquired lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG nova.network.neutron [req-d8efa438-6d64-48a4-9c4a-5595cc158717 req-4bf2894e-6a75-4de3-a2a7-961569f620d4 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Refreshing network info cache for port 17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:18:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.neutron [req-d8efa438-6d64-48a4-9c4a-5595cc158717 req-4bf2894e-6a75-4de3-a2a7-961569f620d4 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Updated VIF entry in instance network info cache for port 17265426-d5a6-4028-8c1c-2f84dfa2ac21. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.neutron [req-d8efa438-6d64-48a4-9c4a-5595cc158717 req-4bf2894e-6a75-4de3-a2a7-961569f620d4 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Updating instance_info_cache with network_info: [{"id": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "address": "fa:16:3e:3a:30:bb", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17265426-d5", "ovs_interfaceid": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d8efa438-6d64-48a4-9c4a-5595cc158717 req-4bf2894e-6a75-4de3-a2a7-961569f620d4 service nova] Releasing lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.795s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] <== connect_volume: return (1797ms) {'type': 'block', 'scsi_wwn': '23236393963366636', 'path': '/dev/sde'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236393963366636', 'path': '/dev/sde'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "address": "fa:16:3e:1f:e4:9d", "network": {"id": "2a24259a-abcc-4676-b0ac-5421ac2a6885", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1205067213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6f0247-04", "ovs_interfaceid": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "address": "fa:16:3e:1f:e4:9d", "network": {"id": "2a24259a-abcc-4676-b0ac-5421ac2a6885", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1205067213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6f0247-04", "ovs_interfaceid": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:e4:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d6f0247-0483-4fad-9551-30b7ea4933cd,network=Network(2a24259a-abcc-4676-b0ac-5421ac2a6885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d6f0247-04') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "address": "fa:16:3e:d0:31:5f", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65a4e99-e0", "ovs_interfaceid": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "address": "fa:16:3e:d0:31:5f", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65a4e99-e0", "ovs_interfaceid": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:31:5f,bridge_name='br-int',has_traffic_filtering=True,id=b65a4e99-e008-4dd1-9db2-25dfb8d19317,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb65a4e99-e0') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "address": "fa:16:3e:46:71:d4", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e811baf-1a", "ovs_interfaceid": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "address": "fa:16:3e:46:71:d4", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e811baf-1a", "ovs_interfaceid": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:71:d4,bridge_name='br-int',has_traffic_filtering=True,id=3e811baf-1a7c-4c5d-bd92-6812e7ab3375,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e811baf-1a') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "350d5856-a681-4266-b9c0-670a99cbd2a2", "address": "fa:16:3e:82:93:6c", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350d5856-a6", "ovs_interfaceid": "350d5856-a681-4266-b9c0-670a99cbd2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "350d5856-a681-4266-b9c0-670a99cbd2a2", "address": "fa:16:3e:82:93:6c", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350d5856-a6", "ovs_interfaceid": "350d5856-a681-4266-b9c0-670a99cbd2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:93:6c,bridge_name='br-int',has_traffic_filtering=True,id=350d5856-a681-4266-b9c0-670a99cbd2a2,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350d5856-a6') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "address": "fa:16:3e:3c:28:8e", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447fb91-c7", "ovs_interfaceid": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "address": "fa:16:3e:3c:28:8e", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447fb91-c7", "ovs_interfaceid": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:28:8e,bridge_name='br-int',has_traffic_filtering=True,id=4447fb91-c7dc-4014-a316-fcc684f2a1d7,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4447fb91-c7') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "address": "fa:16:3e:cc:81:9c", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed88fc4-fc", "ovs_interfaceid": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "address": "fa:16:3e:cc:81:9c", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed88fc4-fc", "ovs_interfaceid": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:81:9c,bridge_name='br-int',has_traffic_filtering=True,id=6ed88fc4-fcd1-415d-a1fe-779f77394c9e,network=Network(19dafa9a-41de-43f8-9f41-499d5449f2e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed88fc4-fc') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4ef743f-f417-446a-adcd-10b699018f21", "address": "fa:16:3e:c3:d8:a8", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ef743f-f4", "ovs_interfaceid": "e4ef743f-f417-446a-adcd-10b699018f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "e4ef743f-f417-446a-adcd-10b699018f21", "address": "fa:16:3e:c3:d8:a8", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ef743f-f4", "ovs_interfaceid": "e4ef743f-f417-446a-adcd-10b699018f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d8:a8,bridge_name='br-int',has_traffic_filtering=True,id=e4ef743f-f417-446a-adcd-10b699018f21,network=Network(19dafa9a-41de-43f8-9f41-499d5449f2e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ef743f-f4') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.objects.instance [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lazy-loading 'pci_devices' on Instance uuid 147a0117-749d-4aff-8a4d-9ea91238278b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:18:20 user nova-compute[72874]:   <uuid>147a0117-749d-4aff-8a4d-9ea91238278b</uuid>
Aug 17 18:18:20 user nova-compute[72874]:   <name>instance-0000000b</name>
Aug 17 18:18:20 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:18:20 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:18:20 user nova-compute[72874]:   <metadata>
Aug 17 18:18:20 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:18:20 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:18:20 user nova-compute[72874]:       <nova:name>tempest-device-tagging-server-961092484</nova:name>
Aug 17 18:18:20 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:18:15</nova:creationTime>
Aug 17 18:18:20 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:18:20 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:18:20 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:18:20 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:18:20 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:18:20 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:18:20 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:18:20 user nova-compute[72874]:       <nova:owner>
Aug 17 18:18:20 user nova-compute[72874]:         <nova:user uuid="c54f23024e2040adaf80571db2b39067">tempest-TaggedBootDevicesTest-1721012935-project-member</nova:user>
Aug 17 18:18:20 user nova-compute[72874]:         <nova:project uuid="39622ec42f1941888eba707de58d580f">tempest-TaggedBootDevicesTest-1721012935</nova:project>
Aug 17 18:18:20 user nova-compute[72874]:       </nova:owner>
Aug 17 18:18:20 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:18:20 user nova-compute[72874]:       <nova:ports>
Aug 17 18:18:20 user nova-compute[72874]:         <nova:port uuid="3d6f0247-0483-4fad-9551-30b7ea4933cd">
Aug 17 18:18:20 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 18:18:20 user nova-compute[72874]:         </nova:port>
Aug 17 18:18:20 user nova-compute[72874]:         <nova:port uuid="b65a4e99-e008-4dd1-9db2-25dfb8d19317">
Aug 17 18:18:20 user nova-compute[72874]:           <nova:ip type="fixed" address="10.1.1.246" ipVersion="4"/>
Aug 17 18:18:20 user nova-compute[72874]:         </nova:port>
Aug 17 18:18:20 user nova-compute[72874]:         <nova:port uuid="3e811baf-1a7c-4c5d-bd92-6812e7ab3375">
Aug 17 18:18:20 user nova-compute[72874]:           <nova:ip type="fixed" address="10.1.1.142" ipVersion="4"/>
Aug 17 18:18:20 user nova-compute[72874]:         </nova:port>
Aug 17 18:18:20 user nova-compute[72874]:         <nova:port uuid="350d5856-a681-4266-b9c0-670a99cbd2a2">
Aug 17 18:18:20 user nova-compute[72874]:           <nova:ip type="fixed" address="10.1.1.17" ipVersion="4"/>
Aug 17 18:18:20 user nova-compute[72874]:         </nova:port>
Aug 17 18:18:20 user nova-compute[72874]:         <nova:port uuid="4447fb91-c7dc-4014-a316-fcc684f2a1d7">
Aug 17 18:18:20 user nova-compute[72874]:           <nova:ip type="fixed" address="10.1.1.57" ipVersion="4"/>
Aug 17 18:18:20 user nova-compute[72874]:         </nova:port>
Aug 17 18:18:20 user nova-compute[72874]:         <nova:port uuid="6ed88fc4-fcd1-415d-a1fe-779f77394c9e">
Aug 17 18:18:20 user nova-compute[72874]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 18:18:20 user nova-compute[72874]:         </nova:port>
Aug 17 18:18:20 user nova-compute[72874]:         <nova:port uuid="e4ef743f-f417-446a-adcd-10b699018f21">
Aug 17 18:18:20 user nova-compute[72874]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 18:18:20 user nova-compute[72874]:         </nova:port>
Aug 17 18:18:20 user nova-compute[72874]:       </nova:ports>
Aug 17 18:18:20 user nova-compute[72874]:     </nova:instance>
Aug 17 18:18:20 user nova-compute[72874]:   </metadata>
Aug 17 18:18:20 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:18:20 user nova-compute[72874]:     <system>
Aug 17 18:18:20 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:18:20 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:18:20 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:18:20 user nova-compute[72874]:       <entry name="serial">147a0117-749d-4aff-8a4d-9ea91238278b</entry>
Aug 17 18:18:20 user nova-compute[72874]:       <entry name="uuid">147a0117-749d-4aff-8a4d-9ea91238278b</entry>
Aug 17 18:18:20 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:18:20 user nova-compute[72874]:     </system>
Aug 17 18:18:20 user nova-compute[72874]:   </sysinfo>
Aug 17 18:18:20 user nova-compute[72874]:   <os>
Aug 17 18:18:20 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:18:20 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:18:20 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:18:20 user nova-compute[72874]:   </os>
Aug 17 18:18:20 user nova-compute[72874]:   <features>
Aug 17 18:18:20 user nova-compute[72874]:     <acpi/>
Aug 17 18:18:20 user nova-compute[72874]:     <apic/>
Aug 17 18:18:20 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:18:20 user nova-compute[72874]:   </features>
Aug 17 18:18:20 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:18:20 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:18:20 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:18:20 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:18:20 user nova-compute[72874]:   </clock>
Aug 17 18:18:20 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:18:20 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:18:20 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:18:20 user nova-compute[72874]:   </cpu>
Aug 17 18:18:20 user nova-compute[72874]:   <devices>
Aug 17 18:18:20 user nova-compute[72874]:     <disk type="file" device="cdrom">
Aug 17 18:18:20 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 18:18:20 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/147a0117-749d-4aff-8a4d-9ea91238278b/disk.config"/>
Aug 17 18:18:20 user nova-compute[72874]:       <target dev="hda" bus="ide"/>
Aug 17 18:18:20 user nova-compute[72874]:     </disk>
Aug 17 18:18:20 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:18:20 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:18:20 user nova-compute[72874]:       <source dev="/dev/sdc"/>
Aug 17 18:18:20 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:18:20 user nova-compute[72874]:       <serial>3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600</serial>
Aug 17 18:18:20 user nova-compute[72874]:     </disk>
Aug 17 18:18:20 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:18:20 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:18:20 user nova-compute[72874]:       <source dev="/dev/sdd"/>
Aug 17 18:18:20 user nova-compute[72874]:       <target dev="vdb" bus="virtio"/>
Aug 17 18:18:20 user nova-compute[72874]:       <serial>1fd775ed-8af7-48df-8684-9c68ef6b62fe</serial>
Aug 17 18:18:20 user nova-compute[72874]:     </disk>
Aug 17 18:18:20 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:18:20 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:18:20 user nova-compute[72874]:       <source dev="/dev/sde"/>
Aug 17 18:18:20 user nova-compute[72874]:       <target dev="vdc" bus="virtio"/>
Aug 17 18:18:20 user nova-compute[72874]:       <serial>df274d3a-8624-4817-8cc7-b2ea82d0df77</serial>
Aug 17 18:18:20 user nova-compute[72874]:     </disk>
Aug 17 18:18:20 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:18:20 user nova-compute[72874]:       <mac address="fa:16:3e:1f:e4:9d"/>
Aug 17 18:18:20 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:18:20 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:18:20 user nova-compute[72874]:       <target dev="tap3d6f0247-04"/>
Aug 17 18:18:20 user nova-compute[72874]:     </interface>
Aug 17 18:18:20 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:18:20 user nova-compute[72874]:       <mac address="fa:16:3e:d0:31:5f"/>
Aug 17 18:18:20 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:18:20 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:18:20 user nova-compute[72874]:       <target dev="tapb65a4e99-e0"/>
Aug 17 18:18:20 user nova-compute[72874]:     </interface>
Aug 17 18:18:20 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:18:20 user nova-compute[72874]:       <mac address="fa:16:3e:46:71:d4"/>
Aug 17 18:18:20 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:18:20 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:18:20 user nova-compute[72874]:       <target dev="tap3e811baf-1a"/>
Aug 17 18:18:20 user nova-compute[72874]:     </interface>
Aug 17 18:18:20 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:18:20 user nova-compute[72874]:       <mac address="fa:16:3e:82:93:6c"/>
Aug 17 18:18:20 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:18:20 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:18:20 user nova-compute[72874]:       <target dev="tap350d5856-a6"/>
Aug 17 18:18:20 user nova-compute[72874]:     </interface>
Aug 17 18:18:20 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:18:20 user nova-compute[72874]:       <mac address="fa:16:3e:3c:28:8e"/>
Aug 17 18:18:20 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:18:20 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:18:20 user nova-compute[72874]:       <target dev="tap4447fb91-c7"/>
Aug 17 18:18:20 user nova-compute[72874]:     </interface>
Aug 17 18:18:20 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:18:20 user nova-compute[72874]:       <mac address="fa:16:3e:cc:81:9c"/>
Aug 17 18:18:20 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:18:20 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:18:20 user nova-compute[72874]:       <target dev="tap6ed88fc4-fc"/>
Aug 17 18:18:20 user nova-compute[72874]:     </interface>
Aug 17 18:18:20 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:18:20 user nova-compute[72874]:       <mac address="fa:16:3e:c3:d8:a8"/>
Aug 17 18:18:20 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:18:20 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:18:20 user nova-compute[72874]:       <target dev="tape4ef743f-f4"/>
Aug 17 18:18:20 user nova-compute[72874]:     </interface>
Aug 17 18:18:20 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:18:20 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/147a0117-749d-4aff-8a4d-9ea91238278b/console.log" append="off"/>
Aug 17 18:18:20 user nova-compute[72874]:     </serial>
Aug 17 18:18:20 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:18:20 user nova-compute[72874]:     <video>
Aug 17 18:18:20 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:18:20 user nova-compute[72874]:     </video>
Aug 17 18:18:20 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:18:20 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:18:20 user nova-compute[72874]:     </rng>
Aug 17 18:18:20 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:18:20 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:18:20 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:18:20 user nova-compute[72874]:     </memballoon>
Aug 17 18:18:20 user nova-compute[72874]:   </devices>
Aug 17 18:18:20 user nova-compute[72874]: </domain>
Aug 17 18:18:20 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "address": "fa:16:3e:1f:e4:9d", "network": {"id": "2a24259a-abcc-4676-b0ac-5421ac2a6885", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1205067213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6f0247-04", "ovs_interfaceid": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "address": "fa:16:3e:1f:e4:9d", "network": {"id": "2a24259a-abcc-4676-b0ac-5421ac2a6885", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1205067213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6f0247-04", "ovs_interfaceid": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:e4:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d6f0247-0483-4fad-9551-30b7ea4933cd,network=Network(2a24259a-abcc-4676-b0ac-5421ac2a6885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d6f0247-04') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG os_vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:e4:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d6f0247-0483-4fad-9551-30b7ea4933cd,network=Network(2a24259a-abcc-4676-b0ac-5421ac2a6885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d6f0247-04') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d6f0247-04, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d6f0247-04, col_values=(('external_ids', {'iface-id': '3d6f0247-0483-4fad-9551-30b7ea4933cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:e4:9d', 'vm-uuid': '147a0117-749d-4aff-8a4d-9ea91238278b'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: INFO os_vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:e4:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d6f0247-0483-4fad-9551-30b7ea4933cd,network=Network(2a24259a-abcc-4676-b0ac-5421ac2a6885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d6f0247-04')
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "address": "fa:16:3e:d0:31:5f", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65a4e99-e0", "ovs_interfaceid": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "address": "fa:16:3e:d0:31:5f", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65a4e99-e0", "ovs_interfaceid": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:31:5f,bridge_name='br-int',has_traffic_filtering=True,id=b65a4e99-e008-4dd1-9db2-25dfb8d19317,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb65a4e99-e0') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG os_vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:31:5f,bridge_name='br-int',has_traffic_filtering=True,id=b65a4e99-e008-4dd1-9db2-25dfb8d19317,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb65a4e99-e0') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb65a4e99-e0, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb65a4e99-e0, col_values=(('external_ids', {'iface-id': 'b65a4e99-e008-4dd1-9db2-25dfb8d19317', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:31:5f', 'vm-uuid': '147a0117-749d-4aff-8a4d-9ea91238278b'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: INFO os_vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:31:5f,bridge_name='br-int',has_traffic_filtering=True,id=b65a4e99-e008-4dd1-9db2-25dfb8d19317,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb65a4e99-e0')
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "address": "fa:16:3e:46:71:d4", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e811baf-1a", "ovs_interfaceid": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "address": "fa:16:3e:46:71:d4", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e811baf-1a", "ovs_interfaceid": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:71:d4,bridge_name='br-int',has_traffic_filtering=True,id=3e811baf-1a7c-4c5d-bd92-6812e7ab3375,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e811baf-1a') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG os_vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:71:d4,bridge_name='br-int',has_traffic_filtering=True,id=3e811baf-1a7c-4c5d-bd92-6812e7ab3375,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e811baf-1a') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e811baf-1a, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e811baf-1a, col_values=(('external_ids', {'iface-id': '3e811baf-1a7c-4c5d-bd92-6812e7ab3375', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:71:d4', 'vm-uuid': '147a0117-749d-4aff-8a4d-9ea91238278b'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: INFO os_vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:71:d4,bridge_name='br-int',has_traffic_filtering=True,id=3e811baf-1a7c-4c5d-bd92-6812e7ab3375,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e811baf-1a')
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "350d5856-a681-4266-b9c0-670a99cbd2a2", "address": "fa:16:3e:82:93:6c", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350d5856-a6", "ovs_interfaceid": "350d5856-a681-4266-b9c0-670a99cbd2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "350d5856-a681-4266-b9c0-670a99cbd2a2", "address": "fa:16:3e:82:93:6c", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350d5856-a6", "ovs_interfaceid": "350d5856-a681-4266-b9c0-670a99cbd2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:93:6c,bridge_name='br-int',has_traffic_filtering=True,id=350d5856-a681-4266-b9c0-670a99cbd2a2,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350d5856-a6') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG os_vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:93:6c,bridge_name='br-int',has_traffic_filtering=True,id=350d5856-a681-4266-b9c0-670a99cbd2a2,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350d5856-a6') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap350d5856-a6, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap350d5856-a6, col_values=(('external_ids', {'iface-id': '350d5856-a681-4266-b9c0-670a99cbd2a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:93:6c', 'vm-uuid': '147a0117-749d-4aff-8a4d-9ea91238278b'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: INFO os_vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:93:6c,bridge_name='br-int',has_traffic_filtering=True,id=350d5856-a681-4266-b9c0-670a99cbd2a2,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350d5856-a6')
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "address": "fa:16:3e:3c:28:8e", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447fb91-c7", "ovs_interfaceid": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "address": "fa:16:3e:3c:28:8e", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447fb91-c7", "ovs_interfaceid": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:28:8e,bridge_name='br-int',has_traffic_filtering=True,id=4447fb91-c7dc-4014-a316-fcc684f2a1d7,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4447fb91-c7') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG os_vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:28:8e,bridge_name='br-int',has_traffic_filtering=True,id=4447fb91-c7dc-4014-a316-fcc684f2a1d7,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4447fb91-c7') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4447fb91-c7, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4447fb91-c7, col_values=(('external_ids', {'iface-id': '4447fb91-c7dc-4014-a316-fcc684f2a1d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:28:8e', 'vm-uuid': '147a0117-749d-4aff-8a4d-9ea91238278b'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:20 user nova-compute[72874]: INFO os_vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:28:8e,bridge_name='br-int',has_traffic_filtering=True,id=4447fb91-c7dc-4014-a316-fcc684f2a1d7,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4447fb91-c7')
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "address": "fa:16:3e:cc:81:9c", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed88fc4-fc", "ovs_interfaceid": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "address": "fa:16:3e:cc:81:9c", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed88fc4-fc", "ovs_interfaceid": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:18:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:81:9c,bridge_name='br-int',has_traffic_filtering=True,id=6ed88fc4-fcd1-415d-a1fe-779f77394c9e,network=Network(19dafa9a-41de-43f8-9f41-499d5449f2e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed88fc4-fc') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG os_vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:81:9c,bridge_name='br-int',has_traffic_filtering=True,id=6ed88fc4-fcd1-415d-a1fe-779f77394c9e,network=Network(19dafa9a-41de-43f8-9f41-499d5449f2e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed88fc4-fc') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ed88fc4-fc, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6ed88fc4-fc, col_values=(('external_ids', {'iface-id': '6ed88fc4-fcd1-415d-a1fe-779f77394c9e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:81:9c', 'vm-uuid': '147a0117-749d-4aff-8a4d-9ea91238278b'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:21 user nova-compute[72874]: INFO os_vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:81:9c,bridge_name='br-int',has_traffic_filtering=True,id=6ed88fc4-fcd1-415d-a1fe-779f77394c9e,network=Network(19dafa9a-41de-43f8-9f41-499d5449f2e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed88fc4-fc')
Aug 17 18:18:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:17:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4ef743f-f417-446a-adcd-10b699018f21", "address": "fa:16:3e:c3:d8:a8", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ef743f-f4", "ovs_interfaceid": "e4ef743f-f417-446a-adcd-10b699018f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "e4ef743f-f417-446a-adcd-10b699018f21", "address": "fa:16:3e:c3:d8:a8", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ef743f-f4", "ovs_interfaceid": "e4ef743f-f417-446a-adcd-10b699018f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d8:a8,bridge_name='br-int',has_traffic_filtering=True,id=e4ef743f-f417-446a-adcd-10b699018f21,network=Network(19dafa9a-41de-43f8-9f41-499d5449f2e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ef743f-f4') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG os_vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d8:a8,bridge_name='br-int',has_traffic_filtering=True,id=e4ef743f-f417-446a-adcd-10b699018f21,network=Network(19dafa9a-41de-43f8-9f41-499d5449f2e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ef743f-f4') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape4ef743f-f4, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape4ef743f-f4, col_values=(('external_ids', {'iface-id': 'e4ef743f-f417-446a-adcd-10b699018f21', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:d8:a8', 'vm-uuid': '147a0117-749d-4aff-8a4d-9ea91238278b'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:21 user nova-compute[72874]: INFO os_vif [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d8:a8,bridge_name='br-int',has_traffic_filtering=True,id=e4ef743f-f417-446a-adcd-10b699018f21,network=Network(19dafa9a-41de-43f8-9f41-499d5449f2e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ef743f-f4')
Aug 17 18:18:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] No BDM found with device name hda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] No VIF found with MAC fa:16:3e:1f:e4:9d, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] No VIF found with MAC fa:16:3e:3c:28:8e, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:18:21 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Using config drive
Aug 17 18:18:21 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Creating config drive at /opt/stack/data/nova/instances/147a0117-749d-4aff-8a4d-9ea91238278b/disk.config
Aug 17 18:18:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/147a0117-749d-4aff-8a4d-9ea91238278b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpedzfmrzm {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/147a0117-749d-4aff-8a4d-9ea91238278b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpedzfmrzm" returned: 0 in 0.062s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:22 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Snapshot image upload complete
Aug 17 18:18:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:18:22 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Snapshot image upload complete
Aug 17 18:18:22 user nova-compute[72874]: INFO nova.compute.manager [None req-c97aa9b6-be78-486b-9520-3a0f25b8f8ba tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Took 6.75 seconds to snapshot the instance on the hypervisor.
Aug 17 18:18:22 user nova-compute[72874]: INFO nova.compute.manager [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Shelve offloading
Aug 17 18:18:22 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Instance destroyed successfully.
Aug 17 18:18:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:18:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:18:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquired lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:18:22 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:18:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:22 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Updating instance_info_cache with network_info: [{"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:18:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Releasing lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:18:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG nova.compute.manager [req-ebb14a9d-4c85-43d0-840b-bdad973f2cfc req-110b82cb-e070-47a1-a504-6cc3c84a949d service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-3d6f0247-0483-4fad-9551-30b7ea4933cd {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ebb14a9d-4c85-43d0-840b-bdad973f2cfc req-110b82cb-e070-47a1-a504-6cc3c84a949d service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ebb14a9d-4c85-43d0-840b-bdad973f2cfc req-110b82cb-e070-47a1-a504-6cc3c84a949d service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ebb14a9d-4c85-43d0-840b-bdad973f2cfc req-110b82cb-e070-47a1-a504-6cc3c84a949d service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG nova.compute.manager [req-ebb14a9d-4c85-43d0-840b-bdad973f2cfc req-110b82cb-e070-47a1-a504-6cc3c84a949d service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-3d6f0247-0483-4fad-9551-30b7ea4933cd {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:23 user nova-compute[72874]: WARNING nova.compute.manager [req-ebb14a9d-4c85-43d0-840b-bdad973f2cfc req-110b82cb-e070-47a1-a504-6cc3c84a949d service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-3d6f0247-0483-4fad-9551-30b7ea4933cd for instance with vm_state building and task_state spawning.
Aug 17 18:18:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG nova.compute.manager [req-3441a55c-6762-4ac0-91be-5857458cf544 req-d93500f6-1023-4174-b60b-ae920643602f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-3e811baf-1a7c-4c5d-bd92-6812e7ab3375 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3441a55c-6762-4ac0-91be-5857458cf544 req-d93500f6-1023-4174-b60b-ae920643602f service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3441a55c-6762-4ac0-91be-5857458cf544 req-d93500f6-1023-4174-b60b-ae920643602f service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3441a55c-6762-4ac0-91be-5857458cf544 req-d93500f6-1023-4174-b60b-ae920643602f service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:23 user nova-compute[72874]: DEBUG nova.compute.manager [req-3441a55c-6762-4ac0-91be-5857458cf544 req-d93500f6-1023-4174-b60b-ae920643602f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-3e811baf-1a7c-4c5d-bd92-6812e7ab3375 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:23 user nova-compute[72874]: WARNING nova.compute.manager [req-3441a55c-6762-4ac0-91be-5857458cf544 req-d93500f6-1023-4174-b60b-ae920643602f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-3e811baf-1a7c-4c5d-bd92-6812e7ab3375 for instance with vm_state building and task_state spawning.
Aug 17 18:18:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Instance destroyed successfully.
Aug 17 18:18:24 user nova-compute[72874]: DEBUG nova.objects.instance [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'resources' on Instance uuid c27fc8b6-cc8c-426a-859d-04722c569cd4 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-432713260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-432713260',id=1,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtzSGb/RTg0RRgVw0I27O9/BIQT9JNqUYiaCVzRF/ZiyzbxLbQ3ogj5i0iMmVI1YnyWXTX4BFGtidL7oy3scdKgIgmM9URa5HU3gOM2Lg8cRYOCgIsNeC1jsau2L7myZA==',key_name='tempest-keypair-271521945',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5c20349a873f4ec7a0f72a7d64c636e4',ramdisk_id='',reservation_id='r-xtamjwzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1376162523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1376162523-project-member',shelved_at='2023-08-17T18:18:22.399223',shelved_host='user',shelved_image_id='927630a0-f5c3-4e26-a3db-d70885a018b5'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b47defaba840e1ba8f91603d99caac',uuid=c27fc8b6-cc8c-426a-859d-04722c569cd4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converting VIF {"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:fb:6f,bridge_name='br-int',has_traffic_filtering=True,id=63ec6fca-872d-4e61-b76a-c39215266088,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ec6fca-87') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG os_vif [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:fb:6f,bridge_name='br-int',has_traffic_filtering=True,id=63ec6fca-872d-4e61-b76a-c39215266088,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ec6fca-87') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63ec6fca-87, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-9eb71e9f-a59f-417f-a78c-bb6bb14f8647 req-369644e4-be0c-47ab-948c-a70546a917d5 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received event network-changed-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-9eb71e9f-a59f-417f-a78c-bb6bb14f8647 req-369644e4-be0c-47ab-948c-a70546a917d5 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Refreshing instance network info cache due to event network-changed-63ec6fca-872d-4e61-b76a-c39215266088. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9eb71e9f-a59f-417f-a78c-bb6bb14f8647 req-369644e4-be0c-47ab-948c-a70546a917d5 service nova] Acquiring lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9eb71e9f-a59f-417f-a78c-bb6bb14f8647 req-369644e4-be0c-47ab-948c-a70546a917d5 service nova] Acquired lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG nova.network.neutron [req-9eb71e9f-a59f-417f-a78c-bb6bb14f8647 req-369644e4-be0c-47ab-948c-a70546a917d5 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Refreshing network info cache for port 63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: INFO os_vif [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:fb:6f,bridge_name='br-int',has_traffic_filtering=True,id=63ec6fca-872d-4e61-b76a-c39215266088,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ec6fca-87')
Aug 17 18:18:24 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Deleting instance files /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4_del
Aug 17 18:18:24 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Deletion of /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4_del complete
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Deleted allocations for instance c27fc8b6-cc8c-426a-859d-04722c569cd4
Aug 17 18:18:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG nova.objects.instance [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'numa_topology' on Instance uuid c27fc8b6-cc8c-426a-859d-04722c569cd4 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:24 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.415s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2df4cee5-0765-4cff-bf62-d628b7292082 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.401s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG nova.network.neutron [req-9eb71e9f-a59f-417f-a78c-bb6bb14f8647 req-369644e4-be0c-47ab-948c-a70546a917d5 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Updated VIF entry in instance network info cache for port 63ec6fca-872d-4e61-b76a-c39215266088. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG nova.network.neutron [req-9eb71e9f-a59f-417f-a78c-bb6bb14f8647 req-369644e4-be0c-47ab-948c-a70546a917d5 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Updating instance_info_cache with network_info: [{"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap63ec6fca-87", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9eb71e9f-a59f-417f-a78c-bb6bb14f8647 req-369644e4-be0c-47ab-948c-a70546a917d5 service nova] Releasing lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-3d6f0247-0483-4fad-9551-30b7ea4933cd {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-3d6f0247-0483-4fad-9551-30b7ea4933cd {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:25 user nova-compute[72874]: WARNING nova.compute.manager [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-3d6f0247-0483-4fad-9551-30b7ea4933cd for instance with vm_state building and task_state spawning.
Aug 17 18:18:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-b65a4e99-e008-4dd1-9db2-25dfb8d19317 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-b65a4e99-e008-4dd1-9db2-25dfb8d19317 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:25 user nova-compute[72874]: WARNING nova.compute.manager [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-b65a4e99-e008-4dd1-9db2-25dfb8d19317 for instance with vm_state building and task_state spawning.
Aug 17 18:18:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-b65a4e99-e008-4dd1-9db2-25dfb8d19317 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-b65a4e99-e008-4dd1-9db2-25dfb8d19317 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:25 user nova-compute[72874]: WARNING nova.compute.manager [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-b65a4e99-e008-4dd1-9db2-25dfb8d19317 for instance with vm_state building and task_state spawning.
Aug 17 18:18:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-e4ef743f-f417-446a-adcd-10b699018f21 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-e4ef743f-f417-446a-adcd-10b699018f21 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:25 user nova-compute[72874]: WARNING nova.compute.manager [req-dd90d7c8-ef3d-4f7d-9263-76c17c7423c6 req-53d2fd3d-b5bf-4848-92ea-0db704a6f13f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-e4ef743f-f417-446a-adcd-10b699018f21 for instance with vm_state building and task_state spawning.
Aug 17 18:18:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-3e811baf-1a7c-4c5d-bd92-6812e7ab3375 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-3e811baf-1a7c-4c5d-bd92-6812e7ab3375 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:25 user nova-compute[72874]: WARNING nova.compute.manager [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-3e811baf-1a7c-4c5d-bd92-6812e7ab3375 for instance with vm_state building and task_state spawning.
Aug 17 18:18:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-6ed88fc4-fcd1-415d-a1fe-779f77394c9e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-6ed88fc4-fcd1-415d-a1fe-779f77394c9e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:25 user nova-compute[72874]: WARNING nova.compute.manager [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-6ed88fc4-fcd1-415d-a1fe-779f77394c9e for instance with vm_state building and task_state spawning.
Aug 17 18:18:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-6ed88fc4-fcd1-415d-a1fe-779f77394c9e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-6ed88fc4-fcd1-415d-a1fe-779f77394c9e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:25 user nova-compute[72874]: WARNING nova.compute.manager [req-1319c5e2-cbab-44e3-b609-e284b3f6e1c3 req-6f777bea-9190-4687-b53c-da1735eda012 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-6ed88fc4-fcd1-415d-a1fe-779f77394c9e for instance with vm_state building and task_state spawning.
Aug 17 18:18:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-350d5856-a681-4266-b9c0-670a99cbd2a2 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-350d5856-a681-4266-b9c0-670a99cbd2a2 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:26 user nova-compute[72874]: WARNING nova.compute.manager [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-350d5856-a681-4266-b9c0-670a99cbd2a2 for instance with vm_state building and task_state spawning.
Aug 17 18:18:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-350d5856-a681-4266-b9c0-670a99cbd2a2 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-350d5856-a681-4266-b9c0-670a99cbd2a2 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:26 user nova-compute[72874]: WARNING nova.compute.manager [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-350d5856-a681-4266-b9c0-670a99cbd2a2 for instance with vm_state building and task_state spawning.
Aug 17 18:18:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-4447fb91-c7dc-4014-a316-fcc684f2a1d7 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-4447fb91-c7dc-4014-a316-fcc684f2a1d7 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:26 user nova-compute[72874]: WARNING nova.compute.manager [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-4447fb91-c7dc-4014-a316-fcc684f2a1d7 for instance with vm_state building and task_state spawning.
Aug 17 18:18:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-4447fb91-c7dc-4014-a316-fcc684f2a1d7 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-4447fb91-c7dc-4014-a316-fcc684f2a1d7 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:26 user nova-compute[72874]: WARNING nova.compute.manager [req-5e28689f-8490-4a0e-80e7-13a5a2b5381d req-0ffdfaa9-fce7-4097-9369-5831513c747c service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-4447fb91-c7dc-4014-a316-fcc684f2a1d7 for instance with vm_state building and task_state spawning.
Aug 17 18:18:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296307.524578, 147a0117-749d-4aff-8a4d-9ea91238278b => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:18:27 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] VM Resumed (Lifecycle Event)
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.compute.manager [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:18:27 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Instance spawned successfully.
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-c4e490e2-2652-41a9-96ce-2fa1ab35bb86 req-b92db592-a9f9-4b63-a886-f4b41802833a service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-e4ef743f-f417-446a-adcd-10b699018f21 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c4e490e2-2652-41a9-96ce-2fa1ab35bb86 req-b92db592-a9f9-4b63-a886-f4b41802833a service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c4e490e2-2652-41a9-96ce-2fa1ab35bb86 req-b92db592-a9f9-4b63-a886-f4b41802833a service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c4e490e2-2652-41a9-96ce-2fa1ab35bb86 req-b92db592-a9f9-4b63-a886-f4b41802833a service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-c4e490e2-2652-41a9-96ce-2fa1ab35bb86 req-b92db592-a9f9-4b63-a886-f4b41802833a service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-e4ef743f-f417-446a-adcd-10b699018f21 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:27 user nova-compute[72874]: WARNING nova.compute.manager [req-c4e490e2-2652-41a9-96ce-2fa1ab35bb86 req-b92db592-a9f9-4b63-a886-f4b41802833a service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-e4ef743f-f417-446a-adcd-10b699018f21 for instance with vm_state building and task_state spawning.
Aug 17 18:18:27 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296307.5278108, 147a0117-749d-4aff-8a4d-9ea91238278b => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:18:27 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] VM Started (Lifecycle Event)
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:18:27 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:18:27 user nova-compute[72874]: INFO nova.compute.manager [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Took 12.05 seconds to spawn the instance on the hypervisor.
Aug 17 18:18:27 user nova-compute[72874]: DEBUG nova.compute.manager [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:18:27 user nova-compute[72874]: INFO nova.compute.manager [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Took 47.46 seconds to build instance.
Aug 17 18:18:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-288285ea-0f0f-410c-90f8-6fbfcf2eb488 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "147a0117-749d-4aff-8a4d-9ea91238278b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.639s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RlYEAVPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:18:29 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:29 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:29 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1deb04a4-5fd0-41fd-8896-cce8503e2491]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:18:29 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bf1f18-5065-4f66-ac46-1acea9492bbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9] added
Aug 17 18:18:29 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c35cccb-7718-4142-a037-97a55d05ec70]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[709cbe97-2a2d-4400-a9d2-64f0b6dd1c9c]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RlYEAVPT {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RlYEAVPT" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a8ee06-1fbf-4f45-a872-c0267cd91072]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RlYEAVPT'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b7442d-f523-47a9-884f-2b6a848e3374]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb66f6d-9447-48c4-b2e1-71eea6f94b86]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:29 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:29 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:29 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:29 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:29 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:29 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:29 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:29 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9b0f08-8637-4ef2-a293-80d0757a9888]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9, portal: 172.16.0.220,3260]
Aug 17 18:18:29 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9, portal: 172.16.0.220,3260] successful.
Aug 17 18:18:29 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a09c54-8b48-48bd-83dd-f237308fbb6e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33f2663-9986-4eef-9c29-e3dd30e3f4f4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:29 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:29 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:29 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:29 user nova-compute[72874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 (non-flash)
Aug 17 18:18:29 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:29 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:29 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:29 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:29 user nova-compute[72874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 (non-flash)
Aug 17 18:18:29 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[00db2ac6-b4a2-473d-8760-9ce1c6533ba8]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RlYEAVPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:18:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '26137373264363837', 'path': '/dev/sdf'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:18:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26137373264363837', 'path': '/dev/sdf'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:18:30 user nova-compute[72874]: DEBUG nova.objects.instance [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lazy-loading 'flavor' on Instance uuid 3bf88e4a-ee43-471a-b375-30684f09c3e3 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:18:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:18:30 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:18:30 user nova-compute[72874]:   <source dev="/dev/sdf"/>
Aug 17 18:18:30 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:18:30 user nova-compute[72874]:   <serial>b04679cd-f3aa-4ab1-8d41-1739b7890fb9</serial>
Aug 17 18:18:30 user nova-compute[72874]: </disk>
Aug 17 18:18:30 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:18:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:18:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:18:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] No VIF found with MAC fa:16:3e:3d:e8:ab, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:18:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-125b3340-d5fb-4b15-81d2-09f38ba513bd tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.443s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Acquiring lock "3bf88e4a-ee43-471a-b375-30684f09c3e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Acquiring lock "3bf88e4a-ee43-471a-b375-30684f09c3e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:32 user nova-compute[72874]: INFO nova.compute.manager [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Terminating instance
Aug 17 18:18:32 user nova-compute[72874]: DEBUG nova.compute.manager [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:18:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:32 user nova-compute[72874]: DEBUG nova.compute.manager [req-258bd616-9e8a-4ecc-bf33-fd14ce8a7302 req-2e203385-452b-41a3-8086-1dde0a7553c9 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Received event network-vif-unplugged-854fd839-b199-4430-a240-29ab1c0a3700 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-258bd616-9e8a-4ecc-bf33-fd14ce8a7302 req-2e203385-452b-41a3-8086-1dde0a7553c9 service nova] Acquiring lock "3bf88e4a-ee43-471a-b375-30684f09c3e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-258bd616-9e8a-4ecc-bf33-fd14ce8a7302 req-2e203385-452b-41a3-8086-1dde0a7553c9 service nova] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-258bd616-9e8a-4ecc-bf33-fd14ce8a7302 req-2e203385-452b-41a3-8086-1dde0a7553c9 service nova] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:32 user nova-compute[72874]: DEBUG nova.compute.manager [req-258bd616-9e8a-4ecc-bf33-fd14ce8a7302 req-2e203385-452b-41a3-8086-1dde0a7553c9 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] No waiting events found dispatching network-vif-unplugged-854fd839-b199-4430-a240-29ab1c0a3700 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:32 user nova-compute[72874]: DEBUG nova.compute.manager [req-258bd616-9e8a-4ecc-bf33-fd14ce8a7302 req-2e203385-452b-41a3-8086-1dde0a7553c9 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Received event network-vif-unplugged-854fd839-b199-4430-a240-29ab1c0a3700 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296298.0409424, c27fc8b6-cc8c-426a-859d-04722c569cd4 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:18:33 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] VM Stopped (Lifecycle Event)
Aug 17 18:18:33 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2abee17d-23c6-4c52-b47a-3281fd8f8bda None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:18:33 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Instance destroyed successfully.
Aug 17 18:18:33 user nova-compute[72874]: DEBUG nova.objects.instance [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lazy-loading 'resources' on Instance uuid 3bf88e4a-ee43-471a-b375-30684f09c3e3 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1668685489',display_name='tempest-DeleteServersTestJSON-server-1668685489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1668685489',id=2,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:16:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21222da070874ea8b635ed3178821402',ramdisk_id='',reservation_id='r-fwy00061',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-19213421',owner_user_name='tempest-DeleteServersTestJSON-19213421-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:16:40Z,user_data=None,user_id='94ac7a3f57014c2594905b75fb46b3c4',uuid=3bf88e4a-ee43-471a-b375-30684f09c3e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "854fd839-b199-4430-a240-29ab1c0a3700", "address": "fa:16:3e:3d:e8:ab", "network": {"id": "6a1d5756-c29e-4f96-aa83-0ad17d8bb48e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1496281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21222da070874ea8b635ed3178821402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fd839-b1", "ovs_interfaceid": "854fd839-b199-4430-a240-29ab1c0a3700", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Converting VIF {"id": "854fd839-b199-4430-a240-29ab1c0a3700", "address": "fa:16:3e:3d:e8:ab", "network": {"id": "6a1d5756-c29e-4f96-aa83-0ad17d8bb48e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1496281815-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21222da070874ea8b635ed3178821402", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap854fd839-b1", "ovs_interfaceid": "854fd839-b199-4430-a240-29ab1c0a3700", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:e8:ab,bridge_name='br-int',has_traffic_filtering=True,id=854fd839-b199-4430-a240-29ab1c0a3700,network=Network(6a1d5756-c29e-4f96-aa83-0ad17d8bb48e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fd839-b1') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_vif [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:e8:ab,bridge_name='br-int',has_traffic_filtering=True,id=854fd839-b199-4430-a240-29ab1c0a3700,network=Network(6a1d5756-c29e-4f96-aa83-0ad17d8bb48e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fd839-b1') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap854fd839-b1, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:18:33 user nova-compute[72874]: INFO os_vif [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:e8:ab,bridge_name='br-int',has_traffic_filtering=True,id=854fd839-b199-4430-a240-29ab1c0a3700,network=Network(6a1d5756-c29e-4f96-aa83-0ad17d8bb48e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap854fd839-b1')
Aug 17 18:18:33 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RlYEAVPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:18:33 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[137660a8-b200-4012-9ad4-a477ee83fb5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf1fbea-de56-4aee-a766-70299ce670c3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:33 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:33 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:33 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:33 user nova-compute[72874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 (non-flash)
Aug 17 18:18:33 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:33 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:33 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:33 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:33 user nova-compute[72874]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 (non-flash)
Aug 17 18:18:33 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c058dea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9'): ({'sdf'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Removing single pathed devices sdf {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23b5020-3c38-4cdc-8c9e-08c15252966f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[90403913-bc31-454c-89f7-d3ab5df89a0c]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Flushing IO for device /dev/sdf {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fc4a31-7898-4a35-ae4e-84bbdf147837]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[253aba9d-6984-44b6-bd54-f1d0fa526684]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] SCSI volumes sdf have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b049b38-94a8-4712-8855-ddea1ebd1fc6]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[287b17a5-4e45-42b7-9209-bd3f8afccf79]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9, portal: 172.16.0.220,3260]
Aug 17 18:18:33 user nova-compute[72874]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9, portal: 172.16.0.220,3260] successful.
Aug 17 18:18:33 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04679cd-f3aa-4ab1-8d41-1739b7890fb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf56484-45a6-4600-b419-8d73a55bcd10]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] <== disconnect_volume: return (299ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:18:33 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Deleting instance files /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3_del
Aug 17 18:18:33 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Deletion of /opt/stack/data/nova/instances/3bf88e4a-ee43-471a-b375-30684f09c3e3_del complete
Aug 17 18:18:33 user nova-compute[72874]: INFO nova.compute.manager [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Took 1.25 seconds to destroy the instance on the hypervisor.
Aug 17 18:18:33 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:18:33 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:18:34 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:18:34 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Took 0.66 seconds to deallocate network for instance.
Aug 17 18:18:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-97802660-7960-4ee1-9dfd-91a3d66a0431 req-5303702b-99c5-4097-8df3-e0191c71eb68 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Received event network-vif-plugged-854fd839-b199-4430-a240-29ab1c0a3700 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-97802660-7960-4ee1-9dfd-91a3d66a0431 req-5303702b-99c5-4097-8df3-e0191c71eb68 service nova] Acquiring lock "3bf88e4a-ee43-471a-b375-30684f09c3e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-97802660-7960-4ee1-9dfd-91a3d66a0431 req-5303702b-99c5-4097-8df3-e0191c71eb68 service nova] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-97802660-7960-4ee1-9dfd-91a3d66a0431 req-5303702b-99c5-4097-8df3-e0191c71eb68 service nova] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-97802660-7960-4ee1-9dfd-91a3d66a0431 req-5303702b-99c5-4097-8df3-e0191c71eb68 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] No waiting events found dispatching network-vif-plugged-854fd839-b199-4430-a240-29ab1c0a3700 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:18:35 user nova-compute[72874]: WARNING nova.compute.manager [req-97802660-7960-4ee1-9dfd-91a3d66a0431 req-5303702b-99c5-4097-8df3-e0191c71eb68 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Received unexpected event network-vif-plugged-854fd839-b199-4430-a240-29ab1c0a3700 for instance with vm_state active and task_state deleting.
Aug 17 18:18:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-97802660-7960-4ee1-9dfd-91a3d66a0431 req-5303702b-99c5-4097-8df3-e0191c71eb68 service nova] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Received event network-vif-deleted-854fd839-b199-4430-a240-29ab1c0a3700 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-7fc3caf2-a249-4b12-af5a-a112fa00929a req-1e649ab8-0dbd-429f-976d-bba17e502e36 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Received event network-changed-a5c80e92-7939-4713-bace-452403c97c47 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-7fc3caf2-a249-4b12-af5a-a112fa00929a req-1e649ab8-0dbd-429f-976d-bba17e502e36 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Refreshing instance network info cache due to event network-changed-a5c80e92-7939-4713-bace-452403c97c47. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:18:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7fc3caf2-a249-4b12-af5a-a112fa00929a req-1e649ab8-0dbd-429f-976d-bba17e502e36 service nova] Acquiring lock "refresh_cache-ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:18:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7fc3caf2-a249-4b12-af5a-a112fa00929a req-1e649ab8-0dbd-429f-976d-bba17e502e36 service nova] Acquired lock "refresh_cache-ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:18:35 user nova-compute[72874]: DEBUG nova.network.neutron [req-7fc3caf2-a249-4b12-af5a-a112fa00929a req-1e649ab8-0dbd-429f-976d-bba17e502e36 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Refreshing network info cache for port a5c80e92-7939-4713-bace-452403c97c47 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:18:35 user nova-compute[72874]: INFO nova.compute.manager [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Took 1.00 seconds to detach 1 volumes for instance.
Aug 17 18:18:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:36 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:18:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-a649364a-dc42-404f-899b-59e7d372074c req-4f82ddf1-0134-4e98-9205-aade1b97b9bf service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Received event network-changed-99361343-b109-451a-9ce9-50e5fd738b0e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-a649364a-dc42-404f-899b-59e7d372074c req-4f82ddf1-0134-4e98-9205-aade1b97b9bf service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Refreshing instance network info cache due to event network-changed-99361343-b109-451a-9ce9-50e5fd738b0e. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:18:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a649364a-dc42-404f-899b-59e7d372074c req-4f82ddf1-0134-4e98-9205-aade1b97b9bf service nova] Acquiring lock "refresh_cache-8c2eb160-5b94-4d53-bd36-b712c62d9100" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:18:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a649364a-dc42-404f-899b-59e7d372074c req-4f82ddf1-0134-4e98-9205-aade1b97b9bf service nova] Acquired lock "refresh_cache-8c2eb160-5b94-4d53-bd36-b712c62d9100" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:18:36 user nova-compute[72874]: DEBUG nova.network.neutron [req-a649364a-dc42-404f-899b-59e7d372074c req-4f82ddf1-0134-4e98-9205-aade1b97b9bf service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Refreshing network info cache for port 99361343-b109-451a-9ce9-50e5fd738b0e {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:18:36 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:18:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.603s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:36 user nova-compute[72874]: DEBUG nova.network.neutron [req-7fc3caf2-a249-4b12-af5a-a112fa00929a req-1e649ab8-0dbd-429f-976d-bba17e502e36 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Updated VIF entry in instance network info cache for port a5c80e92-7939-4713-bace-452403c97c47. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:18:36 user nova-compute[72874]: DEBUG nova.network.neutron [req-7fc3caf2-a249-4b12-af5a-a112fa00929a req-1e649ab8-0dbd-429f-976d-bba17e502e36 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Updating instance_info_cache with network_info: [{"id": "a5c80e92-7939-4713-bace-452403c97c47", "address": "fa:16:3e:31:0e:3b", "network": {"id": "245fda49-a954-49cd-a901-d91753fa07f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-715260708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "817d1715984649a68c2ef734ba21feeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c80e92-79", "ovs_interfaceid": "a5c80e92-7939-4713-bace-452403c97c47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:18:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7fc3caf2-a249-4b12-af5a-a112fa00929a req-1e649ab8-0dbd-429f-976d-bba17e502e36 service nova] Releasing lock "refresh_cache-ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:18:36 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Deleted allocations for instance 3bf88e4a-ee43-471a-b375-30684f09c3e3
Aug 17 18:18:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-beef75dc-eac3-43c6-8d58-bb1545cf7869 tempest-DeleteServersTestJSON-19213421 tempest-DeleteServersTestJSON-19213421-project-member] Lock "3bf88e4a-ee43-471a-b375-30684f09c3e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.768s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:36 user nova-compute[72874]: DEBUG nova.network.neutron [req-a649364a-dc42-404f-899b-59e7d372074c req-4f82ddf1-0134-4e98-9205-aade1b97b9bf service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Updated VIF entry in instance network info cache for port 99361343-b109-451a-9ce9-50e5fd738b0e. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:18:36 user nova-compute[72874]: DEBUG nova.network.neutron [req-a649364a-dc42-404f-899b-59e7d372074c req-4f82ddf1-0134-4e98-9205-aade1b97b9bf service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Updating instance_info_cache with network_info: [{"id": "99361343-b109-451a-9ce9-50e5fd738b0e", "address": "fa:16:3e:a7:7a:4b", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99361343-b1", "ovs_interfaceid": "99361343-b109-451a-9ce9-50e5fd738b0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:18:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a649364a-dc42-404f-899b-59e7d372074c req-4f82ddf1-0134-4e98-9205-aade1b97b9bf service nova] Releasing lock "refresh_cache-8c2eb160-5b94-4d53-bd36-b712c62d9100" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:18:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-4aceaa45-e5e2-4f79-ab92-1b4af6f5f264 req-70a6eb15-a030-43ce-a9a7-19c2960bb16a service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Received event network-changed-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-4aceaa45-e5e2-4f79-ab92-1b4af6f5f264 req-70a6eb15-a030-43ce-a9a7-19c2960bb16a service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Refreshing instance network info cache due to event network-changed-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4aceaa45-e5e2-4f79-ab92-1b4af6f5f264 req-70a6eb15-a030-43ce-a9a7-19c2960bb16a service nova] Acquiring lock "refresh_cache-544005af-7312-4bd4-a086-7d255ca7c479" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4aceaa45-e5e2-4f79-ab92-1b4af6f5f264 req-70a6eb15-a030-43ce-a9a7-19c2960bb16a service nova] Acquired lock "refresh_cache-544005af-7312-4bd4-a086-7d255ca7c479" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG nova.network.neutron [req-4aceaa45-e5e2-4f79-ab92-1b4af6f5f264 req-70a6eb15-a030-43ce-a9a7-19c2960bb16a service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Refreshing network info cache for port fed725fd-dbf1-4c2b-bccc-5cd012a23c8e {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Acquiring lock "544005af-7312-4bd4-a086-7d255ca7c479" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Lock "544005af-7312-4bd4-a086-7d255ca7c479" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG nova.objects.instance [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Lazy-loading 'flavor' on Instance uuid 544005af-7312-4bd4-a086-7d255ca7c479 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Lock "544005af-7312-4bd4-a086-7d255ca7c479" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.100s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Acquiring lock "544005af-7312-4bd4-a086-7d255ca7c479" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Lock "544005af-7312-4bd4-a086-7d255ca7c479" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:39 user nova-compute[72874]: INFO nova.compute.manager [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Attaching volume 874ae2f9-95bc-4958-903e-86c3b9481bf5 to /dev/vdb
Aug 17 18:18:39 user nova-compute[72874]: DEBUG nova.network.neutron [req-4aceaa45-e5e2-4f79-ab92-1b4af6f5f264 req-70a6eb15-a030-43ce-a9a7-19c2960bb16a service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Updated VIF entry in instance network info cache for port fed725fd-dbf1-4c2b-bccc-5cd012a23c8e. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG nova.network.neutron [req-4aceaa45-e5e2-4f79-ab92-1b4af6f5f264 req-70a6eb15-a030-43ce-a9a7-19c2960bb16a service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Updating instance_info_cache with network_info: [{"id": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "address": "fa:16:3e:18:f7:a8", "network": {"id": "769ce42c-9237-4e57-8e6d-e62ed20ec619", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1230971768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a69ad5e8854703abf0ec2fefbc0f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed725fd-db", "ovs_interfaceid": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4aceaa45-e5e2-4f79-ab92-1b4af6f5f264 req-70a6eb15-a030-43ce-a9a7-19c2960bb16a service nova] Releasing lock "refresh_cache-544005af-7312-4bd4-a086-7d255ca7c479" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG os_brick.utils [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0e4d77-e17d-4d81-aad5-cda104b05daa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b20e2d3-825f-465c-bf29-9589b931ec85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cee459-90e8-4a94-a3af-b8ab500d2435]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[269515f8-2a80-4f89-91d6-0fddfdac3461]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:18:39 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f613d46c-0919-460d-9aaa-f9bbbb504c65]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG os_brick.utils [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Updating existing volume attachment record: 71a31437-fcab-46b6-8427-fa7860c88c08 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquiring lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG nova.objects.instance [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lazy-loading 'flavor' on Instance uuid ef6c7125-8a47-4e3f-bb6d-b6aa5254116c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:18:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquiring lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:40 user nova-compute[72874]: INFO nova.compute.manager [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Attaching volume 204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 to /dev/sdc
Aug 17 18:18:40 user nova-compute[72874]: DEBUG os_brick.utils [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30a8beb-6c18-4510-b582-ee80877f150c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[46212bcf-8458-4a09-b3a9-9635dd558867]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c4b2c6-2a28-4df9-98bd-8454e32dd4e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e66d9f-601b-459e-bc81-3c00e86529f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:18:40 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[06952ad9-c031-42e8-a5a0-d4ca0a6852d8]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG os_brick.utils [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Updating existing volume attachment record: e5dab20e-d1ec-4a9a-8255-ca6046368cb9 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG nova.objects.instance [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lazy-loading 'flavor' on Instance uuid 8c2eb160-5b94-4d53-bd36-b712c62d9100 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:41 user nova-compute[72874]: INFO nova.compute.manager [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Attaching volume 2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 to /dev/vdb
Aug 17 18:18:41 user nova-compute[72874]: DEBUG os_brick.utils [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a13d9b-272f-4eba-8555-0f39f75d0efe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd2ab6b-09a3-4c00-93fb-073ad3daa67a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f2606a-8f82-43eb-bd0d-2bda7f3b9e6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3732754-b7b1-4cae-9beb-2f42b9aedf0f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:18:41 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:18:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78671a1-2b76-4b79-b15d-8c2ee7dce88e]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG os_brick.utils [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:18:41 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Updating existing volume attachment record: 1f421323-d55f-4286-a4cb-b246b6ef3885 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:18:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:47 user nova-compute[72874]: DEBUG nova.compute.manager [req-6469a41e-2e88-406a-bdc0-ce3a87d81ccd req-1343b135-0363-47b4-a412-b5248a2c54ff service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Received event network-changed-1293a9a4-696a-41b5-a2f4-10b40e30f85b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:18:47 user nova-compute[72874]: DEBUG nova.compute.manager [req-6469a41e-2e88-406a-bdc0-ce3a87d81ccd req-1343b135-0363-47b4-a412-b5248a2c54ff service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Refreshing instance network info cache due to event network-changed-1293a9a4-696a-41b5-a2f4-10b40e30f85b. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:18:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6469a41e-2e88-406a-bdc0-ce3a87d81ccd req-1343b135-0363-47b4-a412-b5248a2c54ff service nova] Acquiring lock "refresh_cache-8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:18:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6469a41e-2e88-406a-bdc0-ce3a87d81ccd req-1343b135-0363-47b4-a412-b5248a2c54ff service nova] Acquired lock "refresh_cache-8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:18:47 user nova-compute[72874]: DEBUG nova.network.neutron [req-6469a41e-2e88-406a-bdc0-ce3a87d81ccd req-1343b135-0363-47b4-a412-b5248a2c54ff service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Refreshing network info cache for port 1293a9a4-696a-41b5-a2f4-10b40e30f85b {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:18:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-6469a41e-2e88-406a-bdc0-ce3a87d81ccd req-1343b135-0363-47b4-a412-b5248a2c54ff service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Updated VIF entry in instance network info cache for port 1293a9a4-696a-41b5-a2f4-10b40e30f85b. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:18:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-6469a41e-2e88-406a-bdc0-ce3a87d81ccd req-1343b135-0363-47b4-a412-b5248a2c54ff service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Updating instance_info_cache with network_info: [{"id": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "address": "fa:16:3e:87:05:5f", "network": {"id": "d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1596285574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bee00afddbd47ada0661d599605f8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1293a9a4-69", "ovs_interfaceid": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:18:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6469a41e-2e88-406a-bdc0-ce3a87d81ccd req-1343b135-0363-47b4-a412-b5248a2c54ff service nova] Releasing lock "refresh_cache-8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:18:48 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296313.4489987, 3bf88e4a-ee43-471a-b375-30684f09c3e3 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:18:48 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] VM Stopped (Lifecycle Event)
Aug 17 18:18:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3445bc2a-e3f7-42c6-8ea9-e278f01a76a0 None None] [instance: 3bf88e4a-ee43-471a-b375-30684f09c3e3] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:18:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:18:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FmzRKuVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:18:51 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:51 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:51 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:18:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2c715d-c234-4f12-8bee-6bf5d473ef8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:18:52 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0f5e56-bbc4-4795-89bf-1c506b3fa252]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5] added
Aug 17 18:18:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1abc090-2ab4-4022-8ec3-6bdc2be6df15]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[193d0867-f8b7-4df4-a343-2fec0d32f191]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FmzRKuVw {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FmzRKuVw" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f04ea9-8129-453d-ad37-2228b5631153]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FmzRKuVw'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[20be297e-a192-438c-825e-7b9e579f4bf0]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Acquiring lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4439751-02f1-43f2-83c0-01d43280f12a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:52 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:52 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:52 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:52 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:52 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:52 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG nova.objects.instance [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lazy-loading 'flavor' on Instance uuid 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[42518b0e-146b-42ef-8182-9fe64d9fcbe7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5, portal: 172.16.0.220,3260]
Aug 17 18:18:52 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5, portal: 172.16.0.220,3260] successful.
Aug 17 18:18:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgdyWbXp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:18:52 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0d88cb-685d-4c45-8eb3-a0e669c421f6]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.350s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0bfc184-ff34-466a-aa86-61a8a411cd91]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:52 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:52 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:52 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:52 user nova-compute[72874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)
Aug 17 18:18:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:52 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:52 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:52 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:52 user nova-compute[72874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)
Aug 17 18:18:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.536s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff57d24-88a8-446d-8ac4-57659461c2e9]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FmzRKuVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Acquiring lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:52 user nova-compute[72874]: INFO nova.compute.manager [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Attaching volume a5eb0e71-cb94-4635-b215-5e25162a001f to /dev/vdb
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.utils [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54ac2b4-a6ec-4eb1-8615-5604e14e58d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[80630273-8f58-4edd-9a5c-590be872c0bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[019cabb0-b673-4202-a1a8-c5b88e97ad6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c2c9a0-1dfd-467d-a5e6-d20d68f373d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:18:52 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:18:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[36abaeae-0d4b-47bf-a4a8-00fd5e6e6c07]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG os_brick.utils [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:18:52 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Updating existing volume attachment record: 4fdb9419-abfd-44ed-a235-50ac95da494e {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.578s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] <== connect_volume: return (1581ms) {'type': 'block', 'scsi_wwn': '23066623766656131', 'path': '/dev/sdf'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066623766656131', 'path': '/dev/sdf'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.088s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:53 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:53 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG nova.objects.instance [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Lazy-loading 'flavor' on Instance uuid 544005af-7312-4bd4-a086-7d255ca7c479 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66605ec-3689-4f27-951c-8d0376617f95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:18:53 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf10e56-5313-4bae-9f08-5ec81c149c0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6] added
Aug 17 18:18:53 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] attach device xml: <disk type="block" device="disk">
Aug 17 18:18:53 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:18:53 user nova-compute[72874]:   <source dev="/dev/sdf"/>
Aug 17 18:18:53 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:18:53 user nova-compute[72874]:   <serial>874ae2f9-95bc-4958-903e-86c3b9481bf5</serial>
Aug 17 18:18:53 user nova-compute[72874]: </disk>
Aug 17 18:18:53 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8015cf9b-06de-4c6a-ad40-74ec065ca5e5]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9d3b17-8169-4ae2-bfd5-d3f280df613e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vgdyWbXp {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vgdyWbXp" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2f6be2-b817-4854-96a4-c86915511958]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vgdyWbXp'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f4388a-9171-4138-a384-9e0ab3e8c926]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4980ba39-02ec-4736-875e-31f7d2a162a6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5352911a-09e4-40bb-81f3-5b2ec8c79c84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6, portal: 172.16.0.220,3260]
Aug 17 18:18:53 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6, portal: 172.16.0.220,3260] successful.
Aug 17 18:18:53 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02c8f21-3bbd-4516-80d3-29355e80baa3]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c93383-f7d8-4ebf-a8a9-9dd5a02e4874]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 (non-flash)
Aug 17 18:18:53 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b028d8f-7855-410f-ad1d-fac0deeca4cf]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:18:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgdyWbXp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:18:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:18:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:18:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] No VIF found with MAC fa:16:3e:18:f7:a8, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:18:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-861a9557-6c65-4c60-bae4-f5db4dd9c7a2 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Lock "544005af-7312-4bd4-a086-7d255ca7c479" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.652s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] <== connect_volume: return (2464ms) {'type': 'block', 'scsi_wwn': '26637633835353034', 'path': '/dev/sdg'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:18:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637633835353034', 'path': '/dev/sdg'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:18:54 user nova-compute[72874]: DEBUG nova.objects.instance [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lazy-loading 'flavor' on Instance uuid ef6c7125-8a47-4e3f-bb6d-b6aa5254116c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:18:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:18:54 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:18:54 user nova-compute[72874]:   <source dev="/dev/sdg"/>
Aug 17 18:18:54 user nova-compute[72874]:   <target dev="sdc" bus="scsi"/>
Aug 17 18:18:54 user nova-compute[72874]:   <serial>204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6</serial>
Aug 17 18:18:54 user nova-compute[72874]:   <address type="drive" controller="0" unit="2"/>
Aug 17 18:18:54 user nova-compute[72874]: </disk>
Aug 17 18:18:54 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:18:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] No BDM found with device name sda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:18:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:18:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:18:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] No VIF found with MAC fa:16:3e:31:0e:3b, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:18:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9b44babb-fbb5-4931-ac26-763d1ef29ffa tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] volume_snapshot_create: create_info: {'snapshot_id': '747551f7-758a-431f-ab52-1cf3454c7b52', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72874) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 17 18:18:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9b44babb-fbb5-4931-ac26-763d1ef29ffa tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] snap xml: <domainsnapshot>
Aug 17 18:18:55 user nova-compute[72874]:   <disks>
Aug 17 18:18:55 user nova-compute[72874]:     <disk name="/dev/sdf" snapshot="external" type="file">
Aug 17 18:18:55 user nova-compute[72874]:       <source file="/dev/new_file"/>
Aug 17 18:18:55 user nova-compute[72874]:     </disk>
Aug 17 18:18:55 user nova-compute[72874]:     <disk name="vda" snapshot="no"/>
Aug 17 18:18:55 user nova-compute[72874]:   </disks>
Aug 17 18:18:55 user nova-compute[72874]: </domainsnapshot>
Aug 17 18:18:55 user nova-compute[72874]:  {{(pid=72874) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 17 18:18:55 user nova-compute[72874]: DEBUG nova.objects.instance [None req-9b44babb-fbb5-4931-ac26-763d1ef29ffa tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Lazy-loading 'system_metadata' on Instance uuid 544005af-7312-4bd4-a086-7d255ca7c479 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:18:55 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-9b44babb-fbb5-4931-ac26-763d1ef29ffa tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [None req-9b44babb-fbb5-4931-ac26-763d1ef29ffa tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Traceback (most recent call last):
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     rv = execute(f, *args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     six.reraise(c, e, tb)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     raise value
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     rv = meth(*args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479] 
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [None req-9b44babb-fbb5-4931-ac26-763d1ef29ffa tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Traceback (most recent call last):
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     self._volume_snapshot_create(context, instance, guest,
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     rv = execute(f, *args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     six.reraise(c, e, tb)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     raise value
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     rv = meth(*args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479] 
Aug 17 18:18:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-69f21ff9-2494-4148-9ddc-3886f8ce92e8 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] volume_snapshot_delete: delete_info: {'volume_id': '874ae2f9-95bc-4958-903e-86c3b9481bf5'} {{(pid=72874) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [None req-69f21ff9-2494-4148-9ddc-3886f8ce92e8 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Traceback (most recent call last):
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479]     if delete_info['type'] != 'qcow2':
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479] KeyError: 'type'
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [instance: 544005af-7312-4bd4-a086-7d255ca7c479] 
Aug 17 18:18:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1f14ba84-a3e7-4903-9e43-0de2cc6c331a tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.562s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [None req-9b44babb-fbb5-4931-ac26-763d1ef29ffa tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 747551f7-758a-431f-ab52-1cf3454c7b52 could not be found.
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     raise value
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver 
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver 
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 747551f7-758a-431f-ab52-1cf3454c7b52 could not be found. (HTTP 404) (Request-ID: req-582950a0-0fb7-4826-9d66-67a87d07e78f)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver 
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver 
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 747551f7-758a-431f-ab52-1cf3454c7b52 could not be found.
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver 
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server [None req-9b44babb-fbb5-4931-ac26-763d1ef29ffa tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise value
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server 
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver [None req-69f21ff9-2494-4148-9ddc-3886f8ce92e8 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver 
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver 
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f064d613-099a-4521-857b-51c7c2e34c5e)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver 
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver 
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 18:18:55 user nova-compute[72874]: ERROR nova.virt.libvirt.driver 
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server [None req-69f21ff9-2494-4148-9ddc-3886f8ce92e8 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Exception during message handling: KeyError: 'type'
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 17 18:18:55 user nova-compute[72874]: ERROR oslo_messaging.rpc.server 
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Acquiring lock "544005af-7312-4bd4-a086-7d255ca7c479" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Lock "544005af-7312-4bd4-a086-7d255ca7c479" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:56 user nova-compute[72874]: INFO nova.compute.manager [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Detaching volume 874ae2f9-95bc-4958-903e-86c3b9481bf5
Aug 17 18:18:56 user nova-compute[72874]: INFO nova.virt.block_device [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Attempting to driver detach volume 874ae2f9-95bc-4958-903e-86c3b9481bf5 from mountpoint /dev/vdb
Aug 17 18:18:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Attempting to detach device vdb from instance 544005af-7312-4bd4-a086-7d255ca7c479 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 18:18:56 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:18:56 user nova-compute[72874]:   <source dev="/dev/sdf"/>
Aug 17 18:18:56 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:18:56 user nova-compute[72874]:   <serial>874ae2f9-95bc-4958-903e-86c3b9481bf5</serial>
Aug 17 18:18:56 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:18:56 user nova-compute[72874]: </disk>
Aug 17 18:18:56 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:18:56 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Successfully detached device vdb from instance 544005af-7312-4bd4-a086-7d255ca7c479 from the persistent domain config.
Aug 17 18:18:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 544005af-7312-4bd4-a086-7d255ca7c479 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 18:18:56 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:18:56 user nova-compute[72874]:   <source dev="/dev/sdf"/>
Aug 17 18:18:56 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:18:56 user nova-compute[72874]:   <serial>874ae2f9-95bc-4958-903e-86c3b9481bf5</serial>
Aug 17 18:18:56 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:18:56 user nova-compute[72874]: </disk>
Aug 17 18:18:56 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qpEuWBsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:18:56 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:56 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:56 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2c6fbe-f884-4322-a959-f98d1608e352]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:18:56 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d35254a-42d8-4204-b1a7-d45e84abf61b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9] added
Aug 17 18:18:56 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f579c09-2227-49c2-9237-c13903d2439e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[70111576-6018-4091-a86a-30c20b91f411]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qpEuWBsI {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qpEuWBsI" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0160d919-db7e-4530-aa28-946e1ed939fd]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qpEuWBsI'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3348d0d-9bba-428c-b8de-306a23d27313]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccd841a-f833-42fe-b270-34ff86604112]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a829d6-f44a-4fe3-8299-dd9e490e7342]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9, portal: 172.16.0.220,3260]
Aug 17 18:18:56 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9, portal: 172.16.0.220,3260] successful.
Aug 17 18:18:56 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2463faac-3e41-498a-a1fd-b3a1dc006d2d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7026a0ae-84c0-4dbb-89ea-5881d783ddd0]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 (non-flash)
Aug 17 18:18:56 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a949d2-bea7-4c9f-896d-fcf9b1b04e74]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qpEuWBsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692296336.869903, 544005af-7312-4bd4-a086-7d255ca7c479 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 544005af-7312-4bd4-a086-7d255ca7c479 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:18:56 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Successfully detached device vdb from instance 544005af-7312-4bd4-a086-7d255ca7c479 from the live domain config.
Aug 17 18:18:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FmzRKuVw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:18:56 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquiring lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:56 user nova-compute[72874]: INFO nova.compute.manager [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Detaching volume 204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6
Aug 17 18:18:57 user nova-compute[72874]: INFO nova.virt.block_device [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Attempting to driver detach volume 204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 from mountpoint /dev/sdc
Aug 17 18:18:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Attempting to detach device sdc from instance ef6c7125-8a47-4e3f-bb6d-b6aa5254116c from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:18:57 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:18:57 user nova-compute[72874]:   <source dev="/dev/sdg"/>
Aug 17 18:18:57 user nova-compute[72874]:   <target dev="sdc" bus="scsi"/>
Aug 17 18:18:57 user nova-compute[72874]:   <serial>204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6</serial>
Aug 17 18:18:57 user nova-compute[72874]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 18:18:57 user nova-compute[72874]: </disk>
Aug 17 18:18:57 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:18:57 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Successfully detached device sdc from instance ef6c7125-8a47-4e3f-bb6d-b6aa5254116c from the persistent domain config.
Aug 17 18:18:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ef6c7125-8a47-4e3f-bb6d-b6aa5254116c from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:18:57 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:18:57 user nova-compute[72874]:   <source dev="/dev/sdg"/>
Aug 17 18:18:57 user nova-compute[72874]:   <target dev="sdc" bus="scsi"/>
Aug 17 18:18:57 user nova-compute[72874]:   <serial>204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6</serial>
Aug 17 18:18:57 user nova-compute[72874]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 18:18:57 user nova-compute[72874]: </disk>
Aug 17 18:18:57 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692296337.4189289, ef6c7125-8a47-4e3f-bb6d-b6aa5254116c => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ef6c7125-8a47-4e3f-bb6d-b6aa5254116c {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:18:57 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Successfully detached device sdc from instance ef6c7125-8a47-4e3f-bb6d-b6aa5254116c from the live domain config.
Aug 17 18:18:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vgdyWbXp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:18:57 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:18:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23066623235323139', 'path': '/dev/sdh'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066623235323139', 'path': '/dev/sdh'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.967s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG nova.objects.instance [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lazy-loading 'flavor' on Instance uuid 8c2eb160-5b94-4d53-bd36-b712c62d9100 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef53c03-4a45-465f-826a-805a57d28615]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:18:57 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:18:57 user nova-compute[72874]:   <source dev="/dev/sdh"/>
Aug 17 18:18:57 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:18:57 user nova-compute[72874]:   <serial>2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9</serial>
Aug 17 18:18:57 user nova-compute[72874]: </disk>
Aug 17 18:18:57 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f53d2a8-e401-4640-bc06-c875dbc444b7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:57 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:57 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:57 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:57 user nova-compute[72874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)
Aug 17 18:18:57 user nova-compute[72874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 (non-flash)
Aug 17 18:18:57 user nova-compute[72874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 (non-flash)
Aug 17 18:18:57 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:57 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:57 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:57 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:57 user nova-compute[72874]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 (non-flash)
Aug 17 18:18:57 user nova-compute[72874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 (non-flash)
Aug 17 18:18:57 user nova-compute[72874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 (non-flash)
Aug 17 18:18:57 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c0463d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5'): ({'sdf'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Removing single pathed devices sdf {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a13c176-cac5-4c5a-b19b-ec5094d2570e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[db47a35d-643c-4745-b002-25de4be69afa]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Flushing IO for device /dev/sdf {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc44bf67-52b5-4266-8417-fff76674065f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:18:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f5bd88-4d6c-4efe-8c88-b86f52aa827f]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] SCSI volumes sdf have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c0abdf-ae97-414a-9b4d-bcac7ab3be65]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c33746e-73f7-44a8-9a92-fa234177e4af]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5, portal: 172.16.0.220,3260]
Aug 17 18:18:58 user nova-compute[72874]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5, portal: 172.16.0.220,3260] successful.
Aug 17 18:18:58 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:874ae2f9-95bc-4958-903e-86c3b9481bf5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41a3aeb-7bab-4b07-b96f-b2869e34cf67]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] <== disconnect_volume: return (1298ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.760s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bc9839-6237-4a20-9e4e-3dedb2104672]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0094c5-ce0d-4846-af9e-09056d8d4383]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:58 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:58 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:58 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:58 user nova-compute[72874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 (non-flash)
Aug 17 18:18:58 user nova-compute[72874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 (non-flash)
Aug 17 18:18:58 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:18:58 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:18:58 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:18:58 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:18:58 user nova-compute[72874]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 (non-flash)
Aug 17 18:18:58 user nova-compute[72874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 (non-flash)
Aug 17 18:18:58 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6ef3b7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6'): ({'sdg'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Removing single pathed devices sdg {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec3772f-5a39-4844-89fa-07f72551a46a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4d8ed9-fddc-4740-a209-50b379fe108e]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Flushing IO for device /dev/sdg {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] No VIF found with MAC fa:16:3e:a7:7a:4b, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6417b14-bb16-45e2-b02e-e370f3320947]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[82718d1f-8f4f-4f5b-b4cb-3305138eef2f]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] SCSI volumes sdg have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc2da69-035b-4a65-8e0c-36f853d1a260]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6292f257-99b2-4505-bb67-65974e041b5c]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6, portal: 172.16.0.220,3260]
Aug 17 18:18:58 user nova-compute[72874]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6, portal: 172.16.0.220,3260] successful.
Aug 17 18:18:58 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ca1a4cb3-d92b-4c54-95ce-90d55ee9bdd1 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.089s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:204f2a8c-b67e-42e8-a8f2-f5d7c7d25bc6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07c7493-3d71-4d74-90db-d9a487ff37b3]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] <== disconnect_volume: return (1067ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:18:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:59 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Lazy-loading 'flavor' on Instance uuid 544005af-7312-4bd4-a086-7d255ca7c479 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:18:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e33c1b35-0ff8-4201-ab41-68f9c85c5973 tempest-VolumesAssistedSnapshotsTest-1621158434 tempest-VolumesAssistedSnapshotsTest-1621158434-project-admin] Lock "544005af-7312-4bd4-a086-7d255ca7c479" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.014s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:59 user nova-compute[72874]: DEBUG nova.objects.instance [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lazy-loading 'flavor' on Instance uuid ef6c7125-8a47-4e3f-bb6d-b6aa5254116c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:18:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8cd0be35-1a70-428d-8fbb-801dfff586c7 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.493s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:18:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:18:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:18:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:18:59 user nova-compute[72874]: INFO nova.compute.manager [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Detaching volume 2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9
Aug 17 18:19:00 user nova-compute[72874]: INFO nova.virt.block_device [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Attempting to driver detach volume 2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 from mountpoint /dev/vdb
Aug 17 18:19:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Attempting to detach device vdb from instance 8c2eb160-5b94-4d53-bd36-b712c62d9100 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:19:00 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:19:00 user nova-compute[72874]:   <source dev="/dev/sdh"/>
Aug 17 18:19:00 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:19:00 user nova-compute[72874]:   <serial>2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9</serial>
Aug 17 18:19:00 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:19:00 user nova-compute[72874]: </disk>
Aug 17 18:19:00 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:19:00 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Successfully detached device vdb from instance 8c2eb160-5b94-4d53-bd36-b712c62d9100 from the persistent domain config.
Aug 17 18:19:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8c2eb160-5b94-4d53-bd36-b712c62d9100 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:19:00 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:19:00 user nova-compute[72874]:   <source dev="/dev/sdh"/>
Aug 17 18:19:00 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:19:00 user nova-compute[72874]:   <serial>2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9</serial>
Aug 17 18:19:00 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:19:00 user nova-compute[72874]: </disk>
Aug 17 18:19:00 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692296340.488808, 8c2eb160-5b94-4d53-bd36-b712c62d9100 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8c2eb160-5b94-4d53-bd36-b712c62d9100 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:19:00 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Successfully detached device vdb from instance 8c2eb160-5b94-4d53-bd36-b712c62d9100 from the live domain config.
Aug 17 18:19:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qpEuWBsI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:19:00 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a4740b-a379-4abf-825d-fe2720649807]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-d92f766f-c71a-4faf-a1dc-2838d960b8ae req-23e50cf4-9ea2-4b2a-8ad6-2c319dfaaf65 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received event network-changed-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-d92f766f-c71a-4faf-a1dc-2838d960b8ae req-23e50cf4-9ea2-4b2a-8ad6-2c319dfaaf65 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Refreshing instance network info cache due to event network-changed-82fadf6c-c99c-4db9-8f9c-f05d33415d5c. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d92f766f-c71a-4faf-a1dc-2838d960b8ae req-23e50cf4-9ea2-4b2a-8ad6-2c319dfaaf65 service nova] Acquiring lock "refresh_cache-7c486f7d-bcad-4c83-98bf-f08559259d33" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d92f766f-c71a-4faf-a1dc-2838d960b8ae req-23e50cf4-9ea2-4b2a-8ad6-2c319dfaaf65 service nova] Acquired lock "refresh_cache-7c486f7d-bcad-4c83-98bf-f08559259d33" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG nova.network.neutron [req-d92f766f-c71a-4faf-a1dc-2838d960b8ae req-23e50cf4-9ea2-4b2a-8ad6-2c319dfaaf65 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Refreshing network info cache for port 82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b9faec-9c74-4bcc-a9fb-cbfc4b7cd336]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:00 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:00 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:00 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:00 user nova-compute[72874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 (non-flash)
Aug 17 18:19:00 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:00 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:00 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:00 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:00 user nova-compute[72874]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 (non-flash)
Aug 17 18:19:00 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a074c4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9'): ({'sdh'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Removing single pathed devices sdh {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff7cee1-32c9-446c-be4b-a702d8a3be52]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[429556d2-c90a-432b-a900-d5b202c8d901]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Flushing IO for device /dev/sdh {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c766e07-3f41-4a60-8d81-9828b08480af]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquiring lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquiring lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:00 user nova-compute[72874]: INFO nova.compute.manager [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Terminating instance
Aug 17 18:19:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b936a3e-5fde-4972-8ec5-117ef153ffcb]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] SCSI volumes sdh have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f6174e-9d32-4c96-b1f4-4e2627a38735]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.107s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc3b347-eed9-4aaf-9d47-a0acd500cf5f]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9, portal: 172.16.0.220,3260]
Aug 17 18:19:00 user nova-compute[72874]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9, portal: 172.16.0.220,3260] successful.
Aug 17 18:19:00 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fd3c1de-0cea-4c77-bcc9-4e2859e7e1b9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1aa7a79-82bc-4511-8cd3-b0ff567dae19]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] <== disconnect_volume: return (389ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:19:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-945520ac-2937-4deb-a2f7-6038d6722b8e req-4314a65d-7a6f-47bc-ab1f-4beb9c7381df service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Received event network-vif-unplugged-a5c80e92-7939-4713-bace-452403c97c47 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-945520ac-2937-4deb-a2f7-6038d6722b8e req-4314a65d-7a6f-47bc-ab1f-4beb9c7381df service nova] Acquiring lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-945520ac-2937-4deb-a2f7-6038d6722b8e req-4314a65d-7a6f-47bc-ab1f-4beb9c7381df service nova] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-945520ac-2937-4deb-a2f7-6038d6722b8e req-4314a65d-7a6f-47bc-ab1f-4beb9c7381df service nova] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-945520ac-2937-4deb-a2f7-6038d6722b8e req-4314a65d-7a6f-47bc-ab1f-4beb9c7381df service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] No waiting events found dispatching network-vif-unplugged-a5c80e92-7939-4713-bace-452403c97c47 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-945520ac-2937-4deb-a2f7-6038d6722b8e req-4314a65d-7a6f-47bc-ab1f-4beb9c7381df service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Received event network-vif-unplugged-a5c80e92-7939-4713-bace-452403c97c47 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.network.neutron [req-d92f766f-c71a-4faf-a1dc-2838d960b8ae req-23e50cf4-9ea2-4b2a-8ad6-2c319dfaaf65 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Updated VIF entry in instance network info cache for port 82fadf6c-c99c-4db9-8f9c-f05d33415d5c. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.network.neutron [req-d92f766f-c71a-4faf-a1dc-2838d960b8ae req-23e50cf4-9ea2-4b2a-8ad6-2c319dfaaf65 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Updating instance_info_cache with network_info: [{"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d92f766f-c71a-4faf-a1dc-2838d960b8ae req-23e50cf4-9ea2-4b2a-8ad6-2c319dfaaf65 service nova] Releasing lock "refresh_cache-7c486f7d-bcad-4c83-98bf-f08559259d33" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:19:01 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Instance destroyed successfully.
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.objects.instance [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lazy-loading 'resources' on Instance uuid ef6c7125-8a47-4e3f-bb6d-b6aa5254116c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1307787176',display_name='tempest-AttachSCSIVolumeTestJSON-server-1307787176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1307787176',id=5,image_ref='af8b3b0f-e5f5-4fed-8032-bd71520911ba',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgq8m1UMVqSQ1fdxo15VBhjBk7eD8qG2VAUCa4AdbjeWQN9WeG7dxfld44gY4zGetKe/GumwEmjXguF6hFQ0OdSaJ5CB4c4/ZOpvejTyynV/WVt/7mvMIZbc3ebM08egA==',key_name='tempest-keypair-989698209',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:17:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='817d1715984649a68c2ef734ba21feeb',ramdisk_id='',reservation_id='r-yiz3swib',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='af8b3b0f-e5f5-4fed-8032-bd71520911ba',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-7029085',owner_user_name='tempest-AttachSCSIVolumeTestJSON-7029085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77a438e1dcd042359928a363076698c2',uuid=ef6c7125-8a47-4e3f-bb6d-b6aa5254116c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5c80e92-7939-4713-bace-452403c97c47", "address": "fa:16:3e:31:0e:3b", "network": {"id": "245fda49-a954-49cd-a901-d91753fa07f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-715260708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "817d1715984649a68c2ef734ba21feeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c80e92-79", "ovs_interfaceid": "a5c80e92-7939-4713-bace-452403c97c47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Converting VIF {"id": "a5c80e92-7939-4713-bace-452403c97c47", "address": "fa:16:3e:31:0e:3b", "network": {"id": "245fda49-a954-49cd-a901-d91753fa07f7", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-715260708-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "817d1715984649a68c2ef734ba21feeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5c80e92-79", "ovs_interfaceid": "a5c80e92-7939-4713-bace-452403c97c47", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=a5c80e92-7939-4713-bace-452403c97c47,network=Network(245fda49-a954-49cd-a901-d91753fa07f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c80e92-79') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG os_vif [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=a5c80e92-7939-4713-bace-452403c97c47,network=Network(245fda49-a954-49cd-a901-d91753fa07f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c80e92-79') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5c80e92-79, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:19:01 user nova-compute[72874]: INFO os_vif [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:0e:3b,bridge_name='br-int',has_traffic_filtering=True,id=a5c80e92-7939-4713-bace-452403c97c47,network=Network(245fda49-a954-49cd-a901-d91753fa07f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5c80e92-79')
Aug 17 18:19:01 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Deleting instance files /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c_del
Aug 17 18:19:01 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Deletion of /opt/stack/data/nova/instances/ef6c7125-8a47-4e3f-bb6d-b6aa5254116c_del complete
Aug 17 18:19:01 user nova-compute[72874]: INFO nova.compute.manager [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 18:19:01 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:19:01 user nova-compute[72874]: INFO nova.compute.manager [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Rebuilding instance
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7c486f7d-bcad-4c83-98bf-f08559259d33 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.objects.instance [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lazy-loading 'flavor' on Instance uuid 8c2eb160-5b94-4d53-bd36-b712c62d9100 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-c5ccbc68-769b-457e-a238-2857130e28e7 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.967s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lazy-loading 'pci_requests' on Instance uuid 7c486f7d-bcad-4c83-98bf-f08559259d33 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c486f7d-bcad-4c83-98bf-f08559259d33 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lazy-loading 'resources' on Instance uuid 7c486f7d-bcad-4c83-98bf-f08559259d33 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:01 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lazy-loading 'migration_context' on Instance uuid 7c486f7d-bcad-4c83-98bf-f08559259d33 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72874) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:19:02 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Took 1.16 seconds to deallocate network for instance.
Aug 17 18:19:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-a91e4886-1831-490e-a658-568a01c62525 req-5b3b12d0-b575-467b-bee8-2ce1f4817abf service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Received event network-vif-deleted-a5c80e92-7939-4713-bace-452403c97c47 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:02 user nova-compute[72874]: INFO nova.compute.manager [req-a91e4886-1831-490e-a658-568a01c62525 req-5b3b12d0-b575-467b-bee8-2ce1f4817abf service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Neutron deleted interface a5c80e92-7939-4713-bace-452403c97c47; detaching it from the instance and deleting it from the info cache
Aug 17 18:19:02 user nova-compute[72874]: DEBUG nova.network.neutron [req-a91e4886-1831-490e-a658-568a01c62525 req-5b3b12d0-b575-467b-bee8-2ce1f4817abf service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-a91e4886-1831-490e-a658-568a01c62525 req-5b3b12d0-b575-467b-bee8-2ce1f4817abf service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Detach interface failed, port_id=a5c80e92-7939-4713-bace-452403c97c47, reason: Instance ef6c7125-8a47-4e3f-bb6d-b6aa5254116c could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:19:02 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Instance destroyed successfully.
Aug 17 18:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:02 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Instance destroyed successfully.
Aug 17 18:19:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1675062005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2121101201',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHO7rkeC9pzXuKB0SzBYgruoGhDzERqiJUXWtIfbrLLf7ig2/MHev5D+kN1SaVM8QqD4bJCvdEFBeAQxW3jsr31paoEijftB74Jxx/L7jR166vAUYf/FeWQK16Y3ojsdFg==',key_name='tempest-keypair-809304444',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:17:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0ce530e304a47e49163e5e16a07af5a',ramdisk_id='',reservation_id='r-9lpxt6gu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-423641309',owner_user_name='tempest-ServerActionsV293TestJSON-423641309-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:19:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb6178a9238a4c6ca4f80eea57962534',uuid=7c486f7d-bcad-4c83-98bf-f08559259d33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Converting VIF {"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:12:45,bridge_name='br-int',has_traffic_filtering=True,id=82fadf6c-c99c-4db9-8f9c-f05d33415d5c,network=Network(cce89dc3-ea6a-4e83-94a1-6bc08392b565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82fadf6c-c9') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG os_vif [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:12:45,bridge_name='br-int',has_traffic_filtering=True,id=82fadf6c-c99c-4db9-8f9c-f05d33415d5c,network=Network(cce89dc3-ea6a-4e83-94a1-6bc08392b565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82fadf6c-c9') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82fadf6c-c9, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:19:02 user nova-compute[72874]: INFO os_vif [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:12:45,bridge_name='br-int',has_traffic_filtering=True,id=82fadf6c-c99c-4db9-8f9c-f05d33415d5c,network=Network(cce89dc3-ea6a-4e83-94a1-6bc08392b565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82fadf6c-c9')
Aug 17 18:19:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sakPJxrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:19:02 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 18:19:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d721250-e83b-426d-b61e-242171c2c7e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62c0955-d87b-4dac-9cae-4b4286a632d2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:02 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:02 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:02 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:02 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:02 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:02 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:02 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:02 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c076eb90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[580a2eb8-9042-4895-b53b-561996024211]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7133e7-5403-454b-b1f7-8ede34cecf78]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[287d2441-3472-4b3b-bd88-80f31e51aac6]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e34a020-8b21-4896-8c3d-8db9ad04c255]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[622883ac-ebfd-4ba3-813b-d92925f6fa3b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[461e92a2-6dc2-4572-96fc-19d71e28d7e2]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Received event network-vif-plugged-a5c80e92-7939-4713-bace-452403c97c47 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] Acquiring lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] No waiting events found dispatching network-vif-plugged-a5c80e92-7939-4713-bace-452403c97c47 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:03 user nova-compute[72874]: WARNING nova.compute.manager [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Received unexpected event network-vif-plugged-a5c80e92-7939-4713-bace-452403c97c47 for instance with vm_state deleted and task_state None.
Aug 17 18:19:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received event network-vif-unplugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] Acquiring lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] No waiting events found dispatching network-vif-unplugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:03 user nova-compute[72874]: WARNING nova.compute.manager [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received unexpected event network-vif-unplugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c for instance with vm_state active and task_state rebuilding.
Aug 17 18:19:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received event network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] Acquiring lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] No waiting events found dispatching network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:03 user nova-compute[72874]: WARNING nova.compute.manager [req-d536e5e9-6ecd-4522-ae50-018860580369 req-757fda58-f370-4106-89af-6bdedccd4e07 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received unexpected event network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c for instance with vm_state active and task_state rebuilding.
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5, portal: 172.16.0.220,3260]
Aug 17 18:19:03 user nova-compute[72874]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5, portal: 172.16.0.220,3260] successful.
Aug 17 18:19:03 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:03 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Deleted allocations for instance ef6c7125-8a47-4e3f-bb6d-b6aa5254116c
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e14e297-3d78-4540-a306-b41620bf3f4b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] <== disconnect_volume: return (364ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:19:03 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Deleting instance files /opt/stack/data/nova/instances/7c486f7d-bcad-4c83-98bf-f08559259d33_del
Aug 17 18:19:03 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Deletion of /opt/stack/data/nova/instances/7c486f7d-bcad-4c83-98bf-f08559259d33_del complete
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-362c95b5-6077-4bbd-9c14-ca19c1001195 tempest-AttachSCSIVolumeTestJSON-7029085 tempest-AttachSCSIVolumeTestJSON-7029085-project-member] Lock "ef6c7125-8a47-4e3f-bb6d-b6aa5254116c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.643s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:03 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 7c486f7d-bcad-4c83-98bf-f08559259d33 could not be found.
Aug 17 18:19:03 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sakPJxrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:19:03 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fbfd8f-d238-4bbe-a374-1a57a8e7630f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[569fa8f9-d755-43ef-a3e1-49a22b7c5a17]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:03 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:03 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:03 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:03 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:03 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:03 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6ef2e9510>, {}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Disconnecting from: [] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] <== disconnect_volume: return (52ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:19:03 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:19:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Preparing to wait for external event volume-reimaged-44d2d09e-f58b-4287-a79b-73f2c406e0a5 {{(pid=72874) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 17 18:19:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMRIGCEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:19:05 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:05 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:05 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7289051-8c12-46bb-803b-ef61664f92ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:19:05 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c605e9-096d-4d10-a74c-5e4da60160fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f] added
Aug 17 18:19:05 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce81bdd3-25cd-4816-9acd-2916f2cb39b0]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2746b19c-2bfc-4771-9ec2-e9714cf40f77]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OMRIGCEz {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OMRIGCEz" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34fdc04-0d08-4f3c-bbbf-4cb5cb29313a]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OMRIGCEz'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0426f4-7b2b-4447-a8f8-e534560d2fed]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e058d2-b71d-446c-9eef-1675d23f9da3]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:05 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:05 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:05 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:05 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:05 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:05 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb131da3-5014-4d96-98e7-2870eedc3db0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f, portal: 172.16.0.220,3260]
Aug 17 18:19:05 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f, portal: 172.16.0.220,3260] successful.
Aug 17 18:19:05 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c8e856-e0af-4e82-a595-a1910c14cc1b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9affe7-33f7-4aa5-897d-57028b08d102]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)
Aug 17 18:19:05 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:05 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:05 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:05 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)
Aug 17 18:19:05 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:05 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:05 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:05 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ce6fce-8cbd-446f-b5de-0eaee2c34882]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:19:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMRIGCEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:19:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23138626531613830', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:19:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138626531613830', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:19:06 user nova-compute[72874]: DEBUG nova.objects.instance [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lazy-loading 'flavor' on Instance uuid 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:19:06 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:19:06 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 18:19:06 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:19:06 user nova-compute[72874]:   <serial>a5eb0e71-cb94-4635-b215-5e25162a001f</serial>
Aug 17 18:19:06 user nova-compute[72874]: </disk>
Aug 17 18:19:06 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:19:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:19:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:19:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] No VIF found with MAC fa:16:3e:87:05:5f, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:19:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-70b34493-4f3c-488e-930d-148f27e458f9 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.661s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Acquiring lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG os_brick.utils [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec4398e-6731-46d6-bbc2-763ed3cfb115]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e837e43d-4dcd-4271-aad7-3023a05861ab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8b70b4-f896-40fd-b9a5-f4d4668e7251]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d0af3d-45fc-4864-9ee3-40ece2189aff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:19:08 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:19:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ffc17e9-191c-4140-ac4f-9671f98da890]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:19:08 user nova-compute[72874]: DEBUG os_brick.utils [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:19:08 user nova-compute[72874]: INFO nova.compute.manager [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Swapping volume a5eb0e71-cb94-4635-b215-5e25162a001f for a2169187-af77-42aa-aa8f-2581cd87c3c9
Aug 17 18:19:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:19:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:10 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:19:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:19:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:19:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:19:10 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updating instance_info_cache with network_info: [{"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:13 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:19:13 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:19:13 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:19:13 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:19:14 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:19:14 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:19:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7457MB free_disk=25.600460052490234GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance f027045c-d121-45ec-af61-e1a2399c4a43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c2eb160-5b94-4d53-bd36-b712c62d9100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 544005af-7312-4bd4-a086-7d255ca7c479 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 7c486f7d-bcad-4c83-98bf-f08559259d33 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2b854f0d-7305-41d5-8188-12ae9050e213 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 147a0117-749d-4aff-8a4d-9ea91238278b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:15 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:19:15 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:19:15 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:19:15 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:19:15 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:19:16 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296341.4764667, ef6c7125-8a47-4e3f-bb6d-b6aa5254116c => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:19:16 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] VM Stopped (Lifecycle Event)
Aug 17 18:19:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ffb8baa2-d7f4-465d-bbfd-f3a2982d1df0 None None] [instance: ef6c7125-8a47-4e3f-bb6d-b6aa5254116c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:19:17 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296342.8042922, 7c486f7d-bcad-4c83-98bf-f08559259d33 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:19:17 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] VM Stopped (Lifecycle Event)
Aug 17 18:19:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-55070afe-489f-4f1d-ad6a-efb719ef2199 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:19:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG nova.compute.manager [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWBtuXYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2169187-af77-42aa-aa8f-2581cd87c3c9', 'serial': 'a2169187-af77-42aa-aa8f-2581cd87c3c9'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMRIGCEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5eb0e71-cb94-4635-b215-5e25162a001f', 'serial'} {{(pid=72874) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWBtuXYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:19:20 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:20 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:20 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2bce19-fcb9-416d-8993-8a368dc1bb6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:19:20 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f29197f-8a48-4606-8b2f-53a16aae9cac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9] added
Aug 17 18:19:20 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd4dca0-5d19-44a6-bebd-52a2219596c0]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9fb3bb-4dfc-41ea-b52a-3f5419c2dbe4]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWBtuXYK {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWBtuXYK" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7009fa54-d921-4d72-9fca-22053add0d78]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IWBtuXYK'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[94dfa58e-9511-4207-9a8c-57efebda8b1e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04b4168-3b19-449c-a22e-d2ec79de69c2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:20 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:20 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94490e0-4441-46da-a3a2-aa5d76ce2d56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9, portal: 172.16.0.220,3260]
Aug 17 18:19:20 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9, portal: 172.16.0.220,3260] successful.
Aug 17 18:19:20 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[caef8e74-2ba4-45d5-bcd1-4d691340ff7c]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c3771c-523b-4a4b-8c1d-050403b4e67c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:20 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:20 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:20 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] HCTL ('38', '-', '-', 0) found on session 12 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d943bb0b-5a59-4bef-a612-6498778804f8]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:20 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:19:21 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Searching for a device in session 12 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:19:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWBtuXYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:19:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23564383634366537', 'path': '/dev/sdg'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:19:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564383634366537', 'path': '/dev/sdg'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:19:21 user nova-compute[72874]: DEBUG nova.objects.instance [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lazy-loading 'flavor' on Instance uuid 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 16777216 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 105906176 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 253755392 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 435159040 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-e9925591-c9dd-46b1-aeaa-b662645ffbfb req-e8300049-69b5-4c30-b54c-c9b5cd87b9ae service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received event volume-reimaged-44d2d09e-f58b-4287-a79b-73f2c406e0a5 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e9925591-c9dd-46b1-aeaa-b662645ffbfb req-e8300049-69b5-4c30-b54c-c9b5cd87b9ae service nova] Acquiring lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e9925591-c9dd-46b1-aeaa-b662645ffbfb req-e8300049-69b5-4c30-b54c-c9b5cd87b9ae service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e9925591-c9dd-46b1-aeaa-b662645ffbfb req-e8300049-69b5-4c30-b54c-c9b5cd87b9ae service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-e9925591-c9dd-46b1-aeaa-b662645ffbfb req-e8300049-69b5-4c30-b54c-c9b5cd87b9ae service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Processing event volume-reimaged-44d2d09e-f58b-4287-a79b-73f2c406e0a5 {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Instance event wait completed in 20 seconds for volume-reimaged {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:19:25 user nova-compute[72874]: INFO nova.virt.block_device [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Booting with volume 44d2d09e-f58b-4287-a79b-73f2c406e0a5 at /dev/vda
Aug 17 18:19:25 user nova-compute[72874]: DEBUG os_brick.utils [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0452cbc-bc25-4c5f-8843-6115777daeeb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44fc43a-c552-4496-8c80-85cc6ca900e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.035s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2642f8f-ae7c-424b-a6ae-9b263f73f768]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7311d18e-8859-454d-a0f4-97acb24723f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 576716800 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:19:25 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:19:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[382e97df-a5b6-440e-8a5f-b6a4aec52999]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG os_brick.utils [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:19:25 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Updating existing volume attachment record: f7acf413-3c66-40d1-96b2-c6bf97d9ab66 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:19:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 696254464 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 843055104 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 1005584384 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMRIGCEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:19:27 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:19:27 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[32568056-da30-4a3e-bcc8-4619d5e95839]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[631a7dd4-f55e-4bc1-98b1-6fdb3e6a1699]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)
Aug 17 18:19:27 user nova-compute[72874]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:27 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:27 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:27 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:27 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)
Aug 17 18:19:27 user nova-compute[72874]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:27 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:27 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:27 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:27 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c0461fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e61e3c-a0c8-4149-aacb-f1b7c1cda849]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[589468d1-3667-4a0a-ba25-1c229cc4ed7e]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6226c2-88aa-4c50-82b0-d6637845e064]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccafb63c-4aeb-498f-90af-bdf1a9dd7d91]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed013e2c-371c-444b-972f-f0ebb920c497]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6ac083-2749-4729-9351-fe8453a32dd0]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f, portal: 172.16.0.220,3260]
Aug 17 18:19:28 user nova-compute[72874]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f, portal: 172.16.0.220,3260] successful.
Aug 17 18:19:28 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd7876d-30b5-46af-b9ca-e70d490dfb7c]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] <== disconnect_volume: return (303ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:19:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:19:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWBtuXYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2169187-af77-42aa-aa8f-2581cd87c3c9', 'serial'} {{(pid=72874) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 17 18:19:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] swap_volume: removing Cinder connection for volume a5eb0e71-cb94-4635-b215-5e25162a001f {{(pid=72874) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 17 18:19:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] swap_volume: Updating volume a5eb0e71-cb94-4635-b215-5e25162a001f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "IWBtuXYK", "auth_password": "YzHujCAQVg274T", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdg", "volume_id": "a2169187-af77-42aa-aa8f-2581cd87c3c9"}, "status": "reserved", "instance": "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83", "attached_at": "", "detached_at": "", "volume_id": "a2169187-af77-42aa-aa8f-2581cd87c3c9", "serial": "a2169187-af77-42aa-aa8f-2581cd87c3c9"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a2169187-af77-42aa-aa8f-2581cd87c3c9', 'no_device': None, 'attachment_id': '1a43f5e3-9ea5-4693-8c4f-f3da2c4fe103'} {{(pid=72874) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 17 18:19:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-674a3ea3-6f1a-4968-97ad-126fd84b03c1 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.720s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Acquiring lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.003s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG os_brick.utils [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b8ece9-1a18-49dc-9bbd-2dc260ae4d92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80d7fdd-25b6-4144-89a3-a989634300f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0d981e-a580-4054-b31a-e3d932d6b306]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fcf5ad-ec46-47b1-aed8-238d82b16311]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:19:30 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:19:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaeb3473-ea7e-4327-856f-755d7dcaa732]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:19:30 user nova-compute[72874]: DEBUG os_brick.utils [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:19:30 user nova-compute[72874]: INFO nova.compute.manager [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Swapping volume a2169187-af77-42aa-aa8f-2581cd87c3c9 for a5eb0e71-cb94-4635-b215-5e25162a001f
Aug 17 18:19:32 user nova-compute[72874]: DEBUG nova.compute.manager [req-08d16568-7432-4a03-a469-bc5a516fa087 req-b258aade-415f-4be4-bd55-55862d4a7283 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-changed-3d6f0247-0483-4fad-9551-30b7ea4933cd {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:32 user nova-compute[72874]: DEBUG nova.compute.manager [req-08d16568-7432-4a03-a469-bc5a516fa087 req-b258aade-415f-4be4-bd55-55862d4a7283 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Refreshing instance network info cache due to event network-changed-3d6f0247-0483-4fad-9551-30b7ea4933cd. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:19:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-08d16568-7432-4a03-a469-bc5a516fa087 req-b258aade-415f-4be4-bd55-55862d4a7283 service nova] Acquiring lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:19:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-08d16568-7432-4a03-a469-bc5a516fa087 req-b258aade-415f-4be4-bd55-55862d4a7283 service nova] Acquired lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:19:32 user nova-compute[72874]: DEBUG nova.network.neutron [req-08d16568-7432-4a03-a469-bc5a516fa087 req-b258aade-415f-4be4-bd55-55862d4a7283 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Refreshing network info cache for port 3d6f0247-0483-4fad-9551-30b7ea4933cd {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:19:32 user nova-compute[72874]: DEBUG nova.network.neutron [req-08d16568-7432-4a03-a469-bc5a516fa087 req-b258aade-415f-4be4-bd55-55862d4a7283 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Updated VIF entry in instance network info cache for port 3d6f0247-0483-4fad-9551-30b7ea4933cd. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:19:32 user nova-compute[72874]: DEBUG nova.network.neutron [req-08d16568-7432-4a03-a469-bc5a516fa087 req-b258aade-415f-4be4-bd55-55862d4a7283 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Updating instance_info_cache with network_info: [{"id": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "address": "fa:16:3e:1f:e4:9d", "network": {"id": "2a24259a-abcc-4676-b0ac-5421ac2a6885", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1205067213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6f0247-04", "ovs_interfaceid": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "address": "fa:16:3e:d0:31:5f", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65a4e99-e0", "ovs_interfaceid": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "address": "fa:16:3e:46:71:d4", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e811baf-1a", "ovs_interfaceid": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "350d5856-a681-4266-b9c0-670a99cbd2a2", "address": "fa:16:3e:82:93:6c", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350d5856-a6", "ovs_interfaceid": "350d5856-a681-4266-b9c0-670a99cbd2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "address": "fa:16:3e:3c:28:8e", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447fb91-c7", "ovs_interfaceid": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "address": "fa:16:3e:cc:81:9c", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed88fc4-fc", "ovs_interfaceid": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4ef743f-f417-446a-adcd-10b699018f21", "address": "fa:16:3e:c3:d8:a8", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ef743f-f4", "ovs_interfaceid": "e4ef743f-f417-446a-adcd-10b699018f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:19:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-08d16568-7432-4a03-a469-bc5a516fa087 req-b258aade-415f-4be4-bd55-55862d4a7283 service nova] Releasing lock "refresh_cache-147a0117-749d-4aff-8a4d-9ea91238278b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:19:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Acquiring lock "2b854f0d-7305-41d5-8188-12ae9050e213" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lock "2b854f0d-7305-41d5-8188-12ae9050e213" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Acquiring lock "2b854f0d-7305-41d5-8188-12ae9050e213-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lock "2b854f0d-7305-41d5-8188-12ae9050e213-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lock "2b854f0d-7305-41d5-8188-12ae9050e213-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:34 user nova-compute[72874]: INFO nova.compute.manager [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Terminating instance
Aug 17 18:19:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "147a0117-749d-4aff-8a4d-9ea91238278b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:34 user nova-compute[72874]: INFO nova.compute.manager [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Terminating instance
Aug 17 18:19:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-0478de8a-9303-4d47-ac4c-e16fee25cd5a req-9dbc468f-9188-45dd-a9a3-b5c7a768e32f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-unplugged-3d6f0247-0483-4fad-9551-30b7ea4933cd {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0478de8a-9303-4d47-ac4c-e16fee25cd5a req-9dbc468f-9188-45dd-a9a3-b5c7a768e32f service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0478de8a-9303-4d47-ac4c-e16fee25cd5a req-9dbc468f-9188-45dd-a9a3-b5c7a768e32f service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0478de8a-9303-4d47-ac4c-e16fee25cd5a req-9dbc468f-9188-45dd-a9a3-b5c7a768e32f service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-0478de8a-9303-4d47-ac4c-e16fee25cd5a req-9dbc468f-9188-45dd-a9a3-b5c7a768e32f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-unplugged-3d6f0247-0483-4fad-9551-30b7ea4933cd {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-0478de8a-9303-4d47-ac4c-e16fee25cd5a req-9dbc468f-9188-45dd-a9a3-b5c7a768e32f service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-unplugged-3d6f0247-0483-4fad-9551-30b7ea4933cd for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-d0bc3c2d-96c3-4630-8d07-72bb29624960 req-15a84d00-5b0e-4888-a534-c166bb70d203 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-unplugged-350d5856-a681-4266-b9c0-670a99cbd2a2 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d0bc3c2d-96c3-4630-8d07-72bb29624960 req-15a84d00-5b0e-4888-a534-c166bb70d203 service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d0bc3c2d-96c3-4630-8d07-72bb29624960 req-15a84d00-5b0e-4888-a534-c166bb70d203 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d0bc3c2d-96c3-4630-8d07-72bb29624960 req-15a84d00-5b0e-4888-a534-c166bb70d203 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-d0bc3c2d-96c3-4630-8d07-72bb29624960 req-15a84d00-5b0e-4888-a534-c166bb70d203 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-unplugged-350d5856-a681-4266-b9c0-670a99cbd2a2 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-d0bc3c2d-96c3-4630-8d07-72bb29624960 req-15a84d00-5b0e-4888-a534-c166bb70d203 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-unplugged-350d5856-a681-4266-b9c0-670a99cbd2a2 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:19:35 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Instance destroyed successfully.
Aug 17 18:19:35 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lazy-loading 'resources' on Instance uuid 2b854f0d-7305-41d5-8188-12ae9050e213 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:17:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2111298094',display_name='tempest-VolumesActionsTest-instance-2111298094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2111298094',id=10,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:17:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ebc374d01934c2980c5765ee2e4ba73',ramdisk_id='',reservation_id='r-k3yrz9cx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-507325747',owner_user_name='tempest-VolumesActionsTest-507325747-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:17:39Z,user_data=None,user_id='5a612b21f8664e16901b38f3ba875604',uuid=2b854f0d-7305-41d5-8188-12ae9050e213,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f985466-eea4-4ddd-b005-4f3533dff86b", "address": "fa:16:3e:c4:73:fb", "network": {"id": "1d7ab6e9-a793-455f-9932-8a7dbec20dcb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861987999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebc374d01934c2980c5765ee2e4ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f985466-ee", "ovs_interfaceid": "8f985466-eea4-4ddd-b005-4f3533dff86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Converting VIF {"id": "8f985466-eea4-4ddd-b005-4f3533dff86b", "address": "fa:16:3e:c4:73:fb", "network": {"id": "1d7ab6e9-a793-455f-9932-8a7dbec20dcb", "bridge": "br-int", "label": "tempest-VolumesActionsTest-861987999-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ebc374d01934c2980c5765ee2e4ba73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f985466-ee", "ovs_interfaceid": "8f985466-eea4-4ddd-b005-4f3533dff86b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:73:fb,bridge_name='br-int',has_traffic_filtering=True,id=8f985466-eea4-4ddd-b005-4f3533dff86b,network=Network(1d7ab6e9-a793-455f-9932-8a7dbec20dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f985466-ee') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG os_vif [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:73:fb,bridge_name='br-int',has_traffic_filtering=True,id=8f985466-eea4-4ddd-b005-4f3533dff86b,network=Network(1d7ab6e9-a793-455f-9932-8a7dbec20dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f985466-ee') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f985466-ee, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:35 user nova-compute[72874]: INFO os_vif [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:73:fb,bridge_name='br-int',has_traffic_filtering=True,id=8f985466-eea4-4ddd-b005-4f3533dff86b,network=Network(1d7ab6e9-a793-455f-9932-8a7dbec20dcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f985466-ee')
Aug 17 18:19:35 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Deleting instance files /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213_del
Aug 17 18:19:35 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Deletion of /opt/stack/data/nova/instances/2b854f0d-7305-41d5-8188-12ae9050e213_del complete
Aug 17 18:19:35 user nova-compute[72874]: INFO nova.compute.manager [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Took 1.28 seconds to destroy the instance on the hypervisor.
Aug 17 18:19:35 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:19:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-cf7b0371-4293-44f1-a370-618d332bd433 req-3d13afea-6729-4d92-9e1c-f0c1154c8f58 service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Received event network-vif-unplugged-8f985466-eea4-4ddd-b005-4f3533dff86b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cf7b0371-4293-44f1-a370-618d332bd433 req-3d13afea-6729-4d92-9e1c-f0c1154c8f58 service nova] Acquiring lock "2b854f0d-7305-41d5-8188-12ae9050e213-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cf7b0371-4293-44f1-a370-618d332bd433 req-3d13afea-6729-4d92-9e1c-f0c1154c8f58 service nova] Lock "2b854f0d-7305-41d5-8188-12ae9050e213-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cf7b0371-4293-44f1-a370-618d332bd433 req-3d13afea-6729-4d92-9e1c-f0c1154c8f58 service nova] Lock "2b854f0d-7305-41d5-8188-12ae9050e213-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-cf7b0371-4293-44f1-a370-618d332bd433 req-3d13afea-6729-4d92-9e1c-f0c1154c8f58 service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] No waiting events found dispatching network-vif-unplugged-8f985466-eea4-4ddd-b005-4f3533dff86b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-cf7b0371-4293-44f1-a370-618d332bd433 req-3d13afea-6729-4d92-9e1c-f0c1154c8f58 service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Received event network-vif-unplugged-8f985466-eea4-4ddd-b005-4f3533dff86b for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:19:36 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Instance destroyed successfully.
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.objects.instance [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lazy-loading 'resources' on Instance uuid 147a0117-749d-4aff-8a4d-9ea91238278b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "address": "fa:16:3e:1f:e4:9d", "network": {"id": "2a24259a-abcc-4676-b0ac-5421ac2a6885", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1205067213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6f0247-04", "ovs_interfaceid": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "address": "fa:16:3e:1f:e4:9d", "network": {"id": "2a24259a-abcc-4676-b0ac-5421ac2a6885", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1205067213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6f0247-04", "ovs_interfaceid": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:e4:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d6f0247-0483-4fad-9551-30b7ea4933cd,network=Network(2a24259a-abcc-4676-b0ac-5421ac2a6885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d6f0247-04') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG os_vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:e4:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d6f0247-0483-4fad-9551-30b7ea4933cd,network=Network(2a24259a-abcc-4676-b0ac-5421ac2a6885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d6f0247-04') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d6f0247-04, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: INFO os_vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:e4:9d,bridge_name='br-int',has_traffic_filtering=True,id=3d6f0247-0483-4fad-9551-30b7ea4933cd,network=Network(2a24259a-abcc-4676-b0ac-5421ac2a6885),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d6f0247-04')
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "address": "fa:16:3e:d0:31:5f", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65a4e99-e0", "ovs_interfaceid": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "address": "fa:16:3e:d0:31:5f", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65a4e99-e0", "ovs_interfaceid": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:31:5f,bridge_name='br-int',has_traffic_filtering=True,id=b65a4e99-e008-4dd1-9db2-25dfb8d19317,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb65a4e99-e0') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG os_vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:31:5f,bridge_name='br-int',has_traffic_filtering=True,id=b65a4e99-e008-4dd1-9db2-25dfb8d19317,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb65a4e99-e0') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb65a4e99-e0, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: INFO os_vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:31:5f,bridge_name='br-int',has_traffic_filtering=True,id=b65a4e99-e008-4dd1-9db2-25dfb8d19317,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb65a4e99-e0')
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "address": "fa:16:3e:46:71:d4", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e811baf-1a", "ovs_interfaceid": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "address": "fa:16:3e:46:71:d4", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e811baf-1a", "ovs_interfaceid": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:71:d4,bridge_name='br-int',has_traffic_filtering=True,id=3e811baf-1a7c-4c5d-bd92-6812e7ab3375,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e811baf-1a') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG os_vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:71:d4,bridge_name='br-int',has_traffic_filtering=True,id=3e811baf-1a7c-4c5d-bd92-6812e7ab3375,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e811baf-1a') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e811baf-1a, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: INFO os_vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:71:d4,bridge_name='br-int',has_traffic_filtering=True,id=3e811baf-1a7c-4c5d-bd92-6812e7ab3375,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3e811baf-1a')
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "350d5856-a681-4266-b9c0-670a99cbd2a2", "address": "fa:16:3e:82:93:6c", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350d5856-a6", "ovs_interfaceid": "350d5856-a681-4266-b9c0-670a99cbd2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "350d5856-a681-4266-b9c0-670a99cbd2a2", "address": "fa:16:3e:82:93:6c", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.17", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350d5856-a6", "ovs_interfaceid": "350d5856-a681-4266-b9c0-670a99cbd2a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:93:6c,bridge_name='br-int',has_traffic_filtering=True,id=350d5856-a681-4266-b9c0-670a99cbd2a2,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350d5856-a6') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG os_vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:93:6c,bridge_name='br-int',has_traffic_filtering=True,id=350d5856-a681-4266-b9c0-670a99cbd2a2,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350d5856-a6') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap350d5856-a6, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: INFO os_vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:93:6c,bridge_name='br-int',has_traffic_filtering=True,id=350d5856-a681-4266-b9c0-670a99cbd2a2,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350d5856-a6')
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "address": "fa:16:3e:3c:28:8e", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447fb91-c7", "ovs_interfaceid": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "address": "fa:16:3e:3c:28:8e", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447fb91-c7", "ovs_interfaceid": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:28:8e,bridge_name='br-int',has_traffic_filtering=True,id=4447fb91-c7dc-4014-a316-fcc684f2a1d7,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4447fb91-c7') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG os_vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:28:8e,bridge_name='br-int',has_traffic_filtering=True,id=4447fb91-c7dc-4014-a316-fcc684f2a1d7,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4447fb91-c7') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4447fb91-c7, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: INFO os_vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:28:8e,bridge_name='br-int',has_traffic_filtering=True,id=4447fb91-c7dc-4014-a316-fcc684f2a1d7,network=Network(bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4447fb91-c7')
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "address": "fa:16:3e:cc:81:9c", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed88fc4-fc", "ovs_interfaceid": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "address": "fa:16:3e:cc:81:9c", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed88fc4-fc", "ovs_interfaceid": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:81:9c,bridge_name='br-int',has_traffic_filtering=True,id=6ed88fc4-fcd1-415d-a1fe-779f77394c9e,network=Network(19dafa9a-41de-43f8-9f41-499d5449f2e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed88fc4-fc') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG os_vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:81:9c,bridge_name='br-int',has_traffic_filtering=True,id=6ed88fc4-fcd1-415d-a1fe-779f77394c9e,network=Network(19dafa9a-41de-43f8-9f41-499d5449f2e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed88fc4-fc') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ed88fc4-fc, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: INFO os_vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:81:9c,bridge_name='br-int',has_traffic_filtering=True,id=6ed88fc4-fcd1-415d-a1fe-779f77394c9e,network=Network(19dafa9a-41de-43f8-9f41-499d5449f2e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed88fc4-fc')
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:17:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-961092484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-961092484',id=11,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0V8KKLfSBl8TEALkePI+O9PXDxXCSvdRgR9HrCPCIXA75klY/95WUFCxvNG5CWIwJ2m/7WksXFeprQ0UR9Jsqr2nZcCT7s0a7BDRIqH67EV32c6miUT0XOSUe/g0hg3w==',key_name='tempest-keypair-731997501',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:18:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='39622ec42f1941888eba707de58d580f',ramdisk_id='',reservation_id='r-x8jvnvwp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1721012935',owner_user_name='tempest-TaggedBootDevicesTest-1721012935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:18:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c54f23024e2040adaf80571db2b39067',uuid=147a0117-749d-4aff-8a4d-9ea91238278b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e4ef743f-f417-446a-adcd-10b699018f21", "address": "fa:16:3e:c3:d8:a8", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ef743f-f4", "ovs_interfaceid": "e4ef743f-f417-446a-adcd-10b699018f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converting VIF {"id": "e4ef743f-f417-446a-adcd-10b699018f21", "address": "fa:16:3e:c3:d8:a8", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ef743f-f4", "ovs_interfaceid": "e4ef743f-f417-446a-adcd-10b699018f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d8:a8,bridge_name='br-int',has_traffic_filtering=True,id=e4ef743f-f417-446a-adcd-10b699018f21,network=Network(19dafa9a-41de-43f8-9f41-499d5449f2e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ef743f-f4') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG os_vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d8:a8,bridge_name='br-int',has_traffic_filtering=True,id=e4ef743f-f417-446a-adcd-10b699018f21,network=Network(19dafa9a-41de-43f8-9f41-499d5449f2e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ef743f-f4') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4ef743f-f4, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:36 user nova-compute[72874]: INFO os_vif [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:d8:a8,bridge_name='br-int',has_traffic_filtering=True,id=e4ef743f-f417-446a-adcd-10b699018f21,network=Network(19dafa9a-41de-43f8-9f41-499d5449f2e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4ef743f-f4')
Aug 17 18:19:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xGCfLcug', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:19:36 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:19:36 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ac3d37-ec74-42c5-8557-87eb8b22849a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c92ee6b-a952-421d-8776-50d356c37d94]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:37 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:37 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:37 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:37 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:37 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:37 user nova-compute[72874]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe (non-flash)
Aug 17 18:19:37 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:37 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c05d3ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe'): ({'sdd'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Removing single pathed devices sdd {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e328c2-2f2d-4923-81a3-b9d98878ad8c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3067d39-3a79-4dde-a328-6f2ab33b028a]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Flushing IO for device /dev/sdd {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18e3264-2b50-485a-ba3c-8000c787f337]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4f3893-5af1-4f69-b837-e76e2d0a47d2]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c420d8-a20f-4139-98ef-cd0e63b128fa]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Took 1.29 seconds to deallocate network for instance.
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[206c1618-70d4-46e8-b4cd-0d00aedef9a1]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe, portal: 172.16.0.220,3260]
Aug 17 18:19:37 user nova-compute[72874]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe, portal: 172.16.0.220,3260] successful.
Aug 17 18:19:37 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1fd775ed-8af7-48df-8684-9c68ef6b62fe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9ae2a0-0abe-414d-bd13-66764605904c]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] <== disconnect_volume: return (339ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqcKwsBl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:19:37 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-3d6f0247-0483-4fad-9551-30b7ea4933cd {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-3d6f0247-0483-4fad-9551-30b7ea4933cd {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:37 user nova-compute[72874]: WARNING nova.compute.manager [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-3d6f0247-0483-4fad-9551-30b7ea4933cd for instance with vm_state active and task_state deleting.
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-unplugged-b65a4e99-e008-4dd1-9db2-25dfb8d19317 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-unplugged-b65a4e99-e008-4dd1-9db2-25dfb8d19317 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-unplugged-b65a4e99-e008-4dd1-9db2-25dfb8d19317 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-b65a4e99-e008-4dd1-9db2-25dfb8d19317 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-b65a4e99-e008-4dd1-9db2-25dfb8d19317 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:37 user nova-compute[72874]: WARNING nova.compute.manager [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-b65a4e99-e008-4dd1-9db2-25dfb8d19317 for instance with vm_state active and task_state deleting.
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-unplugged-e4ef743f-f417-446a-adcd-10b699018f21 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-unplugged-e4ef743f-f417-446a-adcd-10b699018f21 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-unplugged-e4ef743f-f417-446a-adcd-10b699018f21 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-e4ef743f-f417-446a-adcd-10b699018f21 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-e4ef743f-f417-446a-adcd-10b699018f21 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:37 user nova-compute[72874]: WARNING nova.compute.manager [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-e4ef743f-f417-446a-adcd-10b699018f21 for instance with vm_state active and task_state deleting.
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-58c32a4e-ac11-4e44-9b95-f211d7060a18 req-cdcec6d2-6ee3-4540-b2c9-009212135e11 service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Received event network-vif-deleted-8f985466-eea4-4ddd-b005-4f3533dff86b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb664e59-fe03-4812-92ff-f19f0d1cef78]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[02de2f83-e0b9-4428-8cde-390cd7698e88]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:37 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:37 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:37 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:37 user nova-compute[72874]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 (non-flash)
Aug 17 18:19:37 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:37 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a079d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600'): ({'sdc'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Removing single pathed devices sdc {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7bf80d7-d08d-4709-a8b4-54db41162405]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f273bf-8088-49df-9a92-f3bcbf1394ae]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Flushing IO for device /dev/sdc {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2645d784-fd63-4826-a2b4-dcb65464da28]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4377c3eb-7bb6-41bc-b5d5-954c76164ea9]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b06b8780-4a5f-43c4-b276-7d68eb299f99]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d4d991-be94-4173-9363-d77606f5a9c7]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600, portal: 172.16.0.220,3260]
Aug 17 18:19:37 user nova-compute[72874]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600, portal: 172.16.0.220,3260] successful.
Aug 17 18:19:37 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a7e78c9-7f20-43b8-ab0e-00cf9d5d2600 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[10982443-4498-4f28-beed-3cde88323fe9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.357s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] <== disconnect_volume: return (358ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mVnFfUWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:19:37 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Deleted allocations for instance 2b854f0d-7305-41d5-8188-12ae9050e213
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab457994-5595-416a-9ca6-b0053e7ab977]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-350d5856-a681-4266-b9c0-670a99cbd2a2 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-350d5856-a681-4266-b9c0-670a99cbd2a2 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:37 user nova-compute[72874]: WARNING nova.compute.manager [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-350d5856-a681-4266-b9c0-670a99cbd2a2 for instance with vm_state active and task_state deleting.
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-unplugged-4447fb91-c7dc-4014-a316-fcc684f2a1d7 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-unplugged-4447fb91-c7dc-4014-a316-fcc684f2a1d7 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-unplugged-4447fb91-c7dc-4014-a316-fcc684f2a1d7 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-4447fb91-c7dc-4014-a316-fcc684f2a1d7 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-4447fb91-c7dc-4014-a316-fcc684f2a1d7 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:37 user nova-compute[72874]: WARNING nova.compute.manager [req-86b073f5-bab6-4924-b1ad-5ffa0fcc197f req-775b2172-3966-4d5f-bef1-5311d748a9de service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-4447fb91-c7dc-4014-a316-fcc684f2a1d7 for instance with vm_state active and task_state deleting.
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea14f17e-d86b-4ae9-86b1-4c2a7c57abd7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:37 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:37 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:37 user nova-compute[72874]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 (non-flash)
Aug 17 18:19:37 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c076c700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77'): ({'sde'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Removing single pathed devices sde {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7600b75-0e71-454b-a396-b8ad848bc9cc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e2d359c8-1773-4aeb-aab1-95a1ea62a3a1 tempest-VolumesActionsTest-507325747 tempest-VolumesActionsTest-507325747-project-member] Lock "2b854f0d-7305-41d5-8188-12ae9050e213" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.170s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2893af44-04b9-40a5-b6e0-ddb45d7da85a]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Flushing IO for device /dev/sde {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f7e847-e8f2-451d-a525-30ae22a83b62]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d012b329-9b78-4deb-ad6d-2ca25c4e9954]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] SCSI volumes sde have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c9b3c5-0752-43d7-bc9c-93f9f73f65ac]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55a5a64-4afe-4b4a-a3d4-e8dbabe72e71]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77, portal: 172.16.0.220,3260]
Aug 17 18:19:37 user nova-compute[72874]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77, portal: 172.16.0.220,3260] successful.
Aug 17 18:19:37 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df274d3a-8624-4817-8cc7-b2ea82d0df77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8508b96-12cb-4dfe-a79f-889d93f815c9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] <== disconnect_volume: return (326ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:19:37 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:19:37 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Deleting instance files /opt/stack/data/nova/instances/147a0117-749d-4aff-8a4d-9ea91238278b_del
Aug 17 18:19:37 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Deletion of /opt/stack/data/nova/instances/147a0117-749d-4aff-8a4d-9ea91238278b_del complete
Aug 17 18:19:38 user nova-compute[72874]: INFO nova.compute.manager [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Took 3.57 seconds to destroy the instance on the hypervisor.
Aug 17 18:19:38 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Received event network-vif-plugged-8f985466-eea4-4ddd-b005-4f3533dff86b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] Acquiring lock "2b854f0d-7305-41d5-8188-12ae9050e213-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] Lock "2b854f0d-7305-41d5-8188-12ae9050e213-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] Lock "2b854f0d-7305-41d5-8188-12ae9050e213-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] No waiting events found dispatching network-vif-plugged-8f985466-eea4-4ddd-b005-4f3533dff86b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:38 user nova-compute[72874]: WARNING nova.compute.manager [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Received unexpected event network-vif-plugged-8f985466-eea4-4ddd-b005-4f3533dff86b for instance with vm_state deleted and task_state None.
Aug 17 18:19:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-unplugged-3e811baf-1a7c-4c5d-bd92-6812e7ab3375 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-unplugged-3e811baf-1a7c-4c5d-bd92-6812e7ab3375 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-unplugged-3e811baf-1a7c-4c5d-bd92-6812e7ab3375 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-3e811baf-1a7c-4c5d-bd92-6812e7ab3375 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-3e811baf-1a7c-4c5d-bd92-6812e7ab3375 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:38 user nova-compute[72874]: WARNING nova.compute.manager [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-3e811baf-1a7c-4c5d-bd92-6812e7ab3375 for instance with vm_state active and task_state deleting.
Aug 17 18:19:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-unplugged-6ed88fc4-fcd1-415d-a1fe-779f77394c9e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-unplugged-6ed88fc4-fcd1-415d-a1fe-779f77394c9e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-unplugged-6ed88fc4-fcd1-415d-a1fe-779f77394c9e for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-plugged-6ed88fc4-fcd1-415d-a1fe-779f77394c9e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] Acquiring lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] Lock "147a0117-749d-4aff-8a4d-9ea91238278b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] No waiting events found dispatching network-vif-plugged-6ed88fc4-fcd1-415d-a1fe-779f77394c9e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:38 user nova-compute[72874]: WARNING nova.compute.manager [req-6953c5a8-db85-4c33-a4a5-0af215091e4c req-430b5371-6147-431d-96de-fa489569c7bc service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received unexpected event network-vif-plugged-6ed88fc4-fcd1-415d-a1fe-779f77394c9e for instance with vm_state active and task_state deleting.
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:19:39 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Creating image(s)
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Ensure instance console log exists: /opt/stack/data/nova/instances/7c486f7d-bcad-4c83-98bf-f08559259d33/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Start _get_guest_xml network_info=[{"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sakPJxrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c486f7d-bcad-4c83-98bf-f08559259d33', 'attached_at': '', 'detached_at': '', 'volume_id': '44d2d09e-f58b-4287-a79b-73f2c406e0a5', 'serial': '44d2d09e-f58b-4287-a79b-73f2c406e0a5'}, 'delete_on_termination': True, 'attachment_id': 'f7acf413-3c66-40d1-96b2-c6bf97d9ab66', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:19:39 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 18:19:39 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7c486f7d-bcad-4c83-98bf-f08559259d33 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sakPJxrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:19:39 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:39 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:39 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d84d32-e573-4ccc-b08d-1634221cebba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:19:39 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e408a9e-b008-41a0-9ca5-4316c2f22445]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5] added
Aug 17 18:19:39 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[feba5480-20b3-4bf4-b55e-2a8149670174]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[95f57669-cda2-4f74-824a-07dec3eede7c]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sakPJxrD {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sakPJxrD" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[420cadfa-8c69-4a9a-b626-fa969ecea7a7]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sakPJxrD'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[986a698b-75ed-4a9e-94d0-9faddcc2788a]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[56401f75-ab95-49bf-a36c-5fb5267670d0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:39 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:39 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf2fc20-5524-45cc-9e5b-87da4ed5c947]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5, portal: 172.16.0.220,3260]
Aug 17 18:19:39 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5, portal: 172.16.0.220,3260] successful.
Aug 17 18:19:39 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b593bc47-099d-4c6d-9540-6fceb4a5245e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[11998876-c3ee-4e28-916d-4c8a1a398a74]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:39 user nova-compute[72874]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:39 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:39 user nova-compute[72874]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:39 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0f2d74-945b-4b22-8fb9-06679204c01a]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:19:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG nova.compute.manager [req-8f1ba5e9-ce1d-488c-bc62-63b641a77865 req-5784a33b-ce11-4737-89f2-f9fc923ca2a1 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-deleted-350d5856-a681-4266-b9c0-670a99cbd2a2 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:40 user nova-compute[72874]: INFO nova.compute.manager [req-8f1ba5e9-ce1d-488c-bc62-63b641a77865 req-5784a33b-ce11-4737-89f2-f9fc923ca2a1 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Neutron deleted interface 350d5856-a681-4266-b9c0-670a99cbd2a2; detaching it from the instance and deleting it from the info cache
Aug 17 18:19:40 user nova-compute[72874]: DEBUG nova.network.neutron [req-8f1ba5e9-ce1d-488c-bc62-63b641a77865 req-5784a33b-ce11-4737-89f2-f9fc923ca2a1 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Updating instance_info_cache with network_info: [{"id": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "address": "fa:16:3e:1f:e4:9d", "network": {"id": "2a24259a-abcc-4676-b0ac-5421ac2a6885", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1205067213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.113", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d6f0247-04", "ovs_interfaceid": "3d6f0247-0483-4fad-9551-30b7ea4933cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "address": "fa:16:3e:d0:31:5f", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.246", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb65a4e99-e0", "ovs_interfaceid": "b65a4e99-e008-4dd1-9db2-25dfb8d19317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "address": "fa:16:3e:46:71:d4", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.142", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e811baf-1a", "ovs_interfaceid": "3e811baf-1a7c-4c5d-bd92-6812e7ab3375", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "address": "fa:16:3e:3c:28:8e", "network": {"id": "bb5ad41e-0e8c-4fa1-a77e-bb4fa50b64d6", "bridge": "br-int", "label": "tempest-device-tagging-net1-353573586", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4447fb91-c7", "ovs_interfaceid": "4447fb91-c7dc-4014-a316-fcc684f2a1d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "address": "fa:16:3e:cc:81:9c", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed88fc4-fc", "ovs_interfaceid": "6ed88fc4-fcd1-415d-a1fe-779f77394c9e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e4ef743f-f417-446a-adcd-10b699018f21", "address": "fa:16:3e:c3:d8:a8", "network": {"id": "19dafa9a-41de-43f8-9f41-499d5449f2e8", "bridge": "br-int", "label": "tempest-device-tagging-net2-1019357959", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "39622ec42f1941888eba707de58d580f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4ef743f-f4", "ovs_interfaceid": "e4ef743f-f417-446a-adcd-10b699018f21", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG nova.compute.manager [req-8f1ba5e9-ce1d-488c-bc62-63b641a77865 req-5784a33b-ce11-4737-89f2-f9fc923ca2a1 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Detach interface failed, port_id=350d5856-a681-4266-b9c0-670a99cbd2a2, reason: Instance 147a0117-749d-4aff-8a4d-9ea91238278b could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sakPJxrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23630353666643437', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630353666643437', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T18:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1675062005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2121101201',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHO7rkeC9pzXuKB0SzBYgruoGhDzERqiJUXWtIfbrLLf7ig2/MHev5D+kN1SaVM8QqD4bJCvdEFBeAQxW3jsr31paoEijftB74Jxx/L7jR166vAUYf/FeWQK16Y3ojsdFg==',key_name='tempest-keypair-809304444',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:17:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0ce530e304a47e49163e5e16a07af5a',ramdisk_id='',reservation_id='r-9lpxt6gu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-423641309',owner_user_name='tempest-ServerActionsV293TestJSON-423641309-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:19:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb6178a9238a4c6ca4f80eea57962534',uuid=7c486f7d-bcad-4c83-98bf-f08559259d33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Converting VIF {"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:12:45,bridge_name='br-int',has_traffic_filtering=True,id=82fadf6c-c99c-4db9-8f9c-f05d33415d5c,network=Network(cce89dc3-ea6a-4e83-94a1-6bc08392b565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82fadf6c-c9') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:19:40 user nova-compute[72874]:   <uuid>7c486f7d-bcad-4c83-98bf-f08559259d33</uuid>
Aug 17 18:19:40 user nova-compute[72874]:   <name>instance-00000009</name>
Aug 17 18:19:40 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:19:40 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:19:40 user nova-compute[72874]:   <metadata>
Aug 17 18:19:40 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:19:40 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:19:40 user nova-compute[72874]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1675062005</nova:name>
Aug 17 18:19:40 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:19:39</nova:creationTime>
Aug 17 18:19:40 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:19:40 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:19:40 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:19:40 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:19:40 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:19:40 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:19:40 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:19:40 user nova-compute[72874]:       <nova:owner>
Aug 17 18:19:40 user nova-compute[72874]:         <nova:user uuid="bb6178a9238a4c6ca4f80eea57962534">tempest-ServerActionsV293TestJSON-423641309-project-member</nova:user>
Aug 17 18:19:40 user nova-compute[72874]:         <nova:project uuid="b0ce530e304a47e49163e5e16a07af5a">tempest-ServerActionsV293TestJSON-423641309</nova:project>
Aug 17 18:19:40 user nova-compute[72874]:       </nova:owner>
Aug 17 18:19:40 user nova-compute[72874]:       <nova:ports>
Aug 17 18:19:40 user nova-compute[72874]:         <nova:port uuid="82fadf6c-c99c-4db9-8f9c-f05d33415d5c">
Aug 17 18:19:40 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 18:19:40 user nova-compute[72874]:         </nova:port>
Aug 17 18:19:40 user nova-compute[72874]:       </nova:ports>
Aug 17 18:19:40 user nova-compute[72874]:     </nova:instance>
Aug 17 18:19:40 user nova-compute[72874]:   </metadata>
Aug 17 18:19:40 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:19:40 user nova-compute[72874]:     <system>
Aug 17 18:19:40 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:19:40 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:19:40 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:19:40 user nova-compute[72874]:       <entry name="serial">7c486f7d-bcad-4c83-98bf-f08559259d33</entry>
Aug 17 18:19:40 user nova-compute[72874]:       <entry name="uuid">7c486f7d-bcad-4c83-98bf-f08559259d33</entry>
Aug 17 18:19:40 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:19:40 user nova-compute[72874]:     </system>
Aug 17 18:19:40 user nova-compute[72874]:   </sysinfo>
Aug 17 18:19:40 user nova-compute[72874]:   <os>
Aug 17 18:19:40 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:19:40 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:19:40 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:19:40 user nova-compute[72874]:   </os>
Aug 17 18:19:40 user nova-compute[72874]:   <features>
Aug 17 18:19:40 user nova-compute[72874]:     <acpi/>
Aug 17 18:19:40 user nova-compute[72874]:     <apic/>
Aug 17 18:19:40 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:19:40 user nova-compute[72874]:   </features>
Aug 17 18:19:40 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:19:40 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:19:40 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:19:40 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:19:40 user nova-compute[72874]:   </clock>
Aug 17 18:19:40 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:19:40 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:19:40 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:19:40 user nova-compute[72874]:   </cpu>
Aug 17 18:19:40 user nova-compute[72874]:   <devices>
Aug 17 18:19:40 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:19:40 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:19:40 user nova-compute[72874]:       <source dev="/dev/sdb"/>
Aug 17 18:19:40 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:19:40 user nova-compute[72874]:       <serial>44d2d09e-f58b-4287-a79b-73f2c406e0a5</serial>
Aug 17 18:19:40 user nova-compute[72874]:     </disk>
Aug 17 18:19:40 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:19:40 user nova-compute[72874]:       <mac address="fa:16:3e:44:12:45"/>
Aug 17 18:19:40 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:19:40 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:19:40 user nova-compute[72874]:       <target dev="tap82fadf6c-c9"/>
Aug 17 18:19:40 user nova-compute[72874]:     </interface>
Aug 17 18:19:40 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:19:40 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/7c486f7d-bcad-4c83-98bf-f08559259d33/console.log" append="off"/>
Aug 17 18:19:40 user nova-compute[72874]:     </serial>
Aug 17 18:19:40 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:19:40 user nova-compute[72874]:     <video>
Aug 17 18:19:40 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:19:40 user nova-compute[72874]:     </video>
Aug 17 18:19:40 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:19:40 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:19:40 user nova-compute[72874]:     </rng>
Aug 17 18:19:40 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:19:40 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:19:40 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:19:40 user nova-compute[72874]:     </memballoon>
Aug 17 18:19:40 user nova-compute[72874]:   </devices>
Aug 17 18:19:40 user nova-compute[72874]: </domain>
Aug 17 18:19:40 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T18:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1675062005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2121101201',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHO7rkeC9pzXuKB0SzBYgruoGhDzERqiJUXWtIfbrLLf7ig2/MHev5D+kN1SaVM8QqD4bJCvdEFBeAQxW3jsr31paoEijftB74Jxx/L7jR166vAUYf/FeWQK16Y3ojsdFg==',key_name='tempest-keypair-809304444',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:17:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0ce530e304a47e49163e5e16a07af5a',ramdisk_id='',reservation_id='r-9lpxt6gu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-423641309',owner_user_name='tempest-ServerActionsV293TestJSON-423641309-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:19:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb6178a9238a4c6ca4f80eea57962534',uuid=7c486f7d-bcad-4c83-98bf-f08559259d33,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Converting VIF {"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:12:45,bridge_name='br-int',has_traffic_filtering=True,id=82fadf6c-c99c-4db9-8f9c-f05d33415d5c,network=Network(cce89dc3-ea6a-4e83-94a1-6bc08392b565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82fadf6c-c9') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG os_vif [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:12:45,bridge_name='br-int',has_traffic_filtering=True,id=82fadf6c-c99c-4db9-8f9c-f05d33415d5c,network=Network(cce89dc3-ea6a-4e83-94a1-6bc08392b565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82fadf6c-c9') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82fadf6c-c9, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap82fadf6c-c9, col_values=(('external_ids', {'iface-id': '82fadf6c-c99c-4db9-8f9c-f05d33415d5c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:12:45', 'vm-uuid': '7c486f7d-bcad-4c83-98bf-f08559259d33'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:40 user nova-compute[72874]: INFO os_vif [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:12:45,bridge_name='br-int',has_traffic_filtering=True,id=82fadf6c-c99c-4db9-8f9c-f05d33415d5c,network=Network(cce89dc3-ea6a-4e83-94a1-6bc08392b565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82fadf6c-c9')
Aug 17 18:19:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:19:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] No VIF found with MAC fa:16:3e:44:12:45, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:19:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:42 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:19:42 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Took 4.34 seconds to deallocate network for instance.
Aug 17 18:19:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-c838a2e4-2026-4872-9687-036a61489bc3 req-ab560910-84a8-43e6-b324-c0a7162983e1 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-deleted-6ed88fc4-fcd1-415d-a1fe-779f77394c9e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-c838a2e4-2026-4872-9687-036a61489bc3 req-ab560910-84a8-43e6-b324-c0a7162983e1 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-deleted-4447fb91-c7dc-4014-a316-fcc684f2a1d7 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-c838a2e4-2026-4872-9687-036a61489bc3 req-ab560910-84a8-43e6-b324-c0a7162983e1 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-deleted-e4ef743f-f417-446a-adcd-10b699018f21 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-c838a2e4-2026-4872-9687-036a61489bc3 req-ab560910-84a8-43e6-b324-c0a7162983e1 service nova] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Received event network-vif-deleted-3d6f0247-0483-4fad-9551-30b7ea4933cd {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-d5dcb780-3c20-4f45-9dea-8c37efe8bc2b req-43dfbf73-3406-4b10-af55-10bbfd401e04 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received event network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d5dcb780-3c20-4f45-9dea-8c37efe8bc2b req-43dfbf73-3406-4b10-af55-10bbfd401e04 service nova] Acquiring lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d5dcb780-3c20-4f45-9dea-8c37efe8bc2b req-43dfbf73-3406-4b10-af55-10bbfd401e04 service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d5dcb780-3c20-4f45-9dea-8c37efe8bc2b req-43dfbf73-3406-4b10-af55-10bbfd401e04 service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-d5dcb780-3c20-4f45-9dea-8c37efe8bc2b req-43dfbf73-3406-4b10-af55-10bbfd401e04 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] No waiting events found dispatching network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:42 user nova-compute[72874]: WARNING nova.compute.manager [req-d5dcb780-3c20-4f45-9dea-8c37efe8bc2b req-43dfbf73-3406-4b10-af55-10bbfd401e04 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received unexpected event network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c for instance with vm_state active and task_state rebuild_spawning.
Aug 17 18:19:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:43 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMRIGCEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5eb0e71-cb94-4635-b215-5e25162a001f', 'serial': 'a5eb0e71-cb94-4635-b215-5e25162a001f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWBtuXYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'a2169187-af77-42aa-aa8f-2581cd87c3c9'}, 'status': 'reserved', 'instance': '8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83', 'attached_at': '', 'detached_at': '', 'volume_id': 'a2169187-af77-42aa-aa8f-2581cd87c3c9', 'serial'} {{(pid=72874) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 17 18:19:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:19:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMRIGCEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:19:43 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:19:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:43 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:19:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:43 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:19:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac0284e-d9dd-414e-a539-d1e99790512e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:19:43 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7934c3c8-6ccb-4b3f-970c-24b4f0e06107]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f] added
Aug 17 18:19:44 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77a9772-ff4f-459f-bac5-701ff1421b4f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9ddbf0-c65b-4da2-924e-dfe8dff5b98d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OMRIGCEz {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OMRIGCEz" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f3be5d-dcc2-4366-baa8-405ec0105756]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OMRIGCEz'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d66946-fd25-4e16-b5ae-dee4bb746826]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d891933-19f8-4d76-8fb4-7353d98f890a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:44 user nova-compute[72874]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:44 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:44 user nova-compute[72874]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:44 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e2ead3-bba9-4006-80ba-76cda8b41f1e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f, portal: 172.16.0.220,3260]
Aug 17 18:19:44 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f, portal: 172.16.0.220,3260] successful.
Aug 17 18:19:44 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b8d6b9-385c-49e9-a76f-feea16bcfe69]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c99a931-ea16-4237-b8d7-ecfd69db2f6c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:44 user nova-compute[72874]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:44 user nova-compute[72874]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)
Aug 17 18:19:44 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:44 user nova-compute[72874]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:44 user nova-compute[72874]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)
Aug 17 18:19:44 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6754e62-0aae-4167-9752-a64044bf06f4]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296384.50391, 7c486f7d-bcad-4c83-98bf-f08559259d33 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:19:44 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] VM Resumed (Lifecycle Event)
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:19:44 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Instance spawned successfully.
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:19:44 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296384.504982, 7c486f7d-bcad-4c83-98bf-f08559259d33 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:19:44 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] VM Started (Lifecycle Event)
Aug 17 18:19:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:19:44 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72874) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e9925591-c9dd-46b1-aeaa-b662645ffbfb tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.089s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-8719a174-4d2f-4200-b595-61aaaf29ed64 req-1a43ac63-157f-425c-aae1-1797f72f1394 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received event network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8719a174-4d2f-4200-b595-61aaaf29ed64 req-1a43ac63-157f-425c-aae1-1797f72f1394 service nova] Acquiring lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8719a174-4d2f-4200-b595-61aaaf29ed64 req-1a43ac63-157f-425c-aae1-1797f72f1394 service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8719a174-4d2f-4200-b595-61aaaf29ed64 req-1a43ac63-157f-425c-aae1-1797f72f1394 service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-8719a174-4d2f-4200-b595-61aaaf29ed64 req-1a43ac63-157f-425c-aae1-1797f72f1394 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] No waiting events found dispatching network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:45 user nova-compute[72874]: WARNING nova.compute.manager [req-8719a174-4d2f-4200-b595-61aaaf29ed64 req-1a43ac63-157f-425c-aae1-1797f72f1394 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received unexpected event network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c for instance with vm_state active and task_state None.
Aug 17 18:19:45 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:19:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMRIGCEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:19:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23138626531613830', 'path': '/dev/sdc'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:19:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138626531613830', 'path': '/dev/sdc'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:19:45 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lazy-loading 'flavor' on Instance uuid 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:45 user nova-compute[72874]: INFO nova.compute.manager [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Took 2.78 seconds to detach 3 volumes for instance.
Aug 17 18:19:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:45 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:19:45 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:19:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:45 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Deleted allocations for instance 147a0117-749d-4aff-8a4d-9ea91238278b
Aug 17 18:19:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-98c71800-7028-4c14-b17f-2a1f4a552ce8 tempest-TaggedBootDevicesTest-1721012935 tempest-TaggedBootDevicesTest-1721012935-project-member] Lock "147a0117-749d-4aff-8a4d-9ea91238278b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.288s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 146800640 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 313524224 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 442499072 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 610271232 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 782237696 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 940572672 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWBtuXYK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'volume_id': 'a2169187-af77-42aa-aa8f-2581cd87c3c9'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:19:49 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f67e4e-22e8-4fa7-be27-b083ec4414a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d44e01a-821b-4a08-a8b1-e4adeb076ff0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:49 user nova-compute[72874]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:49 user nova-compute[72874]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)
Aug 17 18:19:49 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 (non-flash)
Aug 17 18:19:49 user nova-compute[72874]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:49 user nova-compute[72874]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)
Aug 17 18:19:49 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a074f400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9'): ({'sdg'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Removing single pathed devices sdg {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f668c3ce-b2fd-405b-b489-42a1b9d0fad0]: (4, ('path checker states:\nup                  1\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fc5d3e-b10a-406a-b6ff-fbbc7b2e7d63]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Flushing IO for device /dev/sdg {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca76703-4c35-43f0-a98f-8eb55024ba80]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.063s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0296d80b-f024-4a92-a41e-e147d1822a9d]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] SCSI volumes sdg have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[082858f4-ea88-4666-9d7c-af001cff308b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[383ce100-67e2-4927-99a6-5933ea7a8112]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9, portal: 172.16.0.220,3260]
Aug 17 18:19:49 user nova-compute[72874]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9, portal: 172.16.0.220,3260] successful.
Aug 17 18:19:49 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2169187-af77-42aa-aa8f-2581cd87c3c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53c5ad9-737a-4d3a-a6e9-a2ff9fde11b5]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] <== disconnect_volume: return (331ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMRIGCEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83', 'attached_at': '', 'detached_at': '', 'volume_id': 'a5eb0e71-cb94-4635-b215-5e25162a001f', 'serial'} {{(pid=72874) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 17 18:19:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] swap_volume: removing Cinder connection for volume a2169187-af77-42aa-aa8f-2581cd87c3c9 {{(pid=72874) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 17 18:19:50 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296375.515679, 2b854f0d-7305-41d5-8188-12ae9050e213 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:19:50 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] VM Stopped (Lifecycle Event)
Aug 17 18:19:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-aef56c29-a2fb-4a45-b571-08fb101a18c2 None None] [instance: 2b854f0d-7305-41d5-8188-12ae9050e213] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:19:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] swap_volume: Updating volume a2169187-af77-42aa-aa8f-2581cd87c3c9 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "OMRIGCEz", "auth_password": "qA06oH8DWxwIsv", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "a5eb0e71-cb94-4635-b215-5e25162a001f"}, "status": "reserved", "instance": "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83", "attached_at": "", "detached_at": "", "volume_id": "a5eb0e71-cb94-4635-b215-5e25162a001f", "serial": "a5eb0e71-cb94-4635-b215-5e25162a001f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a5eb0e71-cb94-4635-b215-5e25162a001f', 'no_device': None, 'attachment_id': '07ef489b-9292-499b-8adc-a51001ff764b'} {{(pid=72874) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 17 18:19:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16f8373e-6402-4a77-b7fa-1814c20c51c6 tempest-TestVolumeSwap-799109211 tempest-TestVolumeSwap-799109211-project-admin] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 20.380s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:51 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296376.5353951, 147a0117-749d-4aff-8a4d-9ea91238278b => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:19:51 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] VM Stopped (Lifecycle Event)
Aug 17 18:19:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-7bfcd95b-08f1-4db1-9b84-90ddea4f5168 None None] [instance: 147a0117-749d-4aff-8a4d-9ea91238278b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:19:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "c9392afe-92e0-4703-bd6f-79d272d541e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "c9392afe-92e0-4703-bd6f-79d272d541e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Acquiring lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:19:51 user nova-compute[72874]: INFO nova.compute.manager [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Detaching volume a5eb0e71-cb94-4635-b215-5e25162a001f
Aug 17 18:19:52 user nova-compute[72874]: INFO nova.virt.block_device [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Attempting to driver detach volume a5eb0e71-cb94-4635-b215-5e25162a001f from mountpoint /dev/vdb
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Attempting to detach device vdb from instance 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:19:52 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:19:52 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:19:52 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:19:52 user nova-compute[72874]:   <serial>a5eb0e71-cb94-4635-b215-5e25162a001f</serial>
Aug 17 18:19:52 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:19:52 user nova-compute[72874]: </disk>
Aug 17 18:19:52 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:19:52 user nova-compute[72874]: INFO nova.compute.claims [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Claim successful on node user
Aug 17 18:19:52 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Successfully detached device vdb from instance 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 from the persistent domain config.
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:19:52 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:19:52 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:19:52 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:19:52 user nova-compute[72874]:   <serial>a5eb0e71-cb94-4635-b215-5e25162a001f</serial>
Aug 17 18:19:52 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:19:52 user nova-compute[72874]: </disk>
Aug 17 18:19:52 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.266s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692296392.5858824, 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:19:52 user nova-compute[72874]: INFO nova.compute.claims [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Claim successful on node user
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:19:52 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Successfully detached device vdb from instance 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 from the live domain config.
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OMRIGCEz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'a5eb0e71-cb94-4635-b215-5e25162a001f'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:19:52 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8d256f-bd43-449e-92d6-7397e1b2cac8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:78494fa7-d66b-4a7a-97aa-96e856f68139\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.network.neutron [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7e64e4-a0eb-4eff-8a55-befb51a549de]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78494fa7-d66b-4a7a-97aa-96e856f68139 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:52 user nova-compute[72874]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)
Aug 17 18:19:52 user nova-compute[72874]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78494fa7-d66b-4a7a-97aa-96e856f68139 (non-flash)
Aug 17 18:19:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:19:52 user nova-compute[72874]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f (non-flash)
Aug 17 18:19:52 user nova-compute[72874]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:78494fa7-d66b-4a7a-97aa-96e856f68139 (non-flash)
Aug 17 18:19:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c04601f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f'): ({'sdc'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Removing single pathed devices sdc {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:19:52 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcb6a53-df02-4b8e-ac86-b4d06c1dc6a2]: (4, ('path checker states:\nup                  1\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[19525cf7-1ae1-4995-9fce-214825a59e44]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Flushing IO for device /dev/sdc {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[748254d2-51d5-4336-ac37-17b765490872]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.policy [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f400334282b4272a8f78d682f3816d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b3fe8a83be9b440b95aa258c4dff6af4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[105d2abc-f6be-462e-aefd-dcdf9e076e24]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:19:52 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Creating image(s)
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "/opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "/opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed9453d-fe4a-4549-96ca-98c2f07d133c]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a52108-6576-4df6-94be-4c94f3046568]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f, portal: 172.16.0.220,3260]
Aug 17 18:19:52 user nova-compute[72874]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f, portal: 172.16.0.220,3260] successful.
Aug 17 18:19:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5eb0e71-cb94-4635-b215-5e25162a001f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[67da6114-b02d-4664-9994-f01564bdd80d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] <== disconnect_volume: return (368ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:19:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.199s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.199s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:53 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk 1073741824" returned: 0 in 0.060s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG nova.policy [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '31f7828a072847dc9cb4d4fd51908366', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad9005fd344e470482b0b90baeb97515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Successfully created port: a1886d6b-a20c-4565-a8ef-0507787724ef {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:19:53 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Creating image(s)
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "/opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "/opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.205s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Cannot resize image /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG nova.objects.instance [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lazy-loading 'migration_context' on Instance uuid c9392afe-92e0-4703-bd6f-79d272d541e3 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.199s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Ensure instance console log exists: /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.212s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk 1073741824" returned: 0 in 0.058s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Successfully created port: d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.network.neutron [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Successfully updated port: a1886d6b-a20c-4565-a8ef-0507787724ef {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.objects.instance [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lazy-loading 'flavor' on Instance uuid 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "refresh_cache-c9392afe-92e0-4703-bd6f-79d272d541e3" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquired lock "refresh_cache-c9392afe-92e0-4703-bd6f-79d272d541e3" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.network.neutron [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.225s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-91228a08-8afe-481b-af10-7aa1c7af364b req-abfaa75d-9a08-413e-9cd6-201f0ad7b833 service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Received event network-changed-a1886d6b-a20c-4565-a8ef-0507787724ef {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-91228a08-8afe-481b-af10-7aa1c7af364b req-abfaa75d-9a08-413e-9cd6-201f0ad7b833 service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Refreshing instance network info cache due to event network-changed-a1886d6b-a20c-4565-a8ef-0507787724ef. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-91228a08-8afe-481b-af10-7aa1c7af364b req-abfaa75d-9a08-413e-9cd6-201f0ad7b833 service nova] Acquiring lock "refresh_cache-c9392afe-92e0-4703-bd6f-79d272d541e3" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9fd77102-0457-4396-ba80-af5c850a2405 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.405s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.network.neutron [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Acquiring lock "544005af-7312-4bd4-a086-7d255ca7c479" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lock "544005af-7312-4bd4-a086-7d255ca7c479" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Acquiring lock "544005af-7312-4bd4-a086-7d255ca7c479-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lock "544005af-7312-4bd4-a086-7d255ca7c479-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lock "544005af-7312-4bd4-a086-7d255ca7c479-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:54 user nova-compute[72874]: INFO nova.compute.manager [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Terminating instance
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Cannot resize image /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.objects.instance [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lazy-loading 'migration_context' on Instance uuid 2ace97e1-c2ee-462e-a929-22c7cb2584d2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Ensure instance console log exists: /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.network.neutron [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Updating instance_info_cache with network_info: [{"id": "a1886d6b-a20c-4565-a8ef-0507787724ef", "address": "fa:16:3e:ad:89:fe", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1886d6b-a2", "ovs_interfaceid": "a1886d6b-a20c-4565-a8ef-0507787724ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Releasing lock "refresh_cache-c9392afe-92e0-4703-bd6f-79d272d541e3" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.compute.manager [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Instance network_info: |[{"id": "a1886d6b-a20c-4565-a8ef-0507787724ef", "address": "fa:16:3e:ad:89:fe", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1886d6b-a2", "ovs_interfaceid": "a1886d6b-a20c-4565-a8ef-0507787724ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-91228a08-8afe-481b-af10-7aa1c7af364b req-abfaa75d-9a08-413e-9cd6-201f0ad7b833 service nova] Acquired lock "refresh_cache-c9392afe-92e0-4703-bd6f-79d272d541e3" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.network.neutron [req-91228a08-8afe-481b-af10-7aa1c7af364b req-abfaa75d-9a08-413e-9cd6-201f0ad7b833 service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Refreshing network info cache for port a1886d6b-a20c-4565-a8ef-0507787724ef {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:19:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Start _get_guest_xml network_info=[{"id": "a1886d6b-a20c-4565-a8ef-0507787724ef", "address": "fa:16:3e:ad:89:fe", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1886d6b-a2", "ovs_interfaceid": "a1886d6b-a20c-4565-a8ef-0507787724ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:19:54 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:19:54 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1203647482',display_name='tempest-VolumesAdminNegativeTest-server-1203647482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1203647482',id=12,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3fe8a83be9b440b95aa258c4dff6af4',ramdisk_id='',reservation_id='r-nus44bud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1606846933',owner_user_name='tempest-VolumesAdminNegativeTest-1606846933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:19:53Z,user_data=None,user_id='2f400334282b4272a8f78d682f3816d0',uuid=c9392afe-92e0-4703-bd6f-79d272d541e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1886d6b-a20c-4565-a8ef-0507787724ef", "address": "fa:16:3e:ad:89:fe", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1886d6b-a2", "ovs_interfaceid": "a1886d6b-a20c-4565-a8ef-0507787724ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Converting VIF {"id": "a1886d6b-a20c-4565-a8ef-0507787724ef", "address": "fa:16:3e:ad:89:fe", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1886d6b-a2", "ovs_interfaceid": "a1886d6b-a20c-4565-a8ef-0507787724ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:89:fe,bridge_name='br-int',has_traffic_filtering=True,id=a1886d6b-a20c-4565-a8ef-0507787724ef,network=Network(92a988c2-183c-41cc-9b97-59474938a618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1886d6b-a2') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.objects.instance [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lazy-loading 'pci_devices' on Instance uuid c9392afe-92e0-4703-bd6f-79d272d541e3 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:19:55 user nova-compute[72874]:   <uuid>c9392afe-92e0-4703-bd6f-79d272d541e3</uuid>
Aug 17 18:19:55 user nova-compute[72874]:   <name>instance-0000000c</name>
Aug 17 18:19:55 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:19:55 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:19:55 user nova-compute[72874]:   <metadata>
Aug 17 18:19:55 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:19:55 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:19:55 user nova-compute[72874]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1203647482</nova:name>
Aug 17 18:19:55 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:19:54</nova:creationTime>
Aug 17 18:19:55 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:19:55 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:19:55 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:19:55 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:19:55 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:19:55 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:19:55 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:19:55 user nova-compute[72874]:       <nova:owner>
Aug 17 18:19:55 user nova-compute[72874]:         <nova:user uuid="2f400334282b4272a8f78d682f3816d0">tempest-VolumesAdminNegativeTest-1606846933-project-member</nova:user>
Aug 17 18:19:55 user nova-compute[72874]:         <nova:project uuid="b3fe8a83be9b440b95aa258c4dff6af4">tempest-VolumesAdminNegativeTest-1606846933</nova:project>
Aug 17 18:19:55 user nova-compute[72874]:       </nova:owner>
Aug 17 18:19:55 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:19:55 user nova-compute[72874]:       <nova:ports>
Aug 17 18:19:55 user nova-compute[72874]:         <nova:port uuid="a1886d6b-a20c-4565-a8ef-0507787724ef">
Aug 17 18:19:55 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 18:19:55 user nova-compute[72874]:         </nova:port>
Aug 17 18:19:55 user nova-compute[72874]:       </nova:ports>
Aug 17 18:19:55 user nova-compute[72874]:     </nova:instance>
Aug 17 18:19:55 user nova-compute[72874]:   </metadata>
Aug 17 18:19:55 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:19:55 user nova-compute[72874]:     <system>
Aug 17 18:19:55 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:19:55 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:19:55 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:19:55 user nova-compute[72874]:       <entry name="serial">c9392afe-92e0-4703-bd6f-79d272d541e3</entry>
Aug 17 18:19:55 user nova-compute[72874]:       <entry name="uuid">c9392afe-92e0-4703-bd6f-79d272d541e3</entry>
Aug 17 18:19:55 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:19:55 user nova-compute[72874]:     </system>
Aug 17 18:19:55 user nova-compute[72874]:   </sysinfo>
Aug 17 18:19:55 user nova-compute[72874]:   <os>
Aug 17 18:19:55 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:19:55 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:19:55 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:19:55 user nova-compute[72874]:   </os>
Aug 17 18:19:55 user nova-compute[72874]:   <features>
Aug 17 18:19:55 user nova-compute[72874]:     <acpi/>
Aug 17 18:19:55 user nova-compute[72874]:     <apic/>
Aug 17 18:19:55 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:19:55 user nova-compute[72874]:   </features>
Aug 17 18:19:55 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:19:55 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:19:55 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:19:55 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:19:55 user nova-compute[72874]:   </clock>
Aug 17 18:19:55 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:19:55 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:19:55 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:19:55 user nova-compute[72874]:   </cpu>
Aug 17 18:19:55 user nova-compute[72874]:   <devices>
Aug 17 18:19:55 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:19:55 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:19:55 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk"/>
Aug 17 18:19:55 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:19:55 user nova-compute[72874]:     </disk>
Aug 17 18:19:55 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:19:55 user nova-compute[72874]:       <mac address="fa:16:3e:ad:89:fe"/>
Aug 17 18:19:55 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:19:55 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:19:55 user nova-compute[72874]:       <target dev="tapa1886d6b-a2"/>
Aug 17 18:19:55 user nova-compute[72874]:     </interface>
Aug 17 18:19:55 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:19:55 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/console.log" append="off"/>
Aug 17 18:19:55 user nova-compute[72874]:     </serial>
Aug 17 18:19:55 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:19:55 user nova-compute[72874]:     <video>
Aug 17 18:19:55 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:19:55 user nova-compute[72874]:     </video>
Aug 17 18:19:55 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:19:55 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:19:55 user nova-compute[72874]:     </rng>
Aug 17 18:19:55 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:19:55 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:19:55 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:19:55 user nova-compute[72874]:     </memballoon>
Aug 17 18:19:55 user nova-compute[72874]:   </devices>
Aug 17 18:19:55 user nova-compute[72874]: </domain>
Aug 17 18:19:55 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1203647482',display_name='tempest-VolumesAdminNegativeTest-server-1203647482',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1203647482',id=12,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b3fe8a83be9b440b95aa258c4dff6af4',ramdisk_id='',reservation_id='r-nus44bud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1606846933',owner_user_name='tempest-VolumesAdminNegativeTest-1606846933-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:19:53Z,user_data=None,user_id='2f400334282b4272a8f78d682f3816d0',uuid=c9392afe-92e0-4703-bd6f-79d272d541e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1886d6b-a20c-4565-a8ef-0507787724ef", "address": "fa:16:3e:ad:89:fe", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1886d6b-a2", "ovs_interfaceid": "a1886d6b-a20c-4565-a8ef-0507787724ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Converting VIF {"id": "a1886d6b-a20c-4565-a8ef-0507787724ef", "address": "fa:16:3e:ad:89:fe", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1886d6b-a2", "ovs_interfaceid": "a1886d6b-a20c-4565-a8ef-0507787724ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:89:fe,bridge_name='br-int',has_traffic_filtering=True,id=a1886d6b-a20c-4565-a8ef-0507787724ef,network=Network(92a988c2-183c-41cc-9b97-59474938a618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1886d6b-a2') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG os_vif [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:89:fe,bridge_name='br-int',has_traffic_filtering=True,id=a1886d6b-a20c-4565-a8ef-0507787724ef,network=Network(92a988c2-183c-41cc-9b97-59474938a618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1886d6b-a2') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1886d6b-a2, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa1886d6b-a2, col_values=(('external_ids', {'iface-id': 'a1886d6b-a20c-4565-a8ef-0507787724ef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:89:fe', 'vm-uuid': 'c9392afe-92e0-4703-bd6f-79d272d541e3'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:55 user nova-compute[72874]: INFO os_vif [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:89:fe,bridge_name='br-int',has_traffic_filtering=True,id=a1886d6b-a20c-4565-a8ef-0507787724ef,network=Network(92a988c2-183c-41cc-9b97-59474938a618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1886d6b-a2')
Aug 17 18:19:55 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Instance destroyed successfully.
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.objects.instance [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lazy-loading 'resources' on Instance uuid 544005af-7312-4bd4-a086-7d255ca7c479 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] No VIF found with MAC fa:16:3e:ad:89:fe, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-631508979',display_name='tempest-VolumesAssistedSnapshotsTest-server-631508979',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-631508979',id=7,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAh2YhduJk62HtHEmK1ZDWtrHnvGoC1PTQDcSJYbapFaJv6ZeDdbcBHjok35vX4vMQjiG0vW9oA6RVOoNuRyVp4Iv+XtjHbCRU50F7PU4cZtThtw/Iv13ddIDl9uuS0iw==',key_name='tempest-keypair-1831967697',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:17:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48a69ad5e8854703abf0ec2fefbc0f49',ramdisk_id='',reservation_id='r-acqampfq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-303606809',owner_user_name='tempest-VolumesAssistedSnapshotsTest-303606809-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4e59123017b14ec6a802d6051e7c7f65',uuid=544005af-7312-4bd4-a086-7d255ca7c479,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "address": "fa:16:3e:18:f7:a8", "network": {"id": "769ce42c-9237-4e57-8e6d-e62ed20ec619", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1230971768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a69ad5e8854703abf0ec2fefbc0f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed725fd-db", "ovs_interfaceid": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Converting VIF {"id": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "address": "fa:16:3e:18:f7:a8", "network": {"id": "769ce42c-9237-4e57-8e6d-e62ed20ec619", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1230971768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.212", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48a69ad5e8854703abf0ec2fefbc0f49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfed725fd-db", "ovs_interfaceid": "fed725fd-dbf1-4c2b-bccc-5cd012a23c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:f7:a8,bridge_name='br-int',has_traffic_filtering=True,id=fed725fd-dbf1-4c2b-bccc-5cd012a23c8e,network=Network(769ce42c-9237-4e57-8e6d-e62ed20ec619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfed725fd-db') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG os_vif [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:f7:a8,bridge_name='br-int',has_traffic_filtering=True,id=fed725fd-dbf1-4c2b-bccc-5cd012a23c8e,network=Network(769ce42c-9237-4e57-8e6d-e62ed20ec619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfed725fd-db') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfed725fd-db, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Successfully updated port: d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:55 user nova-compute[72874]: INFO os_vif [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:f7:a8,bridge_name='br-int',has_traffic_filtering=True,id=fed725fd-dbf1-4c2b-bccc-5cd012a23c8e,network=Network(769ce42c-9237-4e57-8e6d-e62ed20ec619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfed725fd-db')
Aug 17 18:19:55 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Deleting instance files /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479_del
Aug 17 18:19:55 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Deletion of /opt/stack/data/nova/instances/544005af-7312-4bd4-a086-7d255ca7c479_del complete
Aug 17 18:19:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquired lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-110968fa-ffd1-4aea-bdb7-8c950c085916 req-53143be4-1894-4e1c-980b-289f63028c68 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received event network-changed-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-110968fa-ffd1-4aea-bdb7-8c950c085916 req-53143be4-1894-4e1c-980b-289f63028c68 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Refreshing instance network info cache due to event network-changed-d6319754-2bba-45a4-9db3-9fcf99c0c33c. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-110968fa-ffd1-4aea-bdb7-8c950c085916 req-53143be4-1894-4e1c-980b-289f63028c68 service nova] Acquiring lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:19:55 user nova-compute[72874]: INFO nova.compute.manager [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 17 18:19:55 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updating instance_info_cache with network_info: [{"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.neutron [req-91228a08-8afe-481b-af10-7aa1c7af364b req-abfaa75d-9a08-413e-9cd6-201f0ad7b833 service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Updated VIF entry in instance network info cache for port a1886d6b-a20c-4565-a8ef-0507787724ef. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.neutron [req-91228a08-8afe-481b-af10-7aa1c7af364b req-abfaa75d-9a08-413e-9cd6-201f0ad7b833 service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Updating instance_info_cache with network_info: [{"id": "a1886d6b-a20c-4565-a8ef-0507787724ef", "address": "fa:16:3e:ad:89:fe", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1886d6b-a2", "ovs_interfaceid": "a1886d6b-a20c-4565-a8ef-0507787724ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Releasing lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Instance network_info: |[{"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-110968fa-ffd1-4aea-bdb7-8c950c085916 req-53143be4-1894-4e1c-980b-289f63028c68 service nova] Acquired lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.neutron [req-110968fa-ffd1-4aea-bdb7-8c950c085916 req-53143be4-1894-4e1c-980b-289f63028c68 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Refreshing network info cache for port d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Start _get_guest_xml network_info=[{"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-91228a08-8afe-481b-af10-7aa1c7af364b req-abfaa75d-9a08-413e-9cd6-201f0ad7b833 service nova] Releasing lock "refresh_cache-c9392afe-92e0-4703-bd6f-79d272d541e3" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:19:55 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:19:55 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1594135899',display_name='tempest-ServerActionsTestOtherB-server-1594135899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1594135899',id=13,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJL0wGDO9yYxM59zaPj86jL9bZvPsFDy3YJOsbSwVi+3h9+DinmjEtIZue1FvAOYIc54lSepvgAxdfqkbFKLJ90/SAHzFU18VdJmA0Lh/YqOsAztJ9gMRfqGTMWDprprBA==',key_name='tempest-keypair-1720427808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad9005fd344e470482b0b90baeb97515',ramdisk_id='',reservation_id='r-5cqpdw10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1909498304',owner_user_name='tempest-ServerActionsTestOtherB-1909498304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31f7828a072847dc9cb4d4fd51908366',uuid=2ace97e1-c2ee-462e-a929-22c7cb2584d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converting VIF {"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.objects.instance [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ace97e1-c2ee-462e-a929-22c7cb2584d2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:19:55 user nova-compute[72874]:   <uuid>2ace97e1-c2ee-462e-a929-22c7cb2584d2</uuid>
Aug 17 18:19:55 user nova-compute[72874]:   <name>instance-0000000d</name>
Aug 17 18:19:55 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:19:55 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:19:55 user nova-compute[72874]:   <metadata>
Aug 17 18:19:55 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:19:55 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:19:55 user nova-compute[72874]:       <nova:name>tempest-ServerActionsTestOtherB-server-1594135899</nova:name>
Aug 17 18:19:55 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:19:55</nova:creationTime>
Aug 17 18:19:55 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:19:55 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:19:55 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:19:55 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:19:55 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:19:55 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:19:55 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:19:55 user nova-compute[72874]:       <nova:owner>
Aug 17 18:19:55 user nova-compute[72874]:         <nova:user uuid="31f7828a072847dc9cb4d4fd51908366">tempest-ServerActionsTestOtherB-1909498304-project-member</nova:user>
Aug 17 18:19:55 user nova-compute[72874]:         <nova:project uuid="ad9005fd344e470482b0b90baeb97515">tempest-ServerActionsTestOtherB-1909498304</nova:project>
Aug 17 18:19:55 user nova-compute[72874]:       </nova:owner>
Aug 17 18:19:55 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:19:55 user nova-compute[72874]:       <nova:ports>
Aug 17 18:19:55 user nova-compute[72874]:         <nova:port uuid="d6319754-2bba-45a4-9db3-9fcf99c0c33c">
Aug 17 18:19:55 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 18:19:55 user nova-compute[72874]:         </nova:port>
Aug 17 18:19:55 user nova-compute[72874]:       </nova:ports>
Aug 17 18:19:55 user nova-compute[72874]:     </nova:instance>
Aug 17 18:19:55 user nova-compute[72874]:   </metadata>
Aug 17 18:19:55 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:19:55 user nova-compute[72874]:     <system>
Aug 17 18:19:55 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:19:55 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:19:55 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:19:55 user nova-compute[72874]:       <entry name="serial">2ace97e1-c2ee-462e-a929-22c7cb2584d2</entry>
Aug 17 18:19:55 user nova-compute[72874]:       <entry name="uuid">2ace97e1-c2ee-462e-a929-22c7cb2584d2</entry>
Aug 17 18:19:55 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:19:55 user nova-compute[72874]:     </system>
Aug 17 18:19:55 user nova-compute[72874]:   </sysinfo>
Aug 17 18:19:55 user nova-compute[72874]:   <os>
Aug 17 18:19:55 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:19:55 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:19:55 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:19:55 user nova-compute[72874]:   </os>
Aug 17 18:19:55 user nova-compute[72874]:   <features>
Aug 17 18:19:55 user nova-compute[72874]:     <acpi/>
Aug 17 18:19:55 user nova-compute[72874]:     <apic/>
Aug 17 18:19:55 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:19:55 user nova-compute[72874]:   </features>
Aug 17 18:19:55 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:19:55 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:19:55 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:19:55 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:19:55 user nova-compute[72874]:   </clock>
Aug 17 18:19:55 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:19:55 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:19:55 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:19:55 user nova-compute[72874]:   </cpu>
Aug 17 18:19:55 user nova-compute[72874]:   <devices>
Aug 17 18:19:55 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:19:55 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:19:55 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk"/>
Aug 17 18:19:55 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:19:55 user nova-compute[72874]:     </disk>
Aug 17 18:19:55 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:19:55 user nova-compute[72874]:       <mac address="fa:16:3e:80:58:cc"/>
Aug 17 18:19:55 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:19:55 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:19:55 user nova-compute[72874]:       <target dev="tapd6319754-2b"/>
Aug 17 18:19:55 user nova-compute[72874]:     </interface>
Aug 17 18:19:55 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:19:55 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/console.log" append="off"/>
Aug 17 18:19:55 user nova-compute[72874]:     </serial>
Aug 17 18:19:55 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:19:55 user nova-compute[72874]:     <video>
Aug 17 18:19:55 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:19:55 user nova-compute[72874]:     </video>
Aug 17 18:19:55 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:19:55 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:19:55 user nova-compute[72874]:     </rng>
Aug 17 18:19:55 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:19:55 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:19:55 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:19:55 user nova-compute[72874]:     </memballoon>
Aug 17 18:19:55 user nova-compute[72874]:   </devices>
Aug 17 18:19:55 user nova-compute[72874]: </domain>
Aug 17 18:19:55 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1594135899',display_name='tempest-ServerActionsTestOtherB-server-1594135899',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1594135899',id=13,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJL0wGDO9yYxM59zaPj86jL9bZvPsFDy3YJOsbSwVi+3h9+DinmjEtIZue1FvAOYIc54lSepvgAxdfqkbFKLJ90/SAHzFU18VdJmA0Lh/YqOsAztJ9gMRfqGTMWDprprBA==',key_name='tempest-keypair-1720427808',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ad9005fd344e470482b0b90baeb97515',ramdisk_id='',reservation_id='r-5cqpdw10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1909498304',owner_user_name='tempest-ServerActionsTestOtherB-1909498304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:19:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31f7828a072847dc9cb4d4fd51908366',uuid=2ace97e1-c2ee-462e-a929-22c7cb2584d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converting VIF {"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG os_vif [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6319754-2b, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6319754-2b, col_values=(('external_ids', {'iface-id': 'd6319754-2bba-45a4-9db3-9fcf99c0c33c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:58:cc', 'vm-uuid': '2ace97e1-c2ee-462e-a929-22c7cb2584d2'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:55 user nova-compute[72874]: INFO os_vif [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b')
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:19:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] No VIF found with MAC fa:16:3e:80:58:cc, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:19:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-75a5414e-4616-4b5b-9349-875b12416fd7 req-bfe23d0e-ed66-4690-b958-5b473245d4bd service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Received event network-vif-unplugged-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-75a5414e-4616-4b5b-9349-875b12416fd7 req-bfe23d0e-ed66-4690-b958-5b473245d4bd service nova] Acquiring lock "544005af-7312-4bd4-a086-7d255ca7c479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-75a5414e-4616-4b5b-9349-875b12416fd7 req-bfe23d0e-ed66-4690-b958-5b473245d4bd service nova] Lock "544005af-7312-4bd4-a086-7d255ca7c479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-75a5414e-4616-4b5b-9349-875b12416fd7 req-bfe23d0e-ed66-4690-b958-5b473245d4bd service nova] Lock "544005af-7312-4bd4-a086-7d255ca7c479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-75a5414e-4616-4b5b-9349-875b12416fd7 req-bfe23d0e-ed66-4690-b958-5b473245d4bd service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] No waiting events found dispatching network-vif-unplugged-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-75a5414e-4616-4b5b-9349-875b12416fd7 req-bfe23d0e-ed66-4690-b958-5b473245d4bd service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Received event network-vif-unplugged-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:19:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-75a5414e-4616-4b5b-9349-875b12416fd7 req-bfe23d0e-ed66-4690-b958-5b473245d4bd service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Received event network-vif-plugged-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-75a5414e-4616-4b5b-9349-875b12416fd7 req-bfe23d0e-ed66-4690-b958-5b473245d4bd service nova] Acquiring lock "544005af-7312-4bd4-a086-7d255ca7c479-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-75a5414e-4616-4b5b-9349-875b12416fd7 req-bfe23d0e-ed66-4690-b958-5b473245d4bd service nova] Lock "544005af-7312-4bd4-a086-7d255ca7c479-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-75a5414e-4616-4b5b-9349-875b12416fd7 req-bfe23d0e-ed66-4690-b958-5b473245d4bd service nova] Lock "544005af-7312-4bd4-a086-7d255ca7c479-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-75a5414e-4616-4b5b-9349-875b12416fd7 req-bfe23d0e-ed66-4690-b958-5b473245d4bd service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] No waiting events found dispatching network-vif-plugged-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:56 user nova-compute[72874]: WARNING nova.compute.manager [req-75a5414e-4616-4b5b-9349-875b12416fd7 req-bfe23d0e-ed66-4690-b958-5b473245d4bd service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Received unexpected event network-vif-plugged-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e for instance with vm_state active and task_state deleting.
Aug 17 18:19:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:57 user nova-compute[72874]: DEBUG nova.network.neutron [req-110968fa-ffd1-4aea-bdb7-8c950c085916 req-53143be4-1894-4e1c-980b-289f63028c68 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updated VIF entry in instance network info cache for port d6319754-2bba-45a4-9db3-9fcf99c0c33c. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:19:57 user nova-compute[72874]: DEBUG nova.network.neutron [req-110968fa-ffd1-4aea-bdb7-8c950c085916 req-53143be4-1894-4e1c-980b-289f63028c68 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updating instance_info_cache with network_info: [{"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:19:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-110968fa-ffd1-4aea-bdb7-8c950c085916 req-53143be4-1894-4e1c-980b-289f63028c68 service nova] Releasing lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:19:57 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:19:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-12477070-f846-4200-972c-1583ec0d7387 req-27a018ac-7287-4a0d-90e1-438be8db0190 service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Received event network-vif-plugged-a1886d6b-a20c-4565-a8ef-0507787724ef {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-12477070-f846-4200-972c-1583ec0d7387 req-27a018ac-7287-4a0d-90e1-438be8db0190 service nova] Acquiring lock "c9392afe-92e0-4703-bd6f-79d272d541e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-12477070-f846-4200-972c-1583ec0d7387 req-27a018ac-7287-4a0d-90e1-438be8db0190 service nova] Lock "c9392afe-92e0-4703-bd6f-79d272d541e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-12477070-f846-4200-972c-1583ec0d7387 req-27a018ac-7287-4a0d-90e1-438be8db0190 service nova] Lock "c9392afe-92e0-4703-bd6f-79d272d541e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-12477070-f846-4200-972c-1583ec0d7387 req-27a018ac-7287-4a0d-90e1-438be8db0190 service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] No waiting events found dispatching network-vif-plugged-a1886d6b-a20c-4565-a8ef-0507787724ef {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:57 user nova-compute[72874]: WARNING nova.compute.manager [req-12477070-f846-4200-972c-1583ec0d7387 req-27a018ac-7287-4a0d-90e1-438be8db0190 service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Received unexpected event network-vif-plugged-a1886d6b-a20c-4565-a8ef-0507787724ef for instance with vm_state building and task_state spawning.
Aug 17 18:19:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:57 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Took 1.95 seconds to deallocate network for instance.
Aug 17 18:19:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:57 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:19:57 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:19:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:57 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Deleted allocations for instance 544005af-7312-4bd4-a086-7d255ca7c479
Aug 17 18:19:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9f4bdc93-f8c8-4794-8bd5-63a9fea762b6 tempest-VolumesAssistedSnapshotsTest-303606809 tempest-VolumesAssistedSnapshotsTest-303606809-project-member] Lock "544005af-7312-4bd4-a086-7d255ca7c479" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.536s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-35b35253-d9b8-4172-ae69-0a91acf8f8bd req-d27561d4-8765-48d0-bda9-8991c41fad50 service nova] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Received event network-vif-deleted-fed725fd-dbf1-4c2b-bccc-5cd012a23c8e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:19:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Received event network-vif-plugged-a1886d6b-a20c-4565-a8ef-0507787724ef {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] Acquiring lock "c9392afe-92e0-4703-bd6f-79d272d541e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] Lock "c9392afe-92e0-4703-bd6f-79d272d541e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] Lock "c9392afe-92e0-4703-bd6f-79d272d541e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] No waiting events found dispatching network-vif-plugged-a1886d6b-a20c-4565-a8ef-0507787724ef {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:59 user nova-compute[72874]: WARNING nova.compute.manager [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Received unexpected event network-vif-plugged-a1886d6b-a20c-4565-a8ef-0507787724ef for instance with vm_state building and task_state spawning.
Aug 17 18:19:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] No waiting events found dispatching network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:59 user nova-compute[72874]: WARNING nova.compute.manager [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received unexpected event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c for instance with vm_state building and task_state spawning.
Aug 17 18:19:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:19:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:19:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:19:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:19:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] No waiting events found dispatching network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:19:59 user nova-compute[72874]: WARNING nova.compute.manager [req-4f1c9e01-5701-4ca8-85c2-282df633a8a3 req-c932c559-7cd2-4573-8ebb-6bbc9d4f05cd service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received unexpected event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c for instance with vm_state building and task_state spawning.
Aug 17 18:19:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296400.8489106, c9392afe-92e0-4703-bd6f-79d272d541e3 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:20:00 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] VM Resumed (Lifecycle Event)
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:20:00 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Instance spawned successfully.
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:20:00 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296400.852456, c9392afe-92e0-4703-bd6f-79d272d541e3 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:20:00 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] VM Started (Lifecycle Event)
Aug 17 18:20:00 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Instance spawned successfully.
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:00 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296400.8975103, 2ace97e1-c2ee-462e-a929-22c7cb2584d2 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:20:00 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] VM Resumed (Lifecycle Event)
Aug 17 18:20:00 user nova-compute[72874]: INFO nova.compute.manager [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Took 8.17 seconds to spawn the instance on the hypervisor.
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:20:01 user nova-compute[72874]: INFO nova.compute.manager [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Took 7.55 seconds to spawn the instance on the hypervisor.
Aug 17 18:20:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:01 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:20:01 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296400.8985443, 2ace97e1-c2ee-462e-a929-22c7cb2584d2 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:20:01 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] VM Started (Lifecycle Event)
Aug 17 18:20:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:20:01 user nova-compute[72874]: INFO nova.compute.manager [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Took 9.08 seconds to build instance.
Aug 17 18:20:01 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:20:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-49901d89-cbb5-4865-b3f2-338ff4381838 tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "c9392afe-92e0-4703-bd6f-79d272d541e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.216s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:01 user nova-compute[72874]: INFO nova.compute.manager [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Took 8.88 seconds to build instance.
Aug 17 18:20:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ffe57511-4524-4b63-a768-bce7bac50035 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.990s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "f027045c-d121-45ec-af61-e1a2399c4a43" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG nova.objects.instance [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lazy-loading 'flavor' on Instance uuid f027045c-d121-45ec-af61-e1a2399c4a43 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "f027045c-d121-45ec-af61-e1a2399c4a43" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "f027045c-d121-45ec-af61-e1a2399c4a43" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:07 user nova-compute[72874]: INFO nova.compute.manager [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Attaching volume caba3b52-d6d2-42de-ad5c-c7501d2aab3b to /dev/vdb
Aug 17 18:20:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG os_brick.utils [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3de1fb-e363-47da-9c29-5621395ae461]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe7e027-b84c-4fdd-8838-5b0e9a3c2d70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2220d8c5-50c2-4d32-ac0b-bc0ac0fe250a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b504a461-6017-4ca3-9a13-38f8cca4f526]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:20:07 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:20:07 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f7381a-1b39-41a6-920b-d6fdffd72a0d]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG os_brick.utils [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:20:07 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updating existing volume attachment record: da8e6879-2fbe-43dc-baa5-46a015dc8db6 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:20:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:20:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:09 user nova-compute[72874]: INFO nova.compute.manager [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Unshelving
Aug 17 18:20:10 user nova-compute[72874]: INFO nova.virt.block_device [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Booting with volume c387b29c-dd79-49d3-b1e0-542036eecbc7 at /dev/vdc
Aug 17 18:20:10 user nova-compute[72874]: DEBUG os_brick.utils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc36ceb4-b8d3-44c3-8ed8-3d298c3d7823]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8755b8b-d813-4c2c-9708-4f79b3409a8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67a0bcb-3b40-406d-a492-ecb9b37db9b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c479a6-6d3f-48f8-91ea-935ef287fc99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:20:10 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5a7787-f5d1-4119-8a81-9d561c2461fb]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG os_brick.utils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Updating existing volume attachment record: 5e2a8a3e-021a-451a-8928-d0d8dea51220 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296395.2248366, 544005af-7312-4bd4-a086-7d255ca7c479 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:20:10 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] VM Stopped (Lifecycle Event)
Aug 17 18:20:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e0f47565-e587-4a8b-955a-2a0730c2be4a None None] [instance: 544005af-7312-4bd4-a086-7d255ca7c479] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:11 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:20:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:13 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:20:13 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:20:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7743MB free_disk=25.671798706054688GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:20:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance f027045c-d121-45ec-af61-e1a2399c4a43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:20:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:20:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c2eb160-5b94-4d53-bd36-b712c62d9100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:20:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:20:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 7c486f7d-bcad-4c83-98bf-f08559259d33 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:20:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance c9392afe-92e0-4703-bd6f-79d272d541e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:20:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2ace97e1-c2ee-462e-a929-22c7cb2584d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:20:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance c27fc8b6-cc8c-426a-859d-04722c569cd4 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 17 18:20:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:20:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:20:14 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:20:14 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:20:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:20:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.662s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:15 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:20:15 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:20:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:15 user nova-compute[72874]: DEBUG nova.compute.manager [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:20:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:20:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:20:15 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:20:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:15 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:20:15 user nova-compute[72874]: INFO nova.compute.claims [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Claim successful on node user
Aug 17 18:20:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.676s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG nova.network.neutron [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:20:16 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:20:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Updating instance_info_cache with network_info: [{"id": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "address": "fa:16:3e:3a:30:bb", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17265426-d5", "ovs_interfaceid": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG nova.policy [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aaaa47a37543427eaa1712d29c419dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa04d3ed68a4542b32e2efeca25222a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:20:16 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Creating image(s)
Aug 17 18:20:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "/opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "/opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.205s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.190s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk 1073741824" returned: 0 in 0.055s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.261s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG nova.network.neutron [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Successfully created port: fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Cannot resize image /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG nova.objects.instance [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'migration_context' on Instance uuid 3a2a5fdd-3a21-413b-981a-ecc33051c87b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Ensure instance console log exists: /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:18 user nova-compute[72874]: DEBUG nova.network.neutron [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Successfully updated port: fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:20:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "refresh_cache-3a2a5fdd-3a21-413b-981a-ecc33051c87b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:20:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquired lock "refresh_cache-3a2a5fdd-3a21-413b-981a-ecc33051c87b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:20:18 user nova-compute[72874]: DEBUG nova.network.neutron [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:20:18 user nova-compute[72874]: DEBUG nova.compute.manager [req-bbef09b2-77c3-416d-9b5d-80fb29fc4cde req-dd000762-366b-4d29-be92-8ed3f79b6326 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received event network-changed-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:20:18 user nova-compute[72874]: DEBUG nova.compute.manager [req-bbef09b2-77c3-416d-9b5d-80fb29fc4cde req-dd000762-366b-4d29-be92-8ed3f79b6326 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Refreshing instance network info cache due to event network-changed-fd5a0e28-4b48-4668-b9d6-2108a63c618f. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:20:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bbef09b2-77c3-416d-9b5d-80fb29fc4cde req-dd000762-366b-4d29-be92-8ed3f79b6326 service nova] Acquiring lock "refresh_cache-3a2a5fdd-3a21-413b-981a-ecc33051c87b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:20:18 user nova-compute[72874]: DEBUG nova.network.neutron [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.network.neutron [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Updating instance_info_cache with network_info: [{"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Releasing lock "refresh_cache-3a2a5fdd-3a21-413b-981a-ecc33051c87b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.compute.manager [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Instance network_info: |[{"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bbef09b2-77c3-416d-9b5d-80fb29fc4cde req-dd000762-366b-4d29-be92-8ed3f79b6326 service nova] Acquired lock "refresh_cache-3a2a5fdd-3a21-413b-981a-ecc33051c87b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.network.neutron [req-bbef09b2-77c3-416d-9b5d-80fb29fc4cde req-dd000762-366b-4d29-be92-8ed3f79b6326 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Refreshing network info cache for port fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Start _get_guest_xml network_info=[{"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:20:19 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:20:19 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1964684843',display_name='tempest-tempest.common.compute-instance-1964684843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1964684843',id=14,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMpdpfwA+5BzocXAcrapnfCncndWRFtxZCCWpFGlZmI4prUOsZ4cc20CF7Cba6pgb2rHGqRdFOT249RYmqz/f4penXjArDXnxaMRBbAPn+IOmceDrtZRM7Mttzd+GNOXw==',key_name='tempest-keypair-1182001619',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4aa04d3ed68a4542b32e2efeca25222a',ramdisk_id='',reservation_id='r-f8meq89l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1332351935',owner_user_name='tempest-ServerActionsTestOtherA-1332351935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:20:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaaa47a37543427eaa1712d29c419dd9',uuid=3a2a5fdd-3a21-413b-981a-ecc33051c87b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converting VIF {"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=fd5a0e28-4b48-4668-b9d6-2108a63c618f,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5a0e28-4b') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.objects.instance [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a2a5fdd-3a21-413b-981a-ecc33051c87b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:20:19 user nova-compute[72874]:   <uuid>3a2a5fdd-3a21-413b-981a-ecc33051c87b</uuid>
Aug 17 18:20:19 user nova-compute[72874]:   <name>instance-0000000e</name>
Aug 17 18:20:19 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:20:19 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:20:19 user nova-compute[72874]:   <metadata>
Aug 17 18:20:19 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:20:19 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:20:19 user nova-compute[72874]:       <nova:name>tempest-tempest.common.compute-instance-1964684843</nova:name>
Aug 17 18:20:19 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:20:19</nova:creationTime>
Aug 17 18:20:19 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:20:19 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:20:19 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:20:19 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:20:19 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:20:19 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:20:19 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:20:19 user nova-compute[72874]:       <nova:owner>
Aug 17 18:20:19 user nova-compute[72874]:         <nova:user uuid="aaaa47a37543427eaa1712d29c419dd9">tempest-ServerActionsTestOtherA-1332351935-project-member</nova:user>
Aug 17 18:20:19 user nova-compute[72874]:         <nova:project uuid="4aa04d3ed68a4542b32e2efeca25222a">tempest-ServerActionsTestOtherA-1332351935</nova:project>
Aug 17 18:20:19 user nova-compute[72874]:       </nova:owner>
Aug 17 18:20:19 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:20:19 user nova-compute[72874]:       <nova:ports>
Aug 17 18:20:19 user nova-compute[72874]:         <nova:port uuid="fd5a0e28-4b48-4668-b9d6-2108a63c618f">
Aug 17 18:20:19 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 18:20:19 user nova-compute[72874]:         </nova:port>
Aug 17 18:20:19 user nova-compute[72874]:       </nova:ports>
Aug 17 18:20:19 user nova-compute[72874]:     </nova:instance>
Aug 17 18:20:19 user nova-compute[72874]:   </metadata>
Aug 17 18:20:19 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:20:19 user nova-compute[72874]:     <system>
Aug 17 18:20:19 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:20:19 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:20:19 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:20:19 user nova-compute[72874]:       <entry name="serial">3a2a5fdd-3a21-413b-981a-ecc33051c87b</entry>
Aug 17 18:20:19 user nova-compute[72874]:       <entry name="uuid">3a2a5fdd-3a21-413b-981a-ecc33051c87b</entry>
Aug 17 18:20:19 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:20:19 user nova-compute[72874]:     </system>
Aug 17 18:20:19 user nova-compute[72874]:   </sysinfo>
Aug 17 18:20:19 user nova-compute[72874]:   <os>
Aug 17 18:20:19 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:20:19 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:20:19 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:20:19 user nova-compute[72874]:   </os>
Aug 17 18:20:19 user nova-compute[72874]:   <features>
Aug 17 18:20:19 user nova-compute[72874]:     <acpi/>
Aug 17 18:20:19 user nova-compute[72874]:     <apic/>
Aug 17 18:20:19 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:20:19 user nova-compute[72874]:   </features>
Aug 17 18:20:19 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:20:19 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:20:19 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:20:19 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:20:19 user nova-compute[72874]:   </clock>
Aug 17 18:20:19 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:20:19 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:20:19 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:20:19 user nova-compute[72874]:   </cpu>
Aug 17 18:20:19 user nova-compute[72874]:   <devices>
Aug 17 18:20:19 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:20:19 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:20:19 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk"/>
Aug 17 18:20:19 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:20:19 user nova-compute[72874]:     </disk>
Aug 17 18:20:19 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:20:19 user nova-compute[72874]:       <mac address="fa:16:3e:15:fc:2c"/>
Aug 17 18:20:19 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:20:19 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:20:19 user nova-compute[72874]:       <target dev="tapfd5a0e28-4b"/>
Aug 17 18:20:19 user nova-compute[72874]:     </interface>
Aug 17 18:20:19 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:20:19 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/console.log" append="off"/>
Aug 17 18:20:19 user nova-compute[72874]:     </serial>
Aug 17 18:20:19 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:20:19 user nova-compute[72874]:     <video>
Aug 17 18:20:19 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:20:19 user nova-compute[72874]:     </video>
Aug 17 18:20:19 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:20:19 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:20:19 user nova-compute[72874]:     </rng>
Aug 17 18:20:19 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:20:19 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:20:19 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:20:19 user nova-compute[72874]:     </memballoon>
Aug 17 18:20:19 user nova-compute[72874]:   </devices>
Aug 17 18:20:19 user nova-compute[72874]: </domain>
Aug 17 18:20:19 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1964684843',display_name='tempest-tempest.common.compute-instance-1964684843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1964684843',id=14,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMpdpfwA+5BzocXAcrapnfCncndWRFtxZCCWpFGlZmI4prUOsZ4cc20CF7Cba6pgb2rHGqRdFOT249RYmqz/f4penXjArDXnxaMRBbAPn+IOmceDrtZRM7Mttzd+GNOXw==',key_name='tempest-keypair-1182001619',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4aa04d3ed68a4542b32e2efeca25222a',ramdisk_id='',reservation_id='r-f8meq89l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1332351935',owner_user_name='tempest-ServerActionsTestOtherA-1332351935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:20:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaaa47a37543427eaa1712d29c419dd9',uuid=3a2a5fdd-3a21-413b-981a-ecc33051c87b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converting VIF {"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=fd5a0e28-4b48-4668-b9d6-2108a63c618f,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5a0e28-4b') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG os_vif [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=fd5a0e28-4b48-4668-b9d6-2108a63c618f,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5a0e28-4b') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd5a0e28-4b, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd5a0e28-4b, col_values=(('external_ids', {'iface-id': 'fd5a0e28-4b48-4668-b9d6-2108a63c618f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:fc:2c', 'vm-uuid': '3a2a5fdd-3a21-413b-981a-ecc33051c87b'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:19 user nova-compute[72874]: INFO os_vif [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=fd5a0e28-4b48-4668-b9d6-2108a63c618f,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5a0e28-4b')
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] No VIF found with MAC fa:16:3e:15:fc:2c, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.network.neutron [req-bbef09b2-77c3-416d-9b5d-80fb29fc4cde req-dd000762-366b-4d29-be92-8ed3f79b6326 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Updated VIF entry in instance network info cache for port fd5a0e28-4b48-4668-b9d6-2108a63c618f. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG nova.network.neutron [req-bbef09b2-77c3-416d-9b5d-80fb29fc4cde req-dd000762-366b-4d29-be92-8ed3f79b6326 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Updating instance_info_cache with network_info: [{"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:20:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bbef09b2-77c3-416d-9b5d-80fb29fc4cde req-dd000762-366b-4d29-be92-8ed3f79b6326 service nova] Releasing lock "refresh_cache-3a2a5fdd-3a21-413b-981a-ecc33051c87b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:20:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGRYpTgL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:20:21 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:20:21 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:20:21 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fec8c99-4ad4-47ac-b67c-29466a656c9f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:20:21 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c9066a-e200-44da-8b27-a96b8057a056]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b] added
Aug 17 18:20:21 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd730fa-5a31-4f6f-a76b-62a0e12f9969]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8146795-1bd8-4687-8215-c9e27bdc24fa]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lGRYpTgL {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG nova.compute.manager [req-71833396-a1f6-48c5-b4ef-d49370168444 req-b6215f76-5d2b-4839-8a19-8c9f2d05c2f3 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received event network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-71833396-a1f6-48c5-b4ef-d49370168444 req-b6215f76-5d2b-4839-8a19-8c9f2d05c2f3 service nova] Acquiring lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-71833396-a1f6-48c5-b4ef-d49370168444 req-b6215f76-5d2b-4839-8a19-8c9f2d05c2f3 service nova] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-71833396-a1f6-48c5-b4ef-d49370168444 req-b6215f76-5d2b-4839-8a19-8c9f2d05c2f3 service nova] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG nova.compute.manager [req-71833396-a1f6-48c5-b4ef-d49370168444 req-b6215f76-5d2b-4839-8a19-8c9f2d05c2f3 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] No waiting events found dispatching network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:20:21 user nova-compute[72874]: WARNING nova.compute.manager [req-71833396-a1f6-48c5-b4ef-d49370168444 req-b6215f76-5d2b-4839-8a19-8c9f2d05c2f3 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received unexpected event network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f for instance with vm_state building and task_state spawning.
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lGRYpTgL" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7b0d6b-2113-450d-8e8d-60ede3c0236d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lGRYpTgL'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8e451d-b29f-4536-9ad8-12f7ed94bd44]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2370c6-a659-4911-b8c4-9e5d53169ba1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:20:21 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:20:21 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[23087d9e-732d-4567-858f-69b6e23d033e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b, portal: 172.16.0.220,3260]
Aug 17 18:20:21 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b, portal: 172.16.0.220,3260] successful.
Aug 17 18:20:21 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.097s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84dcdde-2334-4938-a053-648e49e707fc]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[70839a2c-84a9-441f-b965-130b3e084297]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:20:21 user nova-compute[72874]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:20:21 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:20:21 user nova-compute[72874]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:20:21 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df302e0-d5ea-4998-91b5-2cd9e93b309b]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:20:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGRYpTgL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:20:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:20:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '26166366664623734', 'path': '/dev/sdc'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:20:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166366664623734', 'path': '/dev/sdc'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:20:22 user nova-compute[72874]: DEBUG nova.objects.instance [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lazy-loading 'flavor' on Instance uuid f027045c-d121-45ec-af61-e1a2399c4a43 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:20:22 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:20:22 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:20:22 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:20:22 user nova-compute[72874]:   <serial>caba3b52-d6d2-42de-ad5c-c7501d2aab3b</serial>
Aug 17 18:20:22 user nova-compute[72874]: </disk>
Aug 17 18:20:22 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] No VIF found with MAC fa:16:3e:50:ac:00, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-31745b21-d130-4fa0-be0b-1d283b66d9a8 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "f027045c-d121-45ec-af61-e1a2399c4a43" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.825s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.compute.manager [req-ca71f6e6-2ef2-4e70-a5cd-f4169ca6c90b req-44a679e3-1c57-4f12-8099-5bf9f943b722 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received event network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ca71f6e6-2ef2-4e70-a5cd-f4169ca6c90b req-44a679e3-1c57-4f12-8099-5bf9f943b722 service nova] Acquiring lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ca71f6e6-2ef2-4e70-a5cd-f4169ca6c90b req-44a679e3-1c57-4f12-8099-5bf9f943b722 service nova] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ca71f6e6-2ef2-4e70-a5cd-f4169ca6c90b req-44a679e3-1c57-4f12-8099-5bf9f943b722 service nova] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.compute.manager [req-ca71f6e6-2ef2-4e70-a5cd-f4169ca6c90b req-44a679e3-1c57-4f12-8099-5bf9f943b722 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] No waiting events found dispatching network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:20:23 user nova-compute[72874]: WARNING nova.compute.manager [req-ca71f6e6-2ef2-4e70-a5cd-f4169ca6c90b req-44a679e3-1c57-4f12-8099-5bf9f943b722 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received unexpected event network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f for instance with vm_state building and task_state spawning.
Aug 17 18:20:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.objects.instance [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'pci_requests' on Instance uuid c27fc8b6-cc8c-426a-859d-04722c569cd4 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.objects.instance [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'numa_topology' on Instance uuid c27fc8b6-cc8c-426a-859d-04722c569cd4 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:20:23 user nova-compute[72874]: INFO nova.compute.claims [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Claim successful on node user
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296423.4094, 3a2a5fdd-3a21-413b-981a-ecc33051c87b => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:20:23 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] VM Resumed (Lifecycle Event)
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:20:23 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Instance spawned successfully.
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:20:23 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296423.4164898, 3a2a5fdd-3a21-413b-981a-ecc33051c87b => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:20:23 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] VM Started (Lifecycle Event)
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:20:23 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:20:23 user nova-compute[72874]: INFO nova.compute.manager [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Took 6.86 seconds to spawn the instance on the hypervisor.
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:23 user nova-compute[72874]: INFO nova.compute.manager [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Took 8.08 seconds to build instance.
Aug 17 18:20:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f2e862e5-fb24-4c62-97cd-e240feda4edb tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.253s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:20:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:23 user nova-compute[72874]: INFO nova.network.neutron [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Updating port 63ec6fca-872d-4e61-b76a-c39215266088 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 18:20:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:24 user nova-compute[72874]: INFO nova.compute.manager [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Rescuing
Aug 17 18:20:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:20:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquired lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:20:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:20:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:20:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquired lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:20:25 user nova-compute[72874]: DEBUG nova.network.neutron [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:20:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-4d1eeaa7-cf5b-45b6-aef2-8ec4c378849d req-e2441dae-c27f-4268-b089-86ebb231dc41 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received event network-changed-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:20:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-4d1eeaa7-cf5b-45b6-aef2-8ec4c378849d req-e2441dae-c27f-4268-b089-86ebb231dc41 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Refreshing instance network info cache due to event network-changed-63ec6fca-872d-4e61-b76a-c39215266088. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:20:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4d1eeaa7-cf5b-45b6-aef2-8ec4c378849d req-e2441dae-c27f-4268-b089-86ebb231dc41 service nova] Acquiring lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:20:25 user nova-compute[72874]: DEBUG nova.network.neutron [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updating instance_info_cache with network_info: [{"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:20:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Releasing lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:20:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:26 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Instance destroyed successfully.
Aug 17 18:20:26 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Attempting a stable device rescue
Aug 17 18:20:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72874) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 18:20:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Instance directory exists: not creating {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 18:20:26 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Creating image(s)
Aug 17 18:20:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "/opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "/opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "/opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:26 user nova-compute[72874]: DEBUG nova.objects.instance [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lazy-loading 'trusted_certs' on Instance uuid f027045c-d121-45ec-af61-e1a2399c4a43 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "050cf5fc9e6e604ccfa1aed447e3473b1b937429" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "050cf5fc9e6e604ccfa1aed447e3473b1b937429" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/050cf5fc9e6e604ccfa1aed447e3473b1b937429.part --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG nova.network.neutron [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Updating instance_info_cache with network_info: [{"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG nova.compute.manager [req-3ff15b2f-3e36-447f-87b5-8c8a8920afdc req-4750eeb2-c747-4ef5-bf7e-76016429dec2 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-unplugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3ff15b2f-3e36-447f-87b5-8c8a8920afdc req-4750eeb2-c747-4ef5-bf7e-76016429dec2 service nova] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3ff15b2f-3e36-447f-87b5-8c8a8920afdc req-4750eeb2-c747-4ef5-bf7e-76016429dec2 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3ff15b2f-3e36-447f-87b5-8c8a8920afdc req-4750eeb2-c747-4ef5-bf7e-76016429dec2 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG nova.compute.manager [req-3ff15b2f-3e36-447f-87b5-8c8a8920afdc req-4750eeb2-c747-4ef5-bf7e-76016429dec2 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] No waiting events found dispatching network-vif-unplugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:20:28 user nova-compute[72874]: WARNING nova.compute.manager [req-3ff15b2f-3e36-447f-87b5-8c8a8920afdc req-4750eeb2-c747-4ef5-bf7e-76016429dec2 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received unexpected event network-vif-unplugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae for instance with vm_state active and task_state rescuing.
Aug 17 18:20:28 user nova-compute[72874]: DEBUG nova.compute.manager [req-3ff15b2f-3e36-447f-87b5-8c8a8920afdc req-4750eeb2-c747-4ef5-bf7e-76016429dec2 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3ff15b2f-3e36-447f-87b5-8c8a8920afdc req-4750eeb2-c747-4ef5-bf7e-76016429dec2 service nova] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3ff15b2f-3e36-447f-87b5-8c8a8920afdc req-4750eeb2-c747-4ef5-bf7e-76016429dec2 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3ff15b2f-3e36-447f-87b5-8c8a8920afdc req-4750eeb2-c747-4ef5-bf7e-76016429dec2 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG nova.compute.manager [req-3ff15b2f-3e36-447f-87b5-8c8a8920afdc req-4750eeb2-c747-4ef5-bf7e-76016429dec2 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] No waiting events found dispatching network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:20:28 user nova-compute[72874]: WARNING nova.compute.manager [req-3ff15b2f-3e36-447f-87b5-8c8a8920afdc req-4750eeb2-c747-4ef5-bf7e-76016429dec2 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received unexpected event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae for instance with vm_state active and task_state rescuing.
Aug 17 18:20:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Releasing lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:20:28 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Creating image(s)
Aug 17 18:20:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "/opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "/opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "/opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG nova.objects.instance [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'trusted_certs' on Instance uuid c27fc8b6-cc8c-426a-859d-04722c569cd4 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4d1eeaa7-cf5b-45b6-aef2-8ec4c378849d req-e2441dae-c27f-4268-b089-86ebb231dc41 service nova] Acquired lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG nova.network.neutron [req-4d1eeaa7-cf5b-45b6-aef2-8ec4c378849d req-e2441dae-c27f-4268-b089-86ebb231dc41 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Refreshing network info cache for port 63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "3b087e331dfbdbd2afe8b285be8595185197f7b0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "3b087e331dfbdbd2afe8b285be8595185197f7b0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/050cf5fc9e6e604ccfa1aed447e3473b1b937429.part --force-share --output=json" returned: 0 in 0.224s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG nova.virt.images [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] b775d579-5630-49b3-81b0-8037978cf135 was qcow2, converting to raw {{(pid=72874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:20:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/050cf5fc9e6e604ccfa1aed447e3473b1b937429.part /opt/stack/data/nova/instances/_base/050cf5fc9e6e604ccfa1aed447e3473b1b937429.converted {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0.part --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/050cf5fc9e6e604ccfa1aed447e3473b1b937429.part /opt/stack/data/nova/instances/_base/050cf5fc9e6e604ccfa1aed447e3473b1b937429.converted" returned: 0 in 1.271s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/050cf5fc9e6e604ccfa1aed447e3473b1b937429.converted --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0.part --force-share --output=json" returned: 0 in 0.264s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:29 user nova-compute[72874]: DEBUG nova.virt.images [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] 927630a0-f5c3-4e26-a3db-d70885a018b5 was qcow2, converting to raw {{(pid=72874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 18:20:29 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:20:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0.part /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0.converted {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/050cf5fc9e6e604ccfa1aed447e3473b1b937429.converted --force-share --output=json" returned: 0 in 0.293s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "050cf5fc9e6e604ccfa1aed447e3473b1b937429" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 3.193s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "050cf5fc9e6e604ccfa1aed447e3473b1b937429" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "050cf5fc9e6e604ccfa1aed447e3473b1b937429" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/050cf5fc9e6e604ccfa1aed447e3473b1b937429 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0.part /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0.converted" returned: 0 in 0.261s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0.converted --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.network.neutron [req-4d1eeaa7-cf5b-45b6-aef2-8ec4c378849d req-e2441dae-c27f-4268-b089-86ebb231dc41 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Updated VIF entry in instance network info cache for port 63ec6fca-872d-4e61-b76a-c39215266088. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.network.neutron [req-4d1eeaa7-cf5b-45b6-aef2-8ec4c378849d req-e2441dae-c27f-4268-b089-86ebb231dc41 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Updating instance_info_cache with network_info: [{"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/050cf5fc9e6e604ccfa1aed447e3473b1b937429 --force-share --output=json" returned: 0 in 0.233s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/050cf5fc9e6e604ccfa1aed447e3473b1b937429,backing_fmt=raw /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.rescue {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4d1eeaa7-cf5b-45b6-aef2-8ec4c378849d req-e2441dae-c27f-4268-b089-86ebb231dc41 service nova] Releasing lock "refresh_cache-c27fc8b6-cc8c-426a-859d-04722c569cd4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/050cf5fc9e6e604ccfa1aed447e3473b1b937429,backing_fmt=raw /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.rescue" returned: 0 in 0.067s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "050cf5fc9e6e604ccfa1aed447e3473b1b937429" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.objects.instance [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lazy-loading 'migration_context' on Instance uuid f027045c-d121-45ec-af61-e1a2399c4a43 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Start _get_guest_xml network_info=[{"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "vif_mac": "fa:16:3e:50:ac:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b775d579-5630-49b3-81b0-8037978cf135', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGRYpTgL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'f027045c-d121-45ec-af61-e1a2399c4a43', 'attached_at': '', 'detached_at': '', 'volume_id': 'caba3b52-d6d2-42de-ad5c-c7501d2aab3b', 'serial': 'caba3b52-d6d2-42de-ad5c-c7501d2aab3b'}, 'delete_on_termination': False, 'attachment_id': 'da8e6879-2fbe-43dc-baa5-46a015dc8db6', 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.objects.instance [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lazy-loading 'resources' on Instance uuid f027045c-d121-45ec-af61-e1a2399c4a43 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.objects.instance [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lazy-loading 'numa_topology' on Instance uuid f027045c-d121-45ec-af61-e1a2399c4a43 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:30 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:20:30 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0.converted --force-share --output=json" returned: 0 in 0.238s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "3b087e331dfbdbd2afe8b285be8595185197f7b0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.095s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.objects.instance [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lazy-loading 'vcpu_model' on Instance uuid f027045c-d121-45ec-af61-e1a2399c4a43 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGRYpTgL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:20:30 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:20:30 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:20:30 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0 --force-share --output=json" returned: 0 in 0.263s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "3b087e331dfbdbd2afe8b285be8595185197f7b0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "3b087e331dfbdbd2afe8b285be8595185197f7b0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260" returned: 0 in 0.035s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c213267-a6c8-4b59-b2da-d8bae8de4c39]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = lGRYpTgL\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 18:20:30 user nova-compute[72874]: node.name = iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b
Aug 17 18:20:30 user nova-compute[72874]: node.tpgt = -1
Aug 17 18:20:30 user nova-compute[72874]: node.startup = automatic
Aug 17 18:20:30 user nova-compute[72874]: node.leading_login = No
Aug 17 18:20:30 user nova-compute[72874]: iface.iscsi_ifacename = default
Aug 17 18:20:30 user nova-compute[72874]: iface.net_ifacename = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.ipaddress = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.prefix_len = 0
Aug 17 18:20:30 user nova-compute[72874]: iface.hwaddress = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.transport_name = tcp
Aug 17 18:20:30 user nova-compute[72874]: iface.initiatorname = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.state = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.vlan_id = 0
Aug 17 18:20:30 user nova-compute[72874]: iface.vlan_priority = 0
Aug 17 18:20:30 user nova-compute[72874]: iface.vlan_state = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.iface_num = 0
Aug 17 18:20:30 user nova-compute[72874]: iface.mtu = 0
Aug 17 18:20:30 user nova-compute[72874]: iface.port = 0
Aug 17 18:20:30 user nova-compute[72874]: iface.bootproto = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.subnet_mask = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.gateway = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.dhcp_alt_client_id = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.dhcp_dns = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.dhcp_learn_iqn = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.dhcp_vendor_id_state = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.dhcp_vendor_id = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.dhcp_slp_da = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.fragmentation = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.gratuitous_arp = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.incoming_forwarding = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.tos_state = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.tos = 0
Aug 17 18:20:30 user nova-compute[72874]: iface.ttl = 0
Aug 17 18:20:30 user nova-compute[72874]: iface.delayed_ack = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.tcp_nagle = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.tcp_wsf_state = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.tcp_wsf = 0
Aug 17 18:20:30 user nova-compute[72874]: iface.tcp_timer_scale = 0
Aug 17 18:20:30 user nova-compute[72874]: iface.tcp_timestamp = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.redirect = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.def_task_mgmt_timeout = 0
Aug 17 18:20:30 user nova-compute[72874]: iface.header_digest = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.data_digest = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.immediate_data = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.initial_r2t = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.data_seq_inorder = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.data_pdu_inorder = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.erl = 0
Aug 17 18:20:30 user nova-compute[72874]: iface.max_receive_data_len = 0
Aug 17 18:20:30 user nova-compute[72874]: iface.first_burst_len = 0
Aug 17 18:20:30 user nova-compute[72874]: iface.max_outstanding_r2t = 0
Aug 17 18:20:30 user nova-compute[72874]: iface.max_burst_len = 0
Aug 17 18:20:30 user nova-compute[72874]: iface.chap_auth = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.bidi_chap = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.strict_login_compliance = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.discovery_auth = <empty>
Aug 17 18:20:30 user nova-compute[72874]: iface.discovery_logout = <empty>
Aug 17 18:20:30 user nova-compute[72874]: node.discovery_address = <empty>
Aug 17 18:20:30 user nova-compute[72874]: node.discovery_port = 0
Aug 17 18:20:30 user nova-compute[72874]: node.discovery_type = static
Aug 17 18:20:30 user nova-compute[72874]: node.session.initial_cmdsn = 0
Aug 17 18:20:30 user nova-compute[72874]: node.session.initial_login_retry_max = 8
Aug 17 18:20:30 user nova-compute[72874]: node.session.xmit_thread_priority = -20
Aug 17 18:20:30 user nova-compute[72874]: node.session.cmds_max = 128
Aug 17 18:20:30 user nova-compute[72874]: node.session.queue_depth = 32
Aug 17 18:20:30 user nova-compute[72874]: node.session.nr_sessions = 1
Aug 17 18:20:30 user nova-compute[72874]: node.session.auth.authmethod = CHAP
Aug 17 18:20:30 user nova-compute[72874]: node.session.auth.username = lGRYpTgL
Aug 17 18:20:30 user nova-compute[72874]: node.session.auth.password = ***
Aug 17 18:20:30 user nova-compute[72874]: node.session.auth.username_in = <empty>
Aug 17 18:20:30 user nova-compute[72874]: node.session.auth.password_in = <empty>
Aug 17 18:20:30 user nova-compute[72874]: node.session.auth.chap_algs = MD5
Aug 17 18:20:30 user nova-compute[72874]: node.session.timeo.replacement_timeout = 120
Aug 17 18:20:30 user nova-compute[72874]: node.session.err_timeo.abort_timeout = 15
Aug 17 18:20:30 user nova-compute[72874]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 18:20:30 user nova-compute[72874]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 18:20:30 user nova-compute[72874]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 18:20:30 user nova-compute[72874]: node.session.iscsi.FastAbort = Yes
Aug 17 18:20:30 user nova-compute[72874]: node.session.iscsi.InitialR2T = No
Aug 17 18:20:30 user nova-compute[72874]: node.session.iscsi.ImmediateData = Yes
Aug 17 18:20:30 user nova-compute[72874]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 18:20:30 user nova-compute[72874]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 18:20:30 user nova-compute[72874]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 18:20:30 user nova-compute[72874]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 18:20:30 user nova-compute[72874]: node.session.iscsi.MaxConnections = 1
Aug 17 18:20:30 user nova-compute[72874]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 18:20:30 user nova-compute[72874]: node.session.iscsi.ERL = 0
Aug 17 18:20:30 user nova-compute[72874]: node.session.scan = manual
Aug 17 18:20:30 user nova-compute[72874]: node.session.reopen_max = 0
Aug 17 18:20:30 user nova-compute[72874]: node.conn[0].address = 172.16.0.220
Aug 17 18:20:30 user nova-compute[72874]: node.conn[0].port = 3260
Aug 17 18:20:30 user nova-compute[72874]: node.conn[0].startup = manual
Aug 17 18:20:30 user nova-compute[72874]: node.conn[0].tcp.window_size = 524288
Aug 17 18:20:30 user nova-compute[72874]: node.conn[0].tcp.type_of_service = 0
Aug 17 18:20:30 user nova-compute[72874]: node.conn[0].timeo.logout_timeout = 15
Aug 17 18:20:30 user nova-compute[72874]: node.conn[0].timeo.login_timeout = 15
Aug 17 18:20:30 user nova-compute[72874]: node.conn[0].timeo.auth_timeout = 45
Aug 17 18:20:30 user nova-compute[72874]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 18:20:30 user nova-compute[72874]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 18:20:30 user nova-compute[72874]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 18:20:30 user nova-compute[72874]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 18:20:30 user nova-compute[72874]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 18:20:30 user nova-compute[72874]: node.conn[0].iscsi.DataDigest = None
Aug 17 18:20:30 user nova-compute[72874]: node.conn[0].iscsi.IFMarker = No
Aug 17 18:20:30 user nova-compute[72874]: node.conn[0].iscsi.OFMarker = No
Aug 17 18:20:30 user nova-compute[72874]: # END RECORD
Aug 17 18:20:30 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.065s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a87fe3-fad6-493c-a334-e2206ef16f5e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0 --force-share --output=json" returned: 0 in 0.203s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0,backing_fmt=raw /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.172s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8028b300-fb4c-4308-9e96-e3c170226713]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lGRYpTgL {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0,backing_fmt=raw /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk 1073741824" returned: 0 in 0.115s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "3b087e331dfbdbd2afe8b285be8595185197f7b0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.321s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lGRYpTgL" returned: 0 in 0.030s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eddf7cb-06b3-4032-816c-a019b314a3b4]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lGRYpTgL'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae0bbd2-115f-4c7b-bc7f-d44d3991cab8]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[39932115-b2d5-42a5-a16d-75a00840f9ad]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:20:30 user nova-compute[72874]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:20:30 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:20:30 user nova-compute[72874]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:20:30 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.504s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] HCTL ('34', '0', '0', 0) found on session 16 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3138a45-2cd3-4f88-93d8-9078d9fbc183]: (4, ('0 0 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Searching for a device in session 16 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGRYpTgL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.537s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] <== connect_volume: return (539ms) {'type': 'block', 'scsi_wwn': '26166366664623734', 'path': '/dev/sdc'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166366664623734', 'path': '/dev/sdc'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1822661416',display_name='tempest-ServerStableDeviceRescueTest-server-1822661416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1822661416',id=3,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOelasHdGoL+Cq5kCerVY3gWowEdYqles28HBqmjG9V1QMXJ5MTrhbBjfmX+uWP1TCA19y7eC/lFWOzs/7uQdIP7uyNX9gKjvHQlPelnMJ6yDDVVohaqn7Usr0KYj2/rw==',key_name='tempest-keypair-1229666427',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='010744e63b35476d85e61945c50dc586',ramdisk_id='',reservation_id='r-ie3dxk98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1978576596',owner_user_name='tempest-ServerStableDeviceRescueTest-1978576596-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:18:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f824595c9ce4775bc021075a7eb7047',uuid=f027045c-d121-45ec-af61-e1a2399c4a43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "vif_mac": "fa:16:3e:50:ac:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Converting VIF {"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "vif_mac": "fa:16:3e:50:ac:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:ac:00,bridge_name='br-int',has_traffic_filtering=True,id=b3598a27-6f66-4999-8ed8-835ffb3d6cae,network=Network(6d517d31-387e-4eff-a4ec-a4d9b046ff16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3598a27-6f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:20:30 user nova-compute[72874]: DEBUG nova.objects.instance [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lazy-loading 'pci_devices' on Instance uuid f027045c-d121-45ec-af61-e1a2399c4a43 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0 --force-share --output=json" returned: 0 in 0.203s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:31 user nova-compute[72874]: DEBUG nova.objects.instance [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'migration_context' on Instance uuid c27fc8b6-cc8c-426a-859d-04722c569cd4 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:20:31 user nova-compute[72874]:   <uuid>f027045c-d121-45ec-af61-e1a2399c4a43</uuid>
Aug 17 18:20:31 user nova-compute[72874]:   <name>instance-00000003</name>
Aug 17 18:20:31 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:20:31 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:20:31 user nova-compute[72874]:   <metadata>
Aug 17 18:20:31 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:20:31 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:20:31 user nova-compute[72874]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1822661416</nova:name>
Aug 17 18:20:31 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:20:30</nova:creationTime>
Aug 17 18:20:31 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:20:31 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:20:31 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:20:31 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:20:31 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:20:31 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:20:31 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:20:31 user nova-compute[72874]:       <nova:owner>
Aug 17 18:20:31 user nova-compute[72874]:         <nova:user uuid="8f824595c9ce4775bc021075a7eb7047">tempest-ServerStableDeviceRescueTest-1978576596-project-member</nova:user>
Aug 17 18:20:31 user nova-compute[72874]:         <nova:project uuid="010744e63b35476d85e61945c50dc586">tempest-ServerStableDeviceRescueTest-1978576596</nova:project>
Aug 17 18:20:31 user nova-compute[72874]:       </nova:owner>
Aug 17 18:20:31 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:20:31 user nova-compute[72874]:       <nova:ports>
Aug 17 18:20:31 user nova-compute[72874]:         <nova:port uuid="b3598a27-6f66-4999-8ed8-835ffb3d6cae">
Aug 17 18:20:31 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 18:20:31 user nova-compute[72874]:         </nova:port>
Aug 17 18:20:31 user nova-compute[72874]:       </nova:ports>
Aug 17 18:20:31 user nova-compute[72874]:     </nova:instance>
Aug 17 18:20:31 user nova-compute[72874]:   </metadata>
Aug 17 18:20:31 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:20:31 user nova-compute[72874]:     <system>
Aug 17 18:20:31 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:20:31 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:20:31 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:20:31 user nova-compute[72874]:       <entry name="serial">f027045c-d121-45ec-af61-e1a2399c4a43</entry>
Aug 17 18:20:31 user nova-compute[72874]:       <entry name="uuid">f027045c-d121-45ec-af61-e1a2399c4a43</entry>
Aug 17 18:20:31 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:20:31 user nova-compute[72874]:     </system>
Aug 17 18:20:31 user nova-compute[72874]:   </sysinfo>
Aug 17 18:20:31 user nova-compute[72874]:   <os>
Aug 17 18:20:31 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:20:31 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:20:31 user nova-compute[72874]:   </os>
Aug 17 18:20:31 user nova-compute[72874]:   <features>
Aug 17 18:20:31 user nova-compute[72874]:     <acpi/>
Aug 17 18:20:31 user nova-compute[72874]:     <apic/>
Aug 17 18:20:31 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:20:31 user nova-compute[72874]:   </features>
Aug 17 18:20:31 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:20:31 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:20:31 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:20:31 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:20:31 user nova-compute[72874]:   </clock>
Aug 17 18:20:31 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:20:31 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:20:31 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:20:31 user nova-compute[72874]:   </cpu>
Aug 17 18:20:31 user nova-compute[72874]:   <devices>
Aug 17 18:20:31 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:20:31 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:20:31 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk"/>
Aug 17 18:20:31 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:20:31 user nova-compute[72874]:     </disk>
Aug 17 18:20:31 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:20:31 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:20:31 user nova-compute[72874]:       <source dev="/dev/sdc"/>
Aug 17 18:20:31 user nova-compute[72874]:       <target dev="vdb" bus="virtio"/>
Aug 17 18:20:31 user nova-compute[72874]:       <serial>caba3b52-d6d2-42de-ad5c-c7501d2aab3b</serial>
Aug 17 18:20:31 user nova-compute[72874]:     </disk>
Aug 17 18:20:31 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:20:31 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:20:31 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.rescue"/>
Aug 17 18:20:31 user nova-compute[72874]:       <target dev="vdc" bus="virtio"/>
Aug 17 18:20:31 user nova-compute[72874]:       <boot order="1"/>
Aug 17 18:20:31 user nova-compute[72874]:     </disk>
Aug 17 18:20:31 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:20:31 user nova-compute[72874]:       <mac address="fa:16:3e:50:ac:00"/>
Aug 17 18:20:31 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:20:31 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:20:31 user nova-compute[72874]:       <target dev="tapb3598a27-6f"/>
Aug 17 18:20:31 user nova-compute[72874]:     </interface>
Aug 17 18:20:31 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:20:31 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/console.log" append="off"/>
Aug 17 18:20:31 user nova-compute[72874]:     </serial>
Aug 17 18:20:31 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:20:31 user nova-compute[72874]:     <video>
Aug 17 18:20:31 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:20:31 user nova-compute[72874]:     </video>
Aug 17 18:20:31 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:20:31 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:20:31 user nova-compute[72874]:     </rng>
Aug 17 18:20:31 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:20:31 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:20:31 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:20:31 user nova-compute[72874]:     </memballoon>
Aug 17 18:20:31 user nova-compute[72874]:   </devices>
Aug 17 18:20:31 user nova-compute[72874]: </domain>
Aug 17 18:20:31 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:20:31 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Rebasing disk image.
Aug 17 18:20:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:31 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Instance destroyed successfully.
Aug 17 18:20:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:20:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:20:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:20:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] No VIF found with MAC fa:16:3e:50:ac:00, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:20:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.257s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 -F raw /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-f30cebf5-85bf-47ed-acce-3df53790021d req-df9bbaf1-0e3f-47e3-b7c4-9fe8904696c8 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:20:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f30cebf5-85bf-47ed-acce-3df53790021d req-df9bbaf1-0e3f-47e3-b7c4-9fe8904696c8 service nova] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f30cebf5-85bf-47ed-acce-3df53790021d req-df9bbaf1-0e3f-47e3-b7c4-9fe8904696c8 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f30cebf5-85bf-47ed-acce-3df53790021d req-df9bbaf1-0e3f-47e3-b7c4-9fe8904696c8 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-f30cebf5-85bf-47ed-acce-3df53790021d req-df9bbaf1-0e3f-47e3-b7c4-9fe8904696c8 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] No waiting events found dispatching network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:20:33 user nova-compute[72874]: WARNING nova.compute.manager [req-f30cebf5-85bf-47ed-acce-3df53790021d req-df9bbaf1-0e3f-47e3-b7c4-9fe8904696c8 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received unexpected event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae for instance with vm_state active and task_state rescuing.
Aug 17 18:20:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 -F raw /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk" returned: 0 in 3.490s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Ensure instance console log exists: /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.005s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Start _get_guest_xml network_info=[{"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='548706ebf15e9c559e0f24569c59e4db',container_format='bare',created_at=2023-08-17T18:18:17Z,direct_url=<?>,disk_format='qcow2',id=927630a0-f5c3-4e26-a3db-d70885a018b5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-432713260-shelved',owner='5c20349a873f4ec7a0f72a7d64c636e4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T18:18:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOgDKhFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'c27fc8b6-cc8c-426a-859d-04722c569cd4', 'attached_at': '', 'detached_at': '', 'volume_id': 'c387b29c-dd79-49d3-b1e0-542036eecbc7', 'serial': 'c387b29c-dd79-49d3-b1e0-542036eecbc7'}, 'delete_on_termination': False, 'attachment_id': '5e2a8a3e-021a-451a-8928-d0d8dea51220', 'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:20:34 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:20:34 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='548706ebf15e9c559e0f24569c59e4db',container_format='bare',created_at=2023-08-17T18:18:17Z,direct_url=<?>,disk_format='qcow2',id=927630a0-f5c3-4e26-a3db-d70885a018b5,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-432713260-shelved',owner='5c20349a873f4ec7a0f72a7d64c636e4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T18:18:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.objects.instance [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'vcpu_model' on Instance uuid c27fc8b6-cc8c-426a-859d-04722c569cd4 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOgDKhFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:20:34 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:20:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:20:34 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:20:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:20:34 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:20:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260" returned: 21 in 0.043s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2837a1-1693-4dc7-a050-9a1d39ccff07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:20:34 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff73654-96e3-4180-b9c4-2e7dd00306f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7] added
Aug 17 18:20:34 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca92e059-34da-4ec5-8c40-55e094c163f9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[79efc632-2ac1-4c8d-8220-6406ef9b96e4]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eOgDKhFG {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eOgDKhFG" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[73853547-2f3b-4d2c-a7d4-68fff4e4d5c2]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eOgDKhFG'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ad2d83-a164-46d4-9a5f-5e12b042f24d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[13083e92-5029-4058-bfce-e4815a7fce49]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:20:35 user nova-compute[72874]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:20:35 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:20:35 user nova-compute[72874]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:20:35 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b06242-0260-459f-9d07-f81be30933ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7, portal: 172.16.0.220,3260]
Aug 17 18:20:35 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7, portal: 172.16.0.220,3260] successful.
Aug 17 18:20:35 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b6d75f5-2abe-4817-b354-914cfb811a36]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85b965c-a97e-4b48-8949-be8336216f04]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:20:35 user nova-compute[72874]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:20:35 user nova-compute[72874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 (non-flash)
Aug 17 18:20:35 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:20:35 user nova-compute[72874]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:20:35 user nova-compute[72874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 (non-flash)
Aug 17 18:20:35 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.045s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[535ba9b1-49a5-49ff-a98c-d889a8b2fe38]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-b3fe4d43-8bd4-4eda-8d7b-d423315b75cd req-bbd4e29d-ee00-46c8-a30f-8ed2b274cb8c service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b3fe4d43-8bd4-4eda-8d7b-d423315b75cd req-bbd4e29d-ee00-46c8-a30f-8ed2b274cb8c service nova] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b3fe4d43-8bd4-4eda-8d7b-d423315b75cd req-bbd4e29d-ee00-46c8-a30f-8ed2b274cb8c service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b3fe4d43-8bd4-4eda-8d7b-d423315b75cd req-bbd4e29d-ee00-46c8-a30f-8ed2b274cb8c service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-b3fe4d43-8bd4-4eda-8d7b-d423315b75cd req-bbd4e29d-ee00-46c8-a30f-8ed2b274cb8c service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] No waiting events found dispatching network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:20:35 user nova-compute[72874]: WARNING nova.compute.manager [req-b3fe4d43-8bd4-4eda-8d7b-d423315b75cd req-bbd4e29d-ee00-46c8-a30f-8ed2b274cb8c service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received unexpected event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae for instance with vm_state active and task_state rescuing.
Aug 17 18:20:36 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOgDKhFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.403s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23665313562353863', 'path': '/dev/sdd'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665313562353863', 'path': '/dev/sdd'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T18:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-432713260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-432713260',id=1,image_ref='927630a0-f5c3-4e26-a3db-d70885a018b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-271521945',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5c20349a873f4ec7a0f72a7d64c636e4',ramdisk_id='',reservation_id='r-xtamjwzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1376162523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1376162523-project-member',shelved_at='2023-08-17T18:18:22.399223',shelved_host='user',shelved_image_id='927630a0-f5c3-4e26-a3db-d70885a018b5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:20:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b47defaba840e1ba8f91603d99caac',uuid=c27fc8b6-cc8c-426a-859d-04722c569cd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converting VIF {"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:fb:6f,bridge_name='br-int',has_traffic_filtering=True,id=63ec6fca-872d-4e61-b76a-c39215266088,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ec6fca-87') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.objects.instance [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'pci_devices' on Instance uuid c27fc8b6-cc8c-426a-859d-04722c569cd4 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:20:36 user nova-compute[72874]:   <uuid>c27fc8b6-cc8c-426a-859d-04722c569cd4</uuid>
Aug 17 18:20:36 user nova-compute[72874]:   <name>instance-00000001</name>
Aug 17 18:20:36 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:20:36 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:20:36 user nova-compute[72874]:   <metadata>
Aug 17 18:20:36 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:20:36 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:20:36 user nova-compute[72874]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-432713260</nova:name>
Aug 17 18:20:36 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:20:34</nova:creationTime>
Aug 17 18:20:36 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:20:36 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:20:36 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:20:36 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:20:36 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:20:36 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:20:36 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:20:36 user nova-compute[72874]:       <nova:owner>
Aug 17 18:20:36 user nova-compute[72874]:         <nova:user uuid="01b47defaba840e1ba8f91603d99caac">tempest-AttachVolumeShelveTestJSON-1376162523-project-member</nova:user>
Aug 17 18:20:36 user nova-compute[72874]:         <nova:project uuid="5c20349a873f4ec7a0f72a7d64c636e4">tempest-AttachVolumeShelveTestJSON-1376162523</nova:project>
Aug 17 18:20:36 user nova-compute[72874]:       </nova:owner>
Aug 17 18:20:36 user nova-compute[72874]:       <nova:root type="image" uuid="927630a0-f5c3-4e26-a3db-d70885a018b5"/>
Aug 17 18:20:36 user nova-compute[72874]:       <nova:ports>
Aug 17 18:20:36 user nova-compute[72874]:         <nova:port uuid="63ec6fca-872d-4e61-b76a-c39215266088">
Aug 17 18:20:36 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 18:20:36 user nova-compute[72874]:         </nova:port>
Aug 17 18:20:36 user nova-compute[72874]:       </nova:ports>
Aug 17 18:20:36 user nova-compute[72874]:     </nova:instance>
Aug 17 18:20:36 user nova-compute[72874]:   </metadata>
Aug 17 18:20:36 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:20:36 user nova-compute[72874]:     <system>
Aug 17 18:20:36 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:20:36 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:20:36 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:20:36 user nova-compute[72874]:       <entry name="serial">c27fc8b6-cc8c-426a-859d-04722c569cd4</entry>
Aug 17 18:20:36 user nova-compute[72874]:       <entry name="uuid">c27fc8b6-cc8c-426a-859d-04722c569cd4</entry>
Aug 17 18:20:36 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:20:36 user nova-compute[72874]:     </system>
Aug 17 18:20:36 user nova-compute[72874]:   </sysinfo>
Aug 17 18:20:36 user nova-compute[72874]:   <os>
Aug 17 18:20:36 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:20:36 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:20:36 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:20:36 user nova-compute[72874]:   </os>
Aug 17 18:20:36 user nova-compute[72874]:   <features>
Aug 17 18:20:36 user nova-compute[72874]:     <acpi/>
Aug 17 18:20:36 user nova-compute[72874]:     <apic/>
Aug 17 18:20:36 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:20:36 user nova-compute[72874]:   </features>
Aug 17 18:20:36 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:20:36 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:20:36 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:20:36 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:20:36 user nova-compute[72874]:   </clock>
Aug 17 18:20:36 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:20:36 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:20:36 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:20:36 user nova-compute[72874]:   </cpu>
Aug 17 18:20:36 user nova-compute[72874]:   <devices>
Aug 17 18:20:36 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:20:36 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:20:36 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk"/>
Aug 17 18:20:36 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:20:36 user nova-compute[72874]:     </disk>
Aug 17 18:20:36 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:20:36 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:20:36 user nova-compute[72874]:       <source dev="/dev/sdd"/>
Aug 17 18:20:36 user nova-compute[72874]:       <target dev="vdc" bus="virtio"/>
Aug 17 18:20:36 user nova-compute[72874]:       <serial>c387b29c-dd79-49d3-b1e0-542036eecbc7</serial>
Aug 17 18:20:36 user nova-compute[72874]:     </disk>
Aug 17 18:20:36 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:20:36 user nova-compute[72874]:       <mac address="fa:16:3e:1d:fb:6f"/>
Aug 17 18:20:36 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:20:36 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:20:36 user nova-compute[72874]:       <target dev="tap63ec6fca-87"/>
Aug 17 18:20:36 user nova-compute[72874]:     </interface>
Aug 17 18:20:36 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:20:36 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/console.log" append="off"/>
Aug 17 18:20:36 user nova-compute[72874]:     </serial>
Aug 17 18:20:36 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:20:36 user nova-compute[72874]:     <video>
Aug 17 18:20:36 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:20:36 user nova-compute[72874]:     </video>
Aug 17 18:20:36 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:20:36 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:20:36 user nova-compute[72874]:     </rng>
Aug 17 18:20:36 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:20:36 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:20:36 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:20:36 user nova-compute[72874]:     </memballoon>
Aug 17 18:20:36 user nova-compute[72874]:   </devices>
Aug 17 18:20:36 user nova-compute[72874]: </domain>
Aug 17 18:20:36 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T18:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-432713260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-432713260',id=1,image_ref='927630a0-f5c3-4e26-a3db-d70885a018b5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-271521945',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5c20349a873f4ec7a0f72a7d64c636e4',ramdisk_id='',reservation_id='r-xtamjwzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1376162523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1376162523-project-member',shelved_at='2023-08-17T18:18:22.399223',shelved_host='user',shelved_image_id='927630a0-f5c3-4e26-a3db-d70885a018b5'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:20:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b47defaba840e1ba8f91603d99caac',uuid=c27fc8b6-cc8c-426a-859d-04722c569cd4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converting VIF {"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:fb:6f,bridge_name='br-int',has_traffic_filtering=True,id=63ec6fca-872d-4e61-b76a-c39215266088,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ec6fca-87') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG os_vif [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:fb:6f,bridge_name='br-int',has_traffic_filtering=True,id=63ec6fca-872d-4e61-b76a-c39215266088,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ec6fca-87') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63ec6fca-87, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap63ec6fca-87, col_values=(('external_ids', {'iface-id': '63ec6fca-872d-4e61-b76a-c39215266088', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:fb:6f', 'vm-uuid': 'c27fc8b6-cc8c-426a-859d-04722c569cd4'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Removed pending event for f027045c-d121-45ec-af61-e1a2399c4a43 due to event {{(pid=72874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296436.5691738, f027045c-d121-45ec-af61-e1a2399c4a43 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:20:36 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] VM Resumed (Lifecycle Event)
Aug 17 18:20:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:36 user nova-compute[72874]: INFO os_vif [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:fb:6f,bridge_name='br-int',has_traffic_filtering=True,id=63ec6fca-872d-4e61-b76a-c39215266088,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ec6fca-87')
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-196207cf-4440-4b72-9c68-c54b2c810d07 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:20:36 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296436.571531, f027045c-d121-45ec-af61-e1a2399c4a43 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:20:36 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] VM Started (Lifecycle Event)
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:20:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] No VIF found with MAC fa:16:3e:1d:fb:6f, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:20:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-9547876d-84e4-4a25-b28f-18b02bd628c0 req-07b6e07f-9ef8-43c1-a7ff-9c81b6b40c19 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received event network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:20:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9547876d-84e4-4a25-b28f-18b02bd628c0 req-07b6e07f-9ef8-43c1-a7ff-9c81b6b40c19 service nova] Acquiring lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9547876d-84e4-4a25-b28f-18b02bd628c0 req-07b6e07f-9ef8-43c1-a7ff-9c81b6b40c19 service nova] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9547876d-84e4-4a25-b28f-18b02bd628c0 req-07b6e07f-9ef8-43c1-a7ff-9c81b6b40c19 service nova] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-9547876d-84e4-4a25-b28f-18b02bd628c0 req-07b6e07f-9ef8-43c1-a7ff-9c81b6b40c19 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] No waiting events found dispatching network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:20:38 user nova-compute[72874]: WARNING nova.compute.manager [req-9547876d-84e4-4a25-b28f-18b02bd628c0 req-07b6e07f-9ef8-43c1-a7ff-9c81b6b40c19 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received unexpected event network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 18:20:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:40 user nova-compute[72874]: DEBUG nova.compute.manager [req-44137426-480d-4dd4-bb9b-4317cf341fcd req-a3a7d76b-106f-4f3b-83b6-785bdb8b9410 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received event network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:20:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-44137426-480d-4dd4-bb9b-4317cf341fcd req-a3a7d76b-106f-4f3b-83b6-785bdb8b9410 service nova] Acquiring lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-44137426-480d-4dd4-bb9b-4317cf341fcd req-a3a7d76b-106f-4f3b-83b6-785bdb8b9410 service nova] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-44137426-480d-4dd4-bb9b-4317cf341fcd req-a3a7d76b-106f-4f3b-83b6-785bdb8b9410 service nova] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:40 user nova-compute[72874]: DEBUG nova.compute.manager [req-44137426-480d-4dd4-bb9b-4317cf341fcd req-a3a7d76b-106f-4f3b-83b6-785bdb8b9410 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] No waiting events found dispatching network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:20:40 user nova-compute[72874]: WARNING nova.compute.manager [req-44137426-480d-4dd4-bb9b-4317cf341fcd req-a3a7d76b-106f-4f3b-83b6-785bdb8b9410 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received unexpected event network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 18:20:41 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296441.2038674, c27fc8b6-cc8c-426a-859d-04722c569cd4 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:20:41 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] VM Resumed (Lifecycle Event)
Aug 17 18:20:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:20:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:20:41 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Instance spawned successfully.
Aug 17 18:20:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:20:41 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:20:41 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296441.2082098, c27fc8b6-cc8c-426a-859d-04722c569cd4 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:20:41 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] VM Started (Lifecycle Event)
Aug 17 18:20:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:20:41 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:20:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-82bd18ad-48ef-4eb3-8f6a-35290b396e53 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 31.777s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Acquiring lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Acquiring lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:42 user nova-compute[72874]: INFO nova.compute.manager [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Terminating instance
Aug 17 18:20:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:20:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-2964924d-c984-4e5f-8e28-35fc4ab08b3f req-8aed95d9-8136-42d9-971f-c2c90f2fe9f9 service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Received event network-vif-unplugged-1293a9a4-696a-41b5-a2f4-10b40e30f85b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:20:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2964924d-c984-4e5f-8e28-35fc4ab08b3f req-8aed95d9-8136-42d9-971f-c2c90f2fe9f9 service nova] Acquiring lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2964924d-c984-4e5f-8e28-35fc4ab08b3f req-8aed95d9-8136-42d9-971f-c2c90f2fe9f9 service nova] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2964924d-c984-4e5f-8e28-35fc4ab08b3f req-8aed95d9-8136-42d9-971f-c2c90f2fe9f9 service nova] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-2964924d-c984-4e5f-8e28-35fc4ab08b3f req-8aed95d9-8136-42d9-971f-c2c90f2fe9f9 service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] No waiting events found dispatching network-vif-unplugged-1293a9a4-696a-41b5-a2f4-10b40e30f85b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:20:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-2964924d-c984-4e5f-8e28-35fc4ab08b3f req-8aed95d9-8136-42d9-971f-c2c90f2fe9f9 service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Received event network-vif-unplugged-1293a9a4-696a-41b5-a2f4-10b40e30f85b for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:20:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:43 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Instance destroyed successfully.
Aug 17 18:20:43 user nova-compute[72874]: DEBUG nova.objects.instance [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lazy-loading 'resources' on Instance uuid 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1703735447',display_name='tempest-TestVolumeSwap-server-1703735447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1703735447',id=8,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAgxhUqL/RVhNWMpw6tH6d+vjG9BaoFvtB+Cui1yC9ibU2ztgzVNc4L407KrrlG2qmZuRp66c6WTEmuLIjw1exJY4cy1+b8YjbEmAj+VXuHET8NYNask/FDwqHxzTrUgZQ==',key_name='tempest-keypair-1567981108',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:17:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7bee00afddbd47ada0661d599605f8b5',ramdisk_id='',reservation_id='r-ylcq1hn4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1434373281',owner_user_name='tempest-TestVolumeSwap-1434373281-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:17:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aa17f84da4e6430db62f92577b12d231',uuid=8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "address": "fa:16:3e:87:05:5f", "network": {"id": "d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1596285574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bee00afddbd47ada0661d599605f8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1293a9a4-69", "ovs_interfaceid": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:20:43 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Converting VIF {"id": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "address": "fa:16:3e:87:05:5f", "network": {"id": "d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1596285574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7bee00afddbd47ada0661d599605f8b5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1293a9a4-69", "ovs_interfaceid": "1293a9a4-696a-41b5-a2f4-10b40e30f85b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:20:43 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:05:5f,bridge_name='br-int',has_traffic_filtering=True,id=1293a9a4-696a-41b5-a2f4-10b40e30f85b,network=Network(d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1293a9a4-69') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:20:43 user nova-compute[72874]: DEBUG os_vif [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:05:5f,bridge_name='br-int',has_traffic_filtering=True,id=1293a9a4-696a-41b5-a2f4-10b40e30f85b,network=Network(d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1293a9a4-69') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:20:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1293a9a4-69, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:20:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:20:43 user nova-compute[72874]: INFO os_vif [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:05:5f,bridge_name='br-int',has_traffic_filtering=True,id=1293a9a4-696a-41b5-a2f4-10b40e30f85b,network=Network(d7e7eae6-9838-4a4c-bb87-fcd2c305b4c5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1293a9a4-69')
Aug 17 18:20:43 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Deleting instance files /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83_del
Aug 17 18:20:43 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Deletion of /opt/stack/data/nova/instances/8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83_del complete
Aug 17 18:20:43 user nova-compute[72874]: INFO nova.compute.manager [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 17 18:20:43 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:20:43 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:20:43 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:20:44 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:20:44 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Took 1.00 seconds to deallocate network for instance.
Aug 17 18:20:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-bdca71de-d5d8-463c-84b4-df00d38928f7 req-92234c82-ef05-4eec-bf12-5b0794bc983c service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Received event network-vif-deleted-1293a9a4-696a-41b5-a2f4-10b40e30f85b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:20:44 user nova-compute[72874]: INFO nova.compute.manager [req-bdca71de-d5d8-463c-84b4-df00d38928f7 req-92234c82-ef05-4eec-bf12-5b0794bc983c service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Neutron deleted interface 1293a9a4-696a-41b5-a2f4-10b40e30f85b; detaching it from the instance and deleting it from the info cache
Aug 17 18:20:44 user nova-compute[72874]: DEBUG nova.network.neutron [req-bdca71de-d5d8-463c-84b4-df00d38928f7 req-92234c82-ef05-4eec-bf12-5b0794bc983c service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:20:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-bdca71de-d5d8-463c-84b4-df00d38928f7 req-92234c82-ef05-4eec-bf12-5b0794bc983c service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Detach interface failed, port_id=1293a9a4-696a-41b5-a2f4-10b40e30f85b, reason: Instance 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:20:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-e5897b3f-9e1e-4c75-94c1-93f78f8508cd req-97ff9a5b-8e8d-4a10-aa23-b11d0e57d2c0 service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Received event network-vif-plugged-1293a9a4-696a-41b5-a2f4-10b40e30f85b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:20:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e5897b3f-9e1e-4c75-94c1-93f78f8508cd req-97ff9a5b-8e8d-4a10-aa23-b11d0e57d2c0 service nova] Acquiring lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e5897b3f-9e1e-4c75-94c1-93f78f8508cd req-97ff9a5b-8e8d-4a10-aa23-b11d0e57d2c0 service nova] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e5897b3f-9e1e-4c75-94c1-93f78f8508cd req-97ff9a5b-8e8d-4a10-aa23-b11d0e57d2c0 service nova] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-e5897b3f-9e1e-4c75-94c1-93f78f8508cd req-97ff9a5b-8e8d-4a10-aa23-b11d0e57d2c0 service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] No waiting events found dispatching network-vif-plugged-1293a9a4-696a-41b5-a2f4-10b40e30f85b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:20:44 user nova-compute[72874]: WARNING nova.compute.manager [req-e5897b3f-9e1e-4c75-94c1-93f78f8508cd req-97ff9a5b-8e8d-4a10-aa23-b11d0e57d2c0 service nova] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Received unexpected event network-vif-plugged-1293a9a4-696a-41b5-a2f4-10b40e30f85b for instance with vm_state deleted and task_state None.
Aug 17 18:20:44 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:20:44 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:20:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.430s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:44 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Deleted allocations for instance 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83
Aug 17 18:20:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a8f3dbca-53ec-4316-806c-a1985053bc63 tempest-TestVolumeSwap-1434373281 tempest-TestVolumeSwap-1434373281-project-member] Lock "8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.705s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "7c486f7d-bcad-4c83-98bf-f08559259d33" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:53 user nova-compute[72874]: INFO nova.compute.manager [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Terminating instance
Aug 17 18:20:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:20:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-23f2db89-fa73-44ba-b2c1-b4676a618fab req-1c6bf720-477d-48e7-965f-54f5df9d8092 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received event network-vif-unplugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-23f2db89-fa73-44ba-b2c1-b4676a618fab req-1c6bf720-477d-48e7-965f-54f5df9d8092 service nova] Acquiring lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-23f2db89-fa73-44ba-b2c1-b4676a618fab req-1c6bf720-477d-48e7-965f-54f5df9d8092 service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-23f2db89-fa73-44ba-b2c1-b4676a618fab req-1c6bf720-477d-48e7-965f-54f5df9d8092 service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-23f2db89-fa73-44ba-b2c1-b4676a618fab req-1c6bf720-477d-48e7-965f-54f5df9d8092 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] No waiting events found dispatching network-vif-unplugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-23f2db89-fa73-44ba-b2c1-b4676a618fab req-1c6bf720-477d-48e7-965f-54f5df9d8092 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received event network-vif-unplugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:20:54 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Instance destroyed successfully.
Aug 17 18:20:54 user nova-compute[72874]: DEBUG nova.objects.instance [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lazy-loading 'resources' on Instance uuid 7c486f7d-bcad-4c83-98bf-f08559259d33 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T18:17:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1675062005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-2121101201',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHO7rkeC9pzXuKB0SzBYgruoGhDzERqiJUXWtIfbrLLf7ig2/MHev5D+kN1SaVM8QqD4bJCvdEFBeAQxW3jsr31paoEijftB74Jxx/L7jR166vAUYf/FeWQK16Y3ojsdFg==',key_name='tempest-keypair-809304444',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:19:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0ce530e304a47e49163e5e16a07af5a',ramdisk_id='',reservation_id='r-9lpxt6gu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-423641309',owner_user_name='tempest-ServerActionsV293TestJSON-423641309-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:19:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bb6178a9238a4c6ca4f80eea57962534',uuid=7c486f7d-bcad-4c83-98bf-f08559259d33,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Converting VIF {"id": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "address": "fa:16:3e:44:12:45", "network": {"id": "cce89dc3-ea6a-4e83-94a1-6bc08392b565", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-527606485-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0ce530e304a47e49163e5e16a07af5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82fadf6c-c9", "ovs_interfaceid": "82fadf6c-c99c-4db9-8f9c-f05d33415d5c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:12:45,bridge_name='br-int',has_traffic_filtering=True,id=82fadf6c-c99c-4db9-8f9c-f05d33415d5c,network=Network(cce89dc3-ea6a-4e83-94a1-6bc08392b565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82fadf6c-c9') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG os_vif [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:12:45,bridge_name='br-int',has_traffic_filtering=True,id=82fadf6c-c99c-4db9-8f9c-f05d33415d5c,network=Network(cce89dc3-ea6a-4e83-94a1-6bc08392b565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82fadf6c-c9') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82fadf6c-c9, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:20:54 user nova-compute[72874]: INFO os_vif [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:12:45,bridge_name='br-int',has_traffic_filtering=True,id=82fadf6c-c99c-4db9-8f9c-f05d33415d5c,network=Network(cce89dc3-ea6a-4e83-94a1-6bc08392b565),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82fadf6c-c9')
Aug 17 18:20:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sakPJxrD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:20:54 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:20:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[509d8c15-54a3-46c3-afe0-e93dcac79048]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcf506d-3ba7-4fba-951e-0e3d3eadb25f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:20:54 user nova-compute[72874]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:20:54 user nova-compute[72874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 (non-flash)
Aug 17 18:20:54 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 (non-flash)
Aug 17 18:20:54 user nova-compute[72874]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:20:54 user nova-compute[72874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 (non-flash)
Aug 17 18:20:54 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a079d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.035s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80c0e4a-6858-470c-a3ce-e814a11162fd]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda30ada-44c7-4fa5-8967-f67a2b3937e2]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8473dcf9-3869-4ae0-9082-bcfd6a45127e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.078s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ce5b7e-f176-4082-8f4f-1b149d6425a0]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO40f9e1e5-6056fd47bc5ae77a', '/dev/disk/by-id/scsi-23630353666643437', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_40f9e1e5') {{(pid=83588) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d58f0a-2860-41f7-b49c-0a7967abd7e2]: (4, None) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:20:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[37553954-b74b-41d3-af4d-3c68a8d80cf7]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1d82ec-aedd-4268-988e-9cb4fea4e264]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5, portal: 172.16.0.220,3260]
Aug 17 18:20:55 user nova-compute[72874]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5, portal: 172.16.0.220,3260] successful.
Aug 17 18:20:55 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:44d2d09e-f58b-4287-a79b-73f2c406e0a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46e0b11-b590-4d35-b0aa-7326ab2ede4d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.407s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] <== disconnect_volume: return (409ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:20:55 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Deleting instance files /opt/stack/data/nova/instances/7c486f7d-bcad-4c83-98bf-f08559259d33_del
Aug 17 18:20:55 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Deletion of /opt/stack/data/nova/instances/7c486f7d-bcad-4c83-98bf-f08559259d33_del complete
Aug 17 18:20:55 user nova-compute[72874]: INFO nova.compute.manager [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Took 1.57 seconds to destroy the instance on the hypervisor.
Aug 17 18:20:55 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:20:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-8b9cffac-f7bc-41bf-b18d-274606524d21 req-6d8dc621-74c9-4495-8bbb-f70fe2f3e73a service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received event network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:20:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8b9cffac-f7bc-41bf-b18d-274606524d21 req-6d8dc621-74c9-4495-8bbb-f70fe2f3e73a service nova] Acquiring lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8b9cffac-f7bc-41bf-b18d-274606524d21 req-6d8dc621-74c9-4495-8bbb-f70fe2f3e73a service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8b9cffac-f7bc-41bf-b18d-274606524d21 req-6d8dc621-74c9-4495-8bbb-f70fe2f3e73a service nova] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-8b9cffac-f7bc-41bf-b18d-274606524d21 req-6d8dc621-74c9-4495-8bbb-f70fe2f3e73a service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] No waiting events found dispatching network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:20:56 user nova-compute[72874]: WARNING nova.compute.manager [req-8b9cffac-f7bc-41bf-b18d-274606524d21 req-6d8dc621-74c9-4495-8bbb-f70fe2f3e73a service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received unexpected event network-vif-plugged-82fadf6c-c99c-4db9-8f9c-f05d33415d5c for instance with vm_state active and task_state deleting.
Aug 17 18:20:56 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:20:56 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Took 1.36 seconds to deallocate network for instance.
Aug 17 18:20:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-65363415-a4df-4f7e-8427-eaed05fa1128 req-99c2aba3-dfc4-4eb6-9365-e5dc84ca2896 service nova] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Received event network-vif-deleted-82fadf6c-c99c-4db9-8f9c-f05d33415d5c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:20:57 user nova-compute[72874]: INFO nova.compute.manager [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Took 0.86 seconds to detach 1 volumes for instance.
Aug 17 18:20:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Deleting volume: 44d2d09e-f58b-4287-a79b-73f2c406e0a5 {{(pid=72874) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 18:20:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:20:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:20:57 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:20:57 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:20:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:58 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Deleted allocations for instance 7c486f7d-bcad-4c83-98bf-f08559259d33
Aug 17 18:20:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7a752221-6a0d-4787-a5f3-4cbc904f44f1 tempest-ServerActionsV293TestJSON-423641309 tempest-ServerActionsV293TestJSON-423641309-project-member] Lock "7c486f7d-bcad-4c83-98bf-f08559259d33" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.506s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:20:58 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296443.2361188, 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:20:58 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] VM Stopped (Lifecycle Event)
Aug 17 18:20:58 user nova-compute[72874]: DEBUG nova.compute.manager [None req-c752937f-56b6-4a4a-87fe-eff2e6282faa None None] [instance: 8bc5f9cb-5a0d-4bcb-b84e-4c44da1d5d83] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:20:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:20:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:21:09 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296454.6713157, 7c486f7d-bcad-4c83-98bf-f08559259d33 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:21:09 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] VM Stopped (Lifecycle Event)
Aug 17 18:21:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3a176aae-3057-4d13-af10-6ec88a6595d6 None None] [instance: 7c486f7d-bcad-4c83-98bf-f08559259d33] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:21:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:10 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:21:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:21:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:21:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:21:10 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:21:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:21:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:13 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:21:14 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:21:14 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:21:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7544MB free_disk=25.470829010009766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance f027045c-d121-45ec-af61-e1a2399c4a43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c2eb160-5b94-4d53-bd36-b712c62d9100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance c9392afe-92e0-4703-bd6f-79d272d541e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2ace97e1-c2ee-462e-a929-22c7cb2584d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance c27fc8b6-cc8c-426a-859d-04722c569cd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 3a2a5fdd-3a21-413b-981a-ecc33051c87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:21:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:15 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:21:15 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:21:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-8c2eb160-5b94-4d53-bd36-b712c62d9100" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:21:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-8c2eb160-5b94-4d53-bd36-b712c62d9100" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:21:16 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:21:17 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Updating instance_info_cache with network_info: [{"id": "99361343-b109-451a-9ce9-50e5fd738b0e", "address": "fa:16:3e:a7:7a:4b", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99361343-b1", "ovs_interfaceid": "99361343-b109-451a-9ce9-50e5fd738b0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:21:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-8c2eb160-5b94-4d53-bd36-b712c62d9100" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:21:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:21:17 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:21:17 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:21:17 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:21:17 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:21:17 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:21:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:18 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:21:18 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:21:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:21:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:21:21 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:21:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:21:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:21:21 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:21:21 user nova-compute[72874]: INFO nova.compute.claims [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Claim successful on node user
Aug 17 18:21:22 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:21:22 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:21:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:21:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:21:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:21:22 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:21:22 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:21:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:21:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:21:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:21:22 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Creating image(s)
Aug 17 18:21:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "/opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:21:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "/opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:21:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "/opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:21:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.202s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:21:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:21:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:22 user nova-compute[72874]: DEBUG nova.policy [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37eba99d36a842ca93af2d82be67dea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d44ed4bf46e4f6bb8d9f9255bfceded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.216s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk 1073741824" returned: 0 in 0.058s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.281s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.233s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Checking if we can resize image /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Cannot resize image /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG nova.objects.instance [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'migration_context' on Instance uuid 857d43f7-6f53-4c82-9e68-fca3078e97ea {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Ensure instance console log exists: /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:21:23 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Successfully created port: 903af9b8-b067-4ada-adc9-3183fe6654ed {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:21:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Successfully updated port: 903af9b8-b067-4ada-adc9-3183fe6654ed {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:21:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "refresh_cache-857d43f7-6f53-4c82-9e68-fca3078e97ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:21:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquired lock "refresh_cache-857d43f7-6f53-4c82-9e68-fca3078e97ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:21:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:21:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-8413a4fe-ce08-4b9c-890b-010217f3ff56 req-21eeb920-9168-4604-ae8b-9a8da67eb004 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Received event network-changed-903af9b8-b067-4ada-adc9-3183fe6654ed {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:21:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-8413a4fe-ce08-4b9c-890b-010217f3ff56 req-21eeb920-9168-4604-ae8b-9a8da67eb004 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Refreshing instance network info cache due to event network-changed-903af9b8-b067-4ada-adc9-3183fe6654ed. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:21:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8413a4fe-ce08-4b9c-890b-010217f3ff56 req-21eeb920-9168-4604-ae8b-9a8da67eb004 service nova] Acquiring lock "refresh_cache-857d43f7-6f53-4c82-9e68-fca3078e97ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:21:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:21:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Updating instance_info_cache with network_info: [{"id": "903af9b8-b067-4ada-adc9-3183fe6654ed", "address": "fa:16:3e:85:9f:87", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903af9b8-b0", "ovs_interfaceid": "903af9b8-b067-4ada-adc9-3183fe6654ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Releasing lock "refresh_cache-857d43f7-6f53-4c82-9e68-fca3078e97ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Instance network_info: |[{"id": "903af9b8-b067-4ada-adc9-3183fe6654ed", "address": "fa:16:3e:85:9f:87", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903af9b8-b0", "ovs_interfaceid": "903af9b8-b067-4ada-adc9-3183fe6654ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8413a4fe-ce08-4b9c-890b-010217f3ff56 req-21eeb920-9168-4604-ae8b-9a8da67eb004 service nova] Acquired lock "refresh_cache-857d43f7-6f53-4c82-9e68-fca3078e97ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.network.neutron [req-8413a4fe-ce08-4b9c-890b-010217f3ff56 req-21eeb920-9168-4604-ae8b-9a8da67eb004 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Refreshing network info cache for port 903af9b8-b067-4ada-adc9-3183fe6654ed {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Start _get_guest_xml network_info=[{"id": "903af9b8-b067-4ada-adc9-3183fe6654ed", "address": "fa:16:3e:85:9f:87", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903af9b8-b0", "ovs_interfaceid": "903af9b8-b067-4ada-adc9-3183fe6654ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:21:25 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:21:25 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:21:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-475172127',display_name='tempest-AttachVolumeNegativeTest-server-475172127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-475172127',id=15,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2qiZMR35MqSrduhNh6ko9KsMQarvyIrmKZfOkASekMWzo0/KGVJSS/2QmNOaYddA0vkTdXnRbdawCp5ZNkjMLF1iT56V5eAIyqaxQnotjs4NPfIHyXMd1uxHGo4lR1g==',key_name='tempest-keypair-2085572254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d44ed4bf46e4f6bb8d9f9255bfceded',ramdisk_id='',reservation_id='r-sdbb7m8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1092460488',owner_user_name='tempest-AttachVolumeNegativeTest-1092460488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eba99d36a842ca93af2d82be67dea1',uuid=857d43f7-6f53-4c82-9e68-fca3078e97ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903af9b8-b067-4ada-adc9-3183fe6654ed", "address": "fa:16:3e:85:9f:87", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903af9b8-b0", "ovs_interfaceid": "903af9b8-b067-4ada-adc9-3183fe6654ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converting VIF {"id": "903af9b8-b067-4ada-adc9-3183fe6654ed", "address": "fa:16:3e:85:9f:87", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903af9b8-b0", "ovs_interfaceid": "903af9b8-b067-4ada-adc9-3183fe6654ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:9f:87,bridge_name='br-int',has_traffic_filtering=True,id=903af9b8-b067-4ada-adc9-3183fe6654ed,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903af9b8-b0') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.objects.instance [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'pci_devices' on Instance uuid 857d43f7-6f53-4c82-9e68-fca3078e97ea {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:21:25 user nova-compute[72874]:   <uuid>857d43f7-6f53-4c82-9e68-fca3078e97ea</uuid>
Aug 17 18:21:25 user nova-compute[72874]:   <name>instance-0000000f</name>
Aug 17 18:21:25 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:21:25 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:21:25 user nova-compute[72874]:   <metadata>
Aug 17 18:21:25 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:21:25 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:21:25 user nova-compute[72874]:       <nova:name>tempest-AttachVolumeNegativeTest-server-475172127</nova:name>
Aug 17 18:21:25 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:21:25</nova:creationTime>
Aug 17 18:21:25 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:21:25 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:21:25 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:21:25 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:21:25 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:21:25 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:21:25 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:21:25 user nova-compute[72874]:       <nova:owner>
Aug 17 18:21:25 user nova-compute[72874]:         <nova:user uuid="37eba99d36a842ca93af2d82be67dea1">tempest-AttachVolumeNegativeTest-1092460488-project-member</nova:user>
Aug 17 18:21:25 user nova-compute[72874]:         <nova:project uuid="9d44ed4bf46e4f6bb8d9f9255bfceded">tempest-AttachVolumeNegativeTest-1092460488</nova:project>
Aug 17 18:21:25 user nova-compute[72874]:       </nova:owner>
Aug 17 18:21:25 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:21:25 user nova-compute[72874]:       <nova:ports>
Aug 17 18:21:25 user nova-compute[72874]:         <nova:port uuid="903af9b8-b067-4ada-adc9-3183fe6654ed">
Aug 17 18:21:25 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 18:21:25 user nova-compute[72874]:         </nova:port>
Aug 17 18:21:25 user nova-compute[72874]:       </nova:ports>
Aug 17 18:21:25 user nova-compute[72874]:     </nova:instance>
Aug 17 18:21:25 user nova-compute[72874]:   </metadata>
Aug 17 18:21:25 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:21:25 user nova-compute[72874]:     <system>
Aug 17 18:21:25 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:21:25 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:21:25 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:21:25 user nova-compute[72874]:       <entry name="serial">857d43f7-6f53-4c82-9e68-fca3078e97ea</entry>
Aug 17 18:21:25 user nova-compute[72874]:       <entry name="uuid">857d43f7-6f53-4c82-9e68-fca3078e97ea</entry>
Aug 17 18:21:25 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:21:25 user nova-compute[72874]:     </system>
Aug 17 18:21:25 user nova-compute[72874]:   </sysinfo>
Aug 17 18:21:25 user nova-compute[72874]:   <os>
Aug 17 18:21:25 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:21:25 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:21:25 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:21:25 user nova-compute[72874]:   </os>
Aug 17 18:21:25 user nova-compute[72874]:   <features>
Aug 17 18:21:25 user nova-compute[72874]:     <acpi/>
Aug 17 18:21:25 user nova-compute[72874]:     <apic/>
Aug 17 18:21:25 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:21:25 user nova-compute[72874]:   </features>
Aug 17 18:21:25 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:21:25 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:21:25 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:21:25 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:21:25 user nova-compute[72874]:   </clock>
Aug 17 18:21:25 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:21:25 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:21:25 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:21:25 user nova-compute[72874]:   </cpu>
Aug 17 18:21:25 user nova-compute[72874]:   <devices>
Aug 17 18:21:25 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:21:25 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:21:25 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk"/>
Aug 17 18:21:25 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:21:25 user nova-compute[72874]:     </disk>
Aug 17 18:21:25 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:21:25 user nova-compute[72874]:       <mac address="fa:16:3e:85:9f:87"/>
Aug 17 18:21:25 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:21:25 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:21:25 user nova-compute[72874]:       <target dev="tap903af9b8-b0"/>
Aug 17 18:21:25 user nova-compute[72874]:     </interface>
Aug 17 18:21:25 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:21:25 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/console.log" append="off"/>
Aug 17 18:21:25 user nova-compute[72874]:     </serial>
Aug 17 18:21:25 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:21:25 user nova-compute[72874]:     <video>
Aug 17 18:21:25 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:21:25 user nova-compute[72874]:     </video>
Aug 17 18:21:25 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:21:25 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:21:25 user nova-compute[72874]:     </rng>
Aug 17 18:21:25 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:21:25 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:21:25 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:21:25 user nova-compute[72874]:     </memballoon>
Aug 17 18:21:25 user nova-compute[72874]:   </devices>
Aug 17 18:21:25 user nova-compute[72874]: </domain>
Aug 17 18:21:25 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:21:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-475172127',display_name='tempest-AttachVolumeNegativeTest-server-475172127',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-475172127',id=15,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2qiZMR35MqSrduhNh6ko9KsMQarvyIrmKZfOkASekMWzo0/KGVJSS/2QmNOaYddA0vkTdXnRbdawCp5ZNkjMLF1iT56V5eAIyqaxQnotjs4NPfIHyXMd1uxHGo4lR1g==',key_name='tempest-keypair-2085572254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d44ed4bf46e4f6bb8d9f9255bfceded',ramdisk_id='',reservation_id='r-sdbb7m8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1092460488',owner_user_name='tempest-AttachVolumeNegativeTest-1092460488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:21:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eba99d36a842ca93af2d82be67dea1',uuid=857d43f7-6f53-4c82-9e68-fca3078e97ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903af9b8-b067-4ada-adc9-3183fe6654ed", "address": "fa:16:3e:85:9f:87", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903af9b8-b0", "ovs_interfaceid": "903af9b8-b067-4ada-adc9-3183fe6654ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converting VIF {"id": "903af9b8-b067-4ada-adc9-3183fe6654ed", "address": "fa:16:3e:85:9f:87", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903af9b8-b0", "ovs_interfaceid": "903af9b8-b067-4ada-adc9-3183fe6654ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:9f:87,bridge_name='br-int',has_traffic_filtering=True,id=903af9b8-b067-4ada-adc9-3183fe6654ed,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903af9b8-b0') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG os_vif [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:9f:87,bridge_name='br-int',has_traffic_filtering=True,id=903af9b8-b067-4ada-adc9-3183fe6654ed,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903af9b8-b0') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap903af9b8-b0, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap903af9b8-b0, col_values=(('external_ids', {'iface-id': '903af9b8-b067-4ada-adc9-3183fe6654ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:9f:87', 'vm-uuid': '857d43f7-6f53-4c82-9e68-fca3078e97ea'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:25 user nova-compute[72874]: INFO os_vif [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:9f:87,bridge_name='br-int',has_traffic_filtering=True,id=903af9b8-b067-4ada-adc9-3183fe6654ed,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903af9b8-b0')
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] No VIF found with MAC fa:16:3e:85:9f:87, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.network.neutron [req-8413a4fe-ce08-4b9c-890b-010217f3ff56 req-21eeb920-9168-4604-ae8b-9a8da67eb004 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Updated VIF entry in instance network info cache for port 903af9b8-b067-4ada-adc9-3183fe6654ed. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG nova.network.neutron [req-8413a4fe-ce08-4b9c-890b-010217f3ff56 req-21eeb920-9168-4604-ae8b-9a8da67eb004 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Updating instance_info_cache with network_info: [{"id": "903af9b8-b067-4ada-adc9-3183fe6654ed", "address": "fa:16:3e:85:9f:87", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903af9b8-b0", "ovs_interfaceid": "903af9b8-b067-4ada-adc9-3183fe6654ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:21:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8413a4fe-ce08-4b9c-890b-010217f3ff56 req-21eeb920-9168-4604-ae8b-9a8da67eb004 service nova] Releasing lock "refresh_cache-857d43f7-6f53-4c82-9e68-fca3078e97ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:21:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-654d82fb-556d-4841-b975-0be193bffcae req-f5f12830-8c2b-4bae-984d-f10956cc958f service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Received event network-vif-plugged-903af9b8-b067-4ada-adc9-3183fe6654ed {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:21:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-654d82fb-556d-4841-b975-0be193bffcae req-f5f12830-8c2b-4bae-984d-f10956cc958f service nova] Acquiring lock "857d43f7-6f53-4c82-9e68-fca3078e97ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:21:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-654d82fb-556d-4841-b975-0be193bffcae req-f5f12830-8c2b-4bae-984d-f10956cc958f service nova] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:21:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-654d82fb-556d-4841-b975-0be193bffcae req-f5f12830-8c2b-4bae-984d-f10956cc958f service nova] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:21:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-654d82fb-556d-4841-b975-0be193bffcae req-f5f12830-8c2b-4bae-984d-f10956cc958f service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] No waiting events found dispatching network-vif-plugged-903af9b8-b067-4ada-adc9-3183fe6654ed {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:21:27 user nova-compute[72874]: WARNING nova.compute.manager [req-654d82fb-556d-4841-b975-0be193bffcae req-f5f12830-8c2b-4bae-984d-f10956cc958f service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Received unexpected event network-vif-plugged-903af9b8-b067-4ada-adc9-3183fe6654ed for instance with vm_state building and task_state spawning.
Aug 17 18:21:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-193faaf0-4534-4726-a1e1-074ef7996daa req-63f66969-23f9-4a29-a773-4db2b5a957f0 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Received event network-vif-plugged-903af9b8-b067-4ada-adc9-3183fe6654ed {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:21:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-193faaf0-4534-4726-a1e1-074ef7996daa req-63f66969-23f9-4a29-a773-4db2b5a957f0 service nova] Acquiring lock "857d43f7-6f53-4c82-9e68-fca3078e97ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:21:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-193faaf0-4534-4726-a1e1-074ef7996daa req-63f66969-23f9-4a29-a773-4db2b5a957f0 service nova] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:21:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-193faaf0-4534-4726-a1e1-074ef7996daa req-63f66969-23f9-4a29-a773-4db2b5a957f0 service nova] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-193faaf0-4534-4726-a1e1-074ef7996daa req-63f66969-23f9-4a29-a773-4db2b5a957f0 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] No waiting events found dispatching network-vif-plugged-903af9b8-b067-4ada-adc9-3183fe6654ed {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:21:29 user nova-compute[72874]: WARNING nova.compute.manager [req-193faaf0-4534-4726-a1e1-074ef7996daa req-63f66969-23f9-4a29-a773-4db2b5a957f0 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Received unexpected event network-vif-plugged-903af9b8-b067-4ada-adc9-3183fe6654ed for instance with vm_state building and task_state spawning.
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296489.5276117, 857d43f7-6f53-4c82-9e68-fca3078e97ea => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:21:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] VM Resumed (Lifecycle Event)
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:21:29 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Instance spawned successfully.
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:21:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296489.529751, 857d43f7-6f53-4c82-9e68-fca3078e97ea => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:21:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] VM Started (Lifecycle Event)
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:21:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:21:29 user nova-compute[72874]: INFO nova.compute.manager [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Took 6.97 seconds to spawn the instance on the hypervisor.
Aug 17 18:21:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:21:29 user nova-compute[72874]: INFO nova.compute.manager [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Took 7.82 seconds to build instance.
Aug 17 18:21:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2671a015-ac21-407b-a0d6-26a7e5731664 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.932s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:21:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-6dd7d5c3-7347-4a9e-9363-a89b694d85ea req-366a4e8f-2787-4367-9f31-bda7d1e55b6b service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received event network-changed-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:21:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-6dd7d5c3-7347-4a9e-9363-a89b694d85ea req-366a4e8f-2787-4367-9f31-bda7d1e55b6b service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Refreshing instance network info cache due to event network-changed-d6319754-2bba-45a4-9db3-9fcf99c0c33c. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:21:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6dd7d5c3-7347-4a9e-9363-a89b694d85ea req-366a4e8f-2787-4367-9f31-bda7d1e55b6b service nova] Acquiring lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:21:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6dd7d5c3-7347-4a9e-9363-a89b694d85ea req-366a4e8f-2787-4367-9f31-bda7d1e55b6b service nova] Acquired lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:21:44 user nova-compute[72874]: DEBUG nova.network.neutron [req-6dd7d5c3-7347-4a9e-9363-a89b694d85ea req-366a4e8f-2787-4367-9f31-bda7d1e55b6b service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Refreshing network info cache for port d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:21:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:45 user nova-compute[72874]: DEBUG nova.network.neutron [req-6dd7d5c3-7347-4a9e-9363-a89b694d85ea req-366a4e8f-2787-4367-9f31-bda7d1e55b6b service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updated VIF entry in instance network info cache for port d6319754-2bba-45a4-9db3-9fcf99c0c33c. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:21:45 user nova-compute[72874]: DEBUG nova.network.neutron [req-6dd7d5c3-7347-4a9e-9363-a89b694d85ea req-366a4e8f-2787-4367-9f31-bda7d1e55b6b service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updating instance_info_cache with network_info: [{"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:21:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6dd7d5c3-7347-4a9e-9363-a89b694d85ea req-366a4e8f-2787-4367-9f31-bda7d1e55b6b service nova] Releasing lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:21:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "c9392afe-92e0-4703-bd6f-79d272d541e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "c9392afe-92e0-4703-bd6f-79d272d541e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "c9392afe-92e0-4703-bd6f-79d272d541e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "c9392afe-92e0-4703-bd6f-79d272d541e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "c9392afe-92e0-4703-bd6f-79d272d541e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:21:55 user nova-compute[72874]: INFO nova.compute.manager [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Terminating instance
Aug 17 18:21:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-6be545d7-3e72-49a9-8457-a61fe29ac291 req-add5adcf-b3af-4d2f-893b-300b779d13db service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Received event network-vif-unplugged-a1886d6b-a20c-4565-a8ef-0507787724ef {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6be545d7-3e72-49a9-8457-a61fe29ac291 req-add5adcf-b3af-4d2f-893b-300b779d13db service nova] Acquiring lock "c9392afe-92e0-4703-bd6f-79d272d541e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6be545d7-3e72-49a9-8457-a61fe29ac291 req-add5adcf-b3af-4d2f-893b-300b779d13db service nova] Lock "c9392afe-92e0-4703-bd6f-79d272d541e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6be545d7-3e72-49a9-8457-a61fe29ac291 req-add5adcf-b3af-4d2f-893b-300b779d13db service nova] Lock "c9392afe-92e0-4703-bd6f-79d272d541e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-6be545d7-3e72-49a9-8457-a61fe29ac291 req-add5adcf-b3af-4d2f-893b-300b779d13db service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] No waiting events found dispatching network-vif-unplugged-a1886d6b-a20c-4565-a8ef-0507787724ef {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-6be545d7-3e72-49a9-8457-a61fe29ac291 req-add5adcf-b3af-4d2f-893b-300b779d13db service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Received event network-vif-unplugged-a1886d6b-a20c-4565-a8ef-0507787724ef for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:55 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Instance destroyed successfully.
Aug 17 18:21:55 user nova-compute[72874]: DEBUG nova.objects.instance [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lazy-loading 'resources' on Instance uuid c9392afe-92e0-4703-bd6f-79d272d541e3 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1203647482',display_name='tempest-VolumesAdminNegativeTest-server-1203647482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1203647482',id=12,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:20:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3fe8a83be9b440b95aa258c4dff6af4',ramdisk_id='',reservation_id='r-nus44bud',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1606846933',owner_user_name='tempest-VolumesAdminNegativeTest-1606846933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:20:01Z,user_data=None,user_id='2f400334282b4272a8f78d682f3816d0',uuid=c9392afe-92e0-4703-bd6f-79d272d541e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1886d6b-a20c-4565-a8ef-0507787724ef", "address": "fa:16:3e:ad:89:fe", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1886d6b-a2", "ovs_interfaceid": "a1886d6b-a20c-4565-a8ef-0507787724ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Converting VIF {"id": "a1886d6b-a20c-4565-a8ef-0507787724ef", "address": "fa:16:3e:ad:89:fe", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1886d6b-a2", "ovs_interfaceid": "a1886d6b-a20c-4565-a8ef-0507787724ef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:89:fe,bridge_name='br-int',has_traffic_filtering=True,id=a1886d6b-a20c-4565-a8ef-0507787724ef,network=Network(92a988c2-183c-41cc-9b97-59474938a618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1886d6b-a2') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG os_vif [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:89:fe,bridge_name='br-int',has_traffic_filtering=True,id=a1886d6b-a20c-4565-a8ef-0507787724ef,network=Network(92a988c2-183c-41cc-9b97-59474938a618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1886d6b-a2') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1886d6b-a2, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:21:55 user nova-compute[72874]: INFO os_vif [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:89:fe,bridge_name='br-int',has_traffic_filtering=True,id=a1886d6b-a20c-4565-a8ef-0507787724ef,network=Network(92a988c2-183c-41cc-9b97-59474938a618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1886d6b-a2')
Aug 17 18:21:55 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Deleting instance files /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3_del
Aug 17 18:21:55 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Deletion of /opt/stack/data/nova/instances/c9392afe-92e0-4703-bd6f-79d272d541e3_del complete
Aug 17 18:21:55 user nova-compute[72874]: INFO nova.compute.manager [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 17 18:21:55 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:21:55 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:21:56 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:21:56 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Took 0.82 seconds to deallocate network for instance.
Aug 17 18:21:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:21:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:21:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-aa9b18b0-045f-44ee-8c23-9d5dd5981822 req-19b1f725-ae13-41d4-854f-2009df4dbfcd service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Received event network-vif-deleted-a1886d6b-a20c-4565-a8ef-0507787724ef {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:21:57 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:21:57 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:21:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:21:57 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Deleted allocations for instance c9392afe-92e0-4703-bd6f-79d272d541e3
Aug 17 18:21:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29a687f1-fe13-46a0-8c2a-a50d63e7000a tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "c9392afe-92e0-4703-bd6f-79d272d541e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.371s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:21:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:21:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-65737fde-f777-47ed-8005-1a42ceb747f5 req-19a9f099-4832-43d5-88c6-b97f3b456819 service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Received event network-vif-plugged-a1886d6b-a20c-4565-a8ef-0507787724ef {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:21:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-65737fde-f777-47ed-8005-1a42ceb747f5 req-19a9f099-4832-43d5-88c6-b97f3b456819 service nova] Acquiring lock "c9392afe-92e0-4703-bd6f-79d272d541e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:21:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-65737fde-f777-47ed-8005-1a42ceb747f5 req-19a9f099-4832-43d5-88c6-b97f3b456819 service nova] Lock "c9392afe-92e0-4703-bd6f-79d272d541e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:21:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-65737fde-f777-47ed-8005-1a42ceb747f5 req-19a9f099-4832-43d5-88c6-b97f3b456819 service nova] Lock "c9392afe-92e0-4703-bd6f-79d272d541e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:21:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-65737fde-f777-47ed-8005-1a42ceb747f5 req-19a9f099-4832-43d5-88c6-b97f3b456819 service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] No waiting events found dispatching network-vif-plugged-a1886d6b-a20c-4565-a8ef-0507787724ef {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:21:57 user nova-compute[72874]: WARNING nova.compute.manager [req-65737fde-f777-47ed-8005-1a42ceb747f5 req-19a9f099-4832-43d5-88c6-b97f3b456819 service nova] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Received unexpected event network-vif-plugged-a1886d6b-a20c-4565-a8ef-0507787724ef for instance with vm_state deleted and task_state None.
Aug 17 18:22:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:00 user nova-compute[72874]: INFO nova.compute.manager [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Detaching volume c387b29c-dd79-49d3-b1e0-542036eecbc7
Aug 17 18:22:00 user nova-compute[72874]: INFO nova.virt.block_device [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Attempting to driver detach volume c387b29c-dd79-49d3-b1e0-542036eecbc7 from mountpoint /dev/vdc
Aug 17 18:22:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Attempting to detach device vdc from instance c27fc8b6-cc8c-426a-859d-04722c569cd4 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:22:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:22:00 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:22:00 user nova-compute[72874]:   <source dev="/dev/sdd"/>
Aug 17 18:22:00 user nova-compute[72874]:   <target dev="vdc" bus="virtio"/>
Aug 17 18:22:00 user nova-compute[72874]:   <serial>c387b29c-dd79-49d3-b1e0-542036eecbc7</serial>
Aug 17 18:22:00 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 18:22:00 user nova-compute[72874]: </disk>
Aug 17 18:22:00 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:22:00 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Successfully detached device vdc from instance c27fc8b6-cc8c-426a-859d-04722c569cd4 from the persistent domain config.
Aug 17 18:22:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c27fc8b6-cc8c-426a-859d-04722c569cd4 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:22:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:22:00 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:22:00 user nova-compute[72874]:   <source dev="/dev/sdd"/>
Aug 17 18:22:00 user nova-compute[72874]:   <target dev="vdc" bus="virtio"/>
Aug 17 18:22:00 user nova-compute[72874]:   <serial>c387b29c-dd79-49d3-b1e0-542036eecbc7</serial>
Aug 17 18:22:00 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 18:22:00 user nova-compute[72874]: </disk>
Aug 17 18:22:00 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:22:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692296521.128305, c27fc8b6-cc8c-426a-859d-04722c569cd4 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c27fc8b6-cc8c-426a-859d-04722c569cd4 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:22:01 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Successfully detached device vdc from instance c27fc8b6-cc8c-426a-859d-04722c569cd4 from the live domain config.
Aug 17 18:22:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eOgDKhFG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:22:01 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4966bbfc-9c50-4409-b9d3-6392a631c2ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[73038301-d3ec-457a-bc51-eda652097b15]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:22:01 user nova-compute[72874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 (non-flash)
Aug 17 18:22:01 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:22:01 user nova-compute[72874]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 (non-flash)
Aug 17 18:22:01 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6ef2ea710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7'): ({'sdd'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Removing single pathed devices sdd {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f63714-b550-4518-a1ce-cab9592104eb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f12b5cc-481a-45cf-b389-ea40f75b60ab]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Flushing IO for device /dev/sdd {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[902896cb-1ddb-4d9c-b307-6fdf38d1851f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e525f1-5b08-4966-8004-4f1b1437f667]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef0820f-1520-492e-9dbc-6ed6a4fa82f4]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfc03b2-374b-417f-be61-49cce0daa3c6]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7, portal: 172.16.0.220,3260]
Aug 17 18:22:01 user nova-compute[72874]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7, portal: 172.16.0.220,3260] successful.
Aug 17 18:22:01 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c387b29c-dd79-49d3-b1e0-542036eecbc7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6597ab-784c-4e24-90b7-d1d7d13808be]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] <== disconnect_volume: return (314ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:22:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:22:02 user nova-compute[72874]: DEBUG nova.objects.instance [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'flavor' on Instance uuid c27fc8b6-cc8c-426a-859d-04722c569cd4 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "9b638f7b-ba47-403f-be22-a65a39ed8438" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:22:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1a6b3f4e-edef-4917-8706-3f807066d571 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.111s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:02 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:22:02 user nova-compute[72874]: INFO nova.compute.claims [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Claim successful on node user
Aug 17 18:22:03 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG nova.network.neutron [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:22:03 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:22:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG nova.policy [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd13289795c8b4991a9cf6bb2880ad6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a550f3591d1347bf8b9fb4d3e90b8aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:22:03 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Creating image(s)
Aug 17 18:22:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "/opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "/opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.210s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.216s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk 1073741824" returned: 0 in 0.055s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:04 user nova-compute[72874]: DEBUG nova.network.neutron [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Successfully created port: 2e25bfc2-dfe4-4e04-88cb-9347ef481944 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:22:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.205s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:04 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:22:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:04 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Cannot resize image /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:22:04 user nova-compute[72874]: DEBUG nova.objects.instance [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'migration_context' on Instance uuid 9b638f7b-ba47-403f-be22-a65a39ed8438 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:22:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Ensure instance console log exists: /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:22:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.network.neutron [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Successfully updated port: 2e25bfc2-dfe4-4e04-88cb-9347ef481944 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquired lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.network.neutron [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.compute.manager [req-ba7d020c-fed4-43af-bb0b-fe856fff6bf9 req-dd176057-d5a7-434f-a27b-bb44bc84168d service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Received event network-changed-2e25bfc2-dfe4-4e04-88cb-9347ef481944 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.compute.manager [req-ba7d020c-fed4-43af-bb0b-fe856fff6bf9 req-dd176057-d5a7-434f-a27b-bb44bc84168d service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Refreshing instance network info cache due to event network-changed-2e25bfc2-dfe4-4e04-88cb-9347ef481944. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ba7d020c-fed4-43af-bb0b-fe856fff6bf9 req-dd176057-d5a7-434f-a27b-bb44bc84168d service nova] Acquiring lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.network.neutron [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.network.neutron [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Updating instance_info_cache with network_info: [{"id": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "address": "fa:16:3e:25:a4:9a", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e25bfc2-df", "ovs_interfaceid": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Releasing lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Instance network_info: |[{"id": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "address": "fa:16:3e:25:a4:9a", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e25bfc2-df", "ovs_interfaceid": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ba7d020c-fed4-43af-bb0b-fe856fff6bf9 req-dd176057-d5a7-434f-a27b-bb44bc84168d service nova] Acquired lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.network.neutron [req-ba7d020c-fed4-43af-bb0b-fe856fff6bf9 req-dd176057-d5a7-434f-a27b-bb44bc84168d service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Refreshing network info cache for port 2e25bfc2-dfe4-4e04-88cb-9347ef481944 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Start _get_guest_xml network_info=[{"id": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "address": "fa:16:3e:25:a4:9a", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e25bfc2-df", "ovs_interfaceid": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:22:05 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:22:05 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:22:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-442790918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-442790918',id=16,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a550f3591d1347bf8b9fb4d3e90b8aad',ramdisk_id='',reservation_id='r-jr0zooor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-68498997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:22:03Z,user_data=None,user_id='d13289795c8b4991a9cf6bb2880ad6ef',uuid=9b638f7b-ba47-403f-be22-a65a39ed8438,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "address": "fa:16:3e:25:a4:9a", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e25bfc2-df", "ovs_interfaceid": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converting VIF {"id": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "address": "fa:16:3e:25:a4:9a", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e25bfc2-df", "ovs_interfaceid": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:a4:9a,bridge_name='br-int',has_traffic_filtering=True,id=2e25bfc2-dfe4-4e04-88cb-9347ef481944,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e25bfc2-df') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.objects.instance [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b638f7b-ba47-403f-be22-a65a39ed8438 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:22:05 user nova-compute[72874]:   <uuid>9b638f7b-ba47-403f-be22-a65a39ed8438</uuid>
Aug 17 18:22:05 user nova-compute[72874]:   <name>instance-00000010</name>
Aug 17 18:22:05 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:22:05 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:22:05 user nova-compute[72874]:   <metadata>
Aug 17 18:22:05 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:22:05 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:22:05 user nova-compute[72874]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-442790918</nova:name>
Aug 17 18:22:05 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:22:05</nova:creationTime>
Aug 17 18:22:05 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:22:05 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:22:05 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:22:05 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:22:05 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:22:05 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:22:05 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:22:05 user nova-compute[72874]:       <nova:owner>
Aug 17 18:22:05 user nova-compute[72874]:         <nova:user uuid="d13289795c8b4991a9cf6bb2880ad6ef">tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member</nova:user>
Aug 17 18:22:05 user nova-compute[72874]:         <nova:project uuid="a550f3591d1347bf8b9fb4d3e90b8aad">tempest-ServerBootFromVolumeStableRescueTest-68498997</nova:project>
Aug 17 18:22:05 user nova-compute[72874]:       </nova:owner>
Aug 17 18:22:05 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:22:05 user nova-compute[72874]:       <nova:ports>
Aug 17 18:22:05 user nova-compute[72874]:         <nova:port uuid="2e25bfc2-dfe4-4e04-88cb-9347ef481944">
Aug 17 18:22:05 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 18:22:05 user nova-compute[72874]:         </nova:port>
Aug 17 18:22:05 user nova-compute[72874]:       </nova:ports>
Aug 17 18:22:05 user nova-compute[72874]:     </nova:instance>
Aug 17 18:22:05 user nova-compute[72874]:   </metadata>
Aug 17 18:22:05 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:22:05 user nova-compute[72874]:     <system>
Aug 17 18:22:05 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:22:05 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:22:05 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:22:05 user nova-compute[72874]:       <entry name="serial">9b638f7b-ba47-403f-be22-a65a39ed8438</entry>
Aug 17 18:22:05 user nova-compute[72874]:       <entry name="uuid">9b638f7b-ba47-403f-be22-a65a39ed8438</entry>
Aug 17 18:22:05 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:22:05 user nova-compute[72874]:     </system>
Aug 17 18:22:05 user nova-compute[72874]:   </sysinfo>
Aug 17 18:22:05 user nova-compute[72874]:   <os>
Aug 17 18:22:05 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:22:05 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:22:05 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:22:05 user nova-compute[72874]:   </os>
Aug 17 18:22:05 user nova-compute[72874]:   <features>
Aug 17 18:22:05 user nova-compute[72874]:     <acpi/>
Aug 17 18:22:05 user nova-compute[72874]:     <apic/>
Aug 17 18:22:05 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:22:05 user nova-compute[72874]:   </features>
Aug 17 18:22:05 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:22:05 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:22:05 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:22:05 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:22:05 user nova-compute[72874]:   </clock>
Aug 17 18:22:05 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:22:05 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:22:05 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:22:05 user nova-compute[72874]:   </cpu>
Aug 17 18:22:05 user nova-compute[72874]:   <devices>
Aug 17 18:22:05 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:22:05 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:22:05 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk"/>
Aug 17 18:22:05 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:22:05 user nova-compute[72874]:     </disk>
Aug 17 18:22:05 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:22:05 user nova-compute[72874]:       <mac address="fa:16:3e:25:a4:9a"/>
Aug 17 18:22:05 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:22:05 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:22:05 user nova-compute[72874]:       <target dev="tap2e25bfc2-df"/>
Aug 17 18:22:05 user nova-compute[72874]:     </interface>
Aug 17 18:22:05 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:22:05 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/console.log" append="off"/>
Aug 17 18:22:05 user nova-compute[72874]:     </serial>
Aug 17 18:22:05 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:22:05 user nova-compute[72874]:     <video>
Aug 17 18:22:05 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:22:05 user nova-compute[72874]:     </video>
Aug 17 18:22:05 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:22:05 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:22:05 user nova-compute[72874]:     </rng>
Aug 17 18:22:05 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:22:05 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:22:05 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:22:05 user nova-compute[72874]:     </memballoon>
Aug 17 18:22:05 user nova-compute[72874]:   </devices>
Aug 17 18:22:05 user nova-compute[72874]: </domain>
Aug 17 18:22:05 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:22:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-442790918',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-442790918',id=16,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a550f3591d1347bf8b9fb4d3e90b8aad',ramdisk_id='',reservation_id='r-jr0zooor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-68498997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:22:03Z,user_data=None,user_id='d13289795c8b4991a9cf6bb2880ad6ef',uuid=9b638f7b-ba47-403f-be22-a65a39ed8438,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "address": "fa:16:3e:25:a4:9a", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e25bfc2-df", "ovs_interfaceid": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converting VIF {"id": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "address": "fa:16:3e:25:a4:9a", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e25bfc2-df", "ovs_interfaceid": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:a4:9a,bridge_name='br-int',has_traffic_filtering=True,id=2e25bfc2-dfe4-4e04-88cb-9347ef481944,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e25bfc2-df') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG os_vif [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:a4:9a,bridge_name='br-int',has_traffic_filtering=True,id=2e25bfc2-dfe4-4e04-88cb-9347ef481944,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e25bfc2-df') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e25bfc2-df, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2e25bfc2-df, col_values=(('external_ids', {'iface-id': '2e25bfc2-dfe4-4e04-88cb-9347ef481944', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:a4:9a', 'vm-uuid': '9b638f7b-ba47-403f-be22-a65a39ed8438'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:05 user nova-compute[72874]: INFO os_vif [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:a4:9a,bridge_name='br-int',has_traffic_filtering=True,id=2e25bfc2-dfe4-4e04-88cb-9347ef481944,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e25bfc2-df')
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:22:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] No VIF found with MAC fa:16:3e:25:a4:9a, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:22:06 user nova-compute[72874]: DEBUG nova.network.neutron [req-ba7d020c-fed4-43af-bb0b-fe856fff6bf9 req-dd176057-d5a7-434f-a27b-bb44bc84168d service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Updated VIF entry in instance network info cache for port 2e25bfc2-dfe4-4e04-88cb-9347ef481944. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:22:06 user nova-compute[72874]: DEBUG nova.network.neutron [req-ba7d020c-fed4-43af-bb0b-fe856fff6bf9 req-dd176057-d5a7-434f-a27b-bb44bc84168d service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Updating instance_info_cache with network_info: [{"id": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "address": "fa:16:3e:25:a4:9a", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e25bfc2-df", "ovs_interfaceid": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:22:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ba7d020c-fed4-43af-bb0b-fe856fff6bf9 req-dd176057-d5a7-434f-a27b-bb44bc84168d service nova] Releasing lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:22:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-a8fdae1d-8e64-4388-bcec-e23d2d58c8f0 req-78c8768e-b1cf-4682-891f-536583a64d81 service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Received event network-vif-plugged-2e25bfc2-dfe4-4e04-88cb-9347ef481944 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a8fdae1d-8e64-4388-bcec-e23d2d58c8f0 req-78c8768e-b1cf-4682-891f-536583a64d81 service nova] Acquiring lock "9b638f7b-ba47-403f-be22-a65a39ed8438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a8fdae1d-8e64-4388-bcec-e23d2d58c8f0 req-78c8768e-b1cf-4682-891f-536583a64d81 service nova] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a8fdae1d-8e64-4388-bcec-e23d2d58c8f0 req-78c8768e-b1cf-4682-891f-536583a64d81 service nova] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-a8fdae1d-8e64-4388-bcec-e23d2d58c8f0 req-78c8768e-b1cf-4682-891f-536583a64d81 service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] No waiting events found dispatching network-vif-plugged-2e25bfc2-dfe4-4e04-88cb-9347ef481944 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:07 user nova-compute[72874]: WARNING nova.compute.manager [req-a8fdae1d-8e64-4388-bcec-e23d2d58c8f0 req-78c8768e-b1cf-4682-891f-536583a64d81 service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Received unexpected event network-vif-plugged-2e25bfc2-dfe4-4e04-88cb-9347ef481944 for instance with vm_state building and task_state spawning.
Aug 17 18:22:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-c9c4c1dd-fb8a-4e7b-a3e8-fa79df1a49ae req-c2416143-94cb-4289-8987-18d2b585b1b2 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received event network-changed-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-c9c4c1dd-fb8a-4e7b-a3e8-fa79df1a49ae req-c2416143-94cb-4289-8987-18d2b585b1b2 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Refreshing instance network info cache due to event network-changed-fd5a0e28-4b48-4668-b9d6-2108a63c618f. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:22:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c9c4c1dd-fb8a-4e7b-a3e8-fa79df1a49ae req-c2416143-94cb-4289-8987-18d2b585b1b2 service nova] Acquiring lock "refresh_cache-3a2a5fdd-3a21-413b-981a-ecc33051c87b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:22:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c9c4c1dd-fb8a-4e7b-a3e8-fa79df1a49ae req-c2416143-94cb-4289-8987-18d2b585b1b2 service nova] Acquired lock "refresh_cache-3a2a5fdd-3a21-413b-981a-ecc33051c87b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:22:07 user nova-compute[72874]: DEBUG nova.network.neutron [req-c9c4c1dd-fb8a-4e7b-a3e8-fa79df1a49ae req-c2416143-94cb-4289-8987-18d2b585b1b2 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Refreshing network info cache for port fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:22:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG nova.objects.instance [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'flavor' on Instance uuid 3a2a5fdd-3a21-413b-981a-ecc33051c87b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG nova.network.neutron [req-c9c4c1dd-fb8a-4e7b-a3e8-fa79df1a49ae req-c2416143-94cb-4289-8987-18d2b585b1b2 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Updated VIF entry in instance network info cache for port fd5a0e28-4b48-4668-b9d6-2108a63c618f. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG nova.network.neutron [req-c9c4c1dd-fb8a-4e7b-a3e8-fa79df1a49ae req-c2416143-94cb-4289-8987-18d2b585b1b2 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Updating instance_info_cache with network_info: [{"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c9c4c1dd-fb8a-4e7b-a3e8-fa79df1a49ae req-c2416143-94cb-4289-8987-18d2b585b1b2 service nova] Releasing lock "refresh_cache-3a2a5fdd-3a21-413b-981a-ecc33051c87b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:08 user nova-compute[72874]: INFO nova.compute.manager [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Attaching volume 4a51f77d-20d8-47d0-b4b9-92bed472f30a to /dev/vdb
Aug 17 18:22:08 user nova-compute[72874]: DEBUG os_brick.utils [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[162ac0e5-318a-452d-ab7a-c51701832a5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ec903b-6cf6-4e29-9e87-86365e122504]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8745d94-7308-42d2-8f6c-ee29600e5d36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22e8a87-aecc-4cf7-b772-a6da940d202d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:22:08 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:22:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fac2c58-570c-4d16-9fb4-d7de28b1b4d8]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG os_brick.utils [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:22:08 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Updating existing volume attachment record: c0802fdf-47d1-4c16-bc4d-2a340ef9b052 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.compute.manager [req-06e342f2-d7fa-4f94-8340-85f724cbc4a1 req-92350948-1ae9-46a1-bd44-edb829999b1c service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Received event network-vif-plugged-2e25bfc2-dfe4-4e04-88cb-9347ef481944 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-06e342f2-d7fa-4f94-8340-85f724cbc4a1 req-92350948-1ae9-46a1-bd44-edb829999b1c service nova] Acquiring lock "9b638f7b-ba47-403f-be22-a65a39ed8438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-06e342f2-d7fa-4f94-8340-85f724cbc4a1 req-92350948-1ae9-46a1-bd44-edb829999b1c service nova] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-06e342f2-d7fa-4f94-8340-85f724cbc4a1 req-92350948-1ae9-46a1-bd44-edb829999b1c service nova] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.compute.manager [req-06e342f2-d7fa-4f94-8340-85f724cbc4a1 req-92350948-1ae9-46a1-bd44-edb829999b1c service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] No waiting events found dispatching network-vif-plugged-2e25bfc2-dfe4-4e04-88cb-9347ef481944 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:09 user nova-compute[72874]: WARNING nova.compute.manager [req-06e342f2-d7fa-4f94-8340-85f724cbc4a1 req-92350948-1ae9-46a1-bd44-edb829999b1c service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Received unexpected event network-vif-plugged-2e25bfc2-dfe4-4e04-88cb-9347ef481944 for instance with vm_state building and task_state spawning.
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296529.5657468, 9b638f7b-ba47-403f-be22-a65a39ed8438 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:22:09 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] VM Resumed (Lifecycle Event)
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:22:09 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Instance spawned successfully.
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:09 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296529.5670109, 9b638f7b-ba47-403f-be22-a65a39ed8438 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:22:09 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] VM Started (Lifecycle Event)
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:22:09 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:22:09 user nova-compute[72874]: INFO nova.compute.manager [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Took 6.29 seconds to spawn the instance on the hypervisor.
Aug 17 18:22:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:22:09 user nova-compute[72874]: INFO nova.compute.manager [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Took 7.05 seconds to build instance.
Aug 17 18:22:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-698b2781-dbf6-4491-92c4-3dd7a0a17a98 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.212s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:10 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:22:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:10 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:22:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:22:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:10 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296515.8538845, c9392afe-92e0-4703-bd6f-79d272d541e3 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:22:10 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] VM Stopped (Lifecycle Event)
Aug 17 18:22:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b85379ab-98aa-4bc0-b792-1d26438b2ee5 None None] [instance: c9392afe-92e0-4703-bd6f-79d272d541e3] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:22:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk.rescue --force-share --output=json" returned: 0 in 0.268s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json" returned: 0 in 0.374s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:15 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:22:15 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:22:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7502MB free_disk=25.453792572021484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:22:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:15 user nova-compute[72874]: INFO nova.compute.manager [None req-0adcf678-f40b-4d8c-a45d-73aa1dce4d4d tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Unrescuing
Aug 17 18:22:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0adcf678-f40b-4d8c-a45d-73aa1dce4d4d tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:22:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0adcf678-f40b-4d8c-a45d-73aa1dce4d4d tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquired lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:22:15 user nova-compute[72874]: DEBUG nova.network.neutron [None req-0adcf678-f40b-4d8c-a45d-73aa1dce4d4d tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance f027045c-d121-45ec-af61-e1a2399c4a43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c2eb160-5b94-4d53-bd36-b712c62d9100 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2ace97e1-c2ee-462e-a929-22c7cb2584d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance c27fc8b6-cc8c-426a-859d-04722c569cd4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 3a2a5fdd-3a21-413b-981a-ecc33051c87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 857d43f7-6f53-4c82-9e68-fca3078e97ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.589s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] There are 0 instances to clean {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.network.neutron [None req-0adcf678-f40b-4d8c-a45d-73aa1dce4d4d tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updating instance_info_cache with network_info: [{"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0adcf678-f40b-4d8c-a45d-73aa1dce4d4d tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Releasing lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:22:16 user nova-compute[72874]: DEBUG nova.objects.instance [None req-0adcf678-f40b-4d8c-a45d-73aa1dce4d4d tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lazy-loading 'flavor' on Instance uuid f027045c-d121-45ec-af61-e1a2399c4a43 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG nova.compute.manager [req-c07d4e7f-a911-42c7-9947-103e9b7bf6b8 req-a96c873e-455f-4dbe-b78d-d980e0205b4c service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-unplugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c07d4e7f-a911-42c7-9947-103e9b7bf6b8 req-a96c873e-455f-4dbe-b78d-d980e0205b4c service nova] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c07d4e7f-a911-42c7-9947-103e9b7bf6b8 req-a96c873e-455f-4dbe-b78d-d980e0205b4c service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c07d4e7f-a911-42c7-9947-103e9b7bf6b8 req-a96c873e-455f-4dbe-b78d-d980e0205b4c service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG nova.compute.manager [req-c07d4e7f-a911-42c7-9947-103e9b7bf6b8 req-a96c873e-455f-4dbe-b78d-d980e0205b4c service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] No waiting events found dispatching network-vif-unplugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:17 user nova-compute[72874]: WARNING nova.compute.manager [req-c07d4e7f-a911-42c7-9947-103e9b7bf6b8 req-a96c873e-455f-4dbe-b78d-d980e0205b4c service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received unexpected event network-vif-unplugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:22:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG nova.compute.manager [req-8f6a859f-135e-4db3-a456-95e8858662fe req-9c901b16-909a-4b69-b2f4-b02b89edb871 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-changed-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG nova.compute.manager [req-8f6a859f-135e-4db3-a456-95e8858662fe req-9c901b16-909a-4b69-b2f4-b02b89edb871 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Refreshing instance network info cache due to event network-changed-b3598a27-6f66-4999-8ed8-835ffb3d6cae. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8f6a859f-135e-4db3-a456-95e8858662fe req-9c901b16-909a-4b69-b2f4-b02b89edb871 service nova] Acquiring lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8f6a859f-135e-4db3-a456-95e8858662fe req-9c901b16-909a-4b69-b2f4-b02b89edb871 service nova] Acquired lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG nova.network.neutron [req-8f6a859f-135e-4db3-a456-95e8858662fe req-9c901b16-909a-4b69-b2f4-b02b89edb871 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Refreshing network info cache for port b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:17 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Instance destroyed successfully.
Aug 17 18:22:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Didn't find any instances for network info cache update. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG nova.network.neutron [req-8f6a859f-135e-4db3-a456-95e8858662fe req-9c901b16-909a-4b69-b2f4-b02b89edb871 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updated VIF entry in instance network info cache for port b3598a27-6f66-4999-8ed8-835ffb3d6cae. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG nova.network.neutron [req-8f6a859f-135e-4db3-a456-95e8858662fe req-9c901b16-909a-4b69-b2f4-b02b89edb871 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updating instance_info_cache with network_info: [{"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8f6a859f-135e-4db3-a456-95e8858662fe req-9c901b16-909a-4b69-b2f4-b02b89edb871 service nova] Releasing lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] No waiting events found dispatching network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:19 user nova-compute[72874]: WARNING nova.compute.manager [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received unexpected event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:22:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] No waiting events found dispatching network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:19 user nova-compute[72874]: WARNING nova.compute.manager [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received unexpected event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:22:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] No waiting events found dispatching network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:19 user nova-compute[72874]: WARNING nova.compute.manager [req-6a06bd20-0133-408f-ac7a-c84ed6df2b61 req-22e39d31-35a0-43da-b9e3-3128d6979e47 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received unexpected event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:22:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-36a20fd6-7e3b-4139-91a9-de1a5ba6269d req-500b5e3d-b422-4a9b-9e0c-d3d6ee4d9074 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-changed-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-36a20fd6-7e3b-4139-91a9-de1a5ba6269d req-500b5e3d-b422-4a9b-9e0c-d3d6ee4d9074 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Refreshing instance network info cache due to event network-changed-b3598a27-6f66-4999-8ed8-835ffb3d6cae. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-36a20fd6-7e3b-4139-91a9-de1a5ba6269d req-500b5e3d-b422-4a9b-9e0c-d3d6ee4d9074 service nova] Acquiring lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-36a20fd6-7e3b-4139-91a9-de1a5ba6269d req-500b5e3d-b422-4a9b-9e0c-d3d6ee4d9074 service nova] Acquired lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG nova.network.neutron [req-36a20fd6-7e3b-4139-91a9-de1a5ba6269d req-500b5e3d-b422-4a9b-9e0c-d3d6ee4d9074 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Refreshing network info cache for port b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:22:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:20 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:22:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:21 user nova-compute[72874]: DEBUG nova.network.neutron [req-36a20fd6-7e3b-4139-91a9-de1a5ba6269d req-500b5e3d-b422-4a9b-9e0c-d3d6ee4d9074 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updated VIF entry in instance network info cache for port b3598a27-6f66-4999-8ed8-835ffb3d6cae. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:22:21 user nova-compute[72874]: DEBUG nova.network.neutron [req-36a20fd6-7e3b-4139-91a9-de1a5ba6269d req-500b5e3d-b422-4a9b-9e0c-d3d6ee4d9074 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updating instance_info_cache with network_info: [{"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:22:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-36a20fd6-7e3b-4139-91a9-de1a5ba6269d req-500b5e3d-b422-4a9b-9e0c-d3d6ee4d9074 service nova] Releasing lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:22:21 user nova-compute[72874]: DEBUG nova.compute.manager [req-31af4e32-3b73-41af-9b4e-8bfccf358959 req-edd5f089-e9de-4bec-8800-32cfea8f0fe9 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-unplugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-31af4e32-3b73-41af-9b4e-8bfccf358959 req-edd5f089-e9de-4bec-8800-32cfea8f0fe9 service nova] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-31af4e32-3b73-41af-9b4e-8bfccf358959 req-edd5f089-e9de-4bec-8800-32cfea8f0fe9 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-31af4e32-3b73-41af-9b4e-8bfccf358959 req-edd5f089-e9de-4bec-8800-32cfea8f0fe9 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:21 user nova-compute[72874]: DEBUG nova.compute.manager [req-31af4e32-3b73-41af-9b4e-8bfccf358959 req-edd5f089-e9de-4bec-8800-32cfea8f0fe9 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] No waiting events found dispatching network-vif-unplugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:21 user nova-compute[72874]: WARNING nova.compute.manager [req-31af4e32-3b73-41af-9b4e-8bfccf358959 req-edd5f089-e9de-4bec-8800-32cfea8f0fe9 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received unexpected event network-vif-unplugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:22:21 user nova-compute[72874]: DEBUG nova.compute.manager [req-31af4e32-3b73-41af-9b4e-8bfccf358959 req-edd5f089-e9de-4bec-8800-32cfea8f0fe9 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-31af4e32-3b73-41af-9b4e-8bfccf358959 req-edd5f089-e9de-4bec-8800-32cfea8f0fe9 service nova] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-31af4e32-3b73-41af-9b4e-8bfccf358959 req-edd5f089-e9de-4bec-8800-32cfea8f0fe9 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-31af4e32-3b73-41af-9b4e-8bfccf358959 req-edd5f089-e9de-4bec-8800-32cfea8f0fe9 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:21 user nova-compute[72874]: DEBUG nova.compute.manager [req-31af4e32-3b73-41af-9b4e-8bfccf358959 req-edd5f089-e9de-4bec-8800-32cfea8f0fe9 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] No waiting events found dispatching network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:21 user nova-compute[72874]: WARNING nova.compute.manager [req-31af4e32-3b73-41af-9b4e-8bfccf358959 req-edd5f089-e9de-4bec-8800-32cfea8f0fe9 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received unexpected event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:22:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Removed pending event for f027045c-d121-45ec-af61-e1a2399c4a43 due to event {{(pid=72874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 18:22:22 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296542.8036807, f027045c-d121-45ec-af61-e1a2399c4a43 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:22:22 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] VM Resumed (Lifecycle Event)
Aug 17 18:22:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-0adcf678-f40b-4d8c-a45d-73aa1dce4d4d tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:22:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:22:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:22:22 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 18:22:22 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296542.8188834, f027045c-d121-45ec-af61-e1a2399c4a43 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:22:22 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] VM Started (Lifecycle Event)
Aug 17 18:22:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:22:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdqhSUaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:22:23 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:22:23 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:22:23 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7618740b-0a7f-418f-9d62-f5b808fcfabb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:22:23 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3d6090-5c51-479d-960b-1b05964ea755]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a] added
Aug 17 18:22:23 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[eece267b-0f57-4ef1-a2f4-ce1cc6ce9eed]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a531119-c328-47b2-92e5-5a9200b99c3b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XdqhSUaC {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XdqhSUaC" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e8e846-37eb-49a8-a764-e50182b1bfe9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XdqhSUaC'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[768b50fb-aaa0-4002-aa7a-2b14f7e846ca]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd993fa5-45d8-4f72-a59d-e08c6f375007]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:22:23 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:22:23 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[902c733b-9925-4909-bcc8-962ce8e9d3a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a, portal: 172.16.0.220,3260]
Aug 17 18:22:23 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a, portal: 172.16.0.220,3260] successful.
Aug 17 18:22:23 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.047s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8340ef84-72b3-42e8-bec3-c62bc996c8ca]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0a313d-7943-47f5-8761-e5ef5e3a2b02]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:22:23 user nova-compute[72874]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:22:23 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:22:23 user nova-compute[72874]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:22:23 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.434s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.035s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3086d9-ef2c-4933-9a3c-12e40698b946]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG nova.compute.manager [req-fff91644-38bd-4754-836c-87623e1e5f2f req-6e310ed7-421c-4be1-ae9d-7eabf984c1ac service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fff91644-38bd-4754-836c-87623e1e5f2f req-6e310ed7-421c-4be1-ae9d-7eabf984c1ac service nova] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fff91644-38bd-4754-836c-87623e1e5f2f req-6e310ed7-421c-4be1-ae9d-7eabf984c1ac service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fff91644-38bd-4754-836c-87623e1e5f2f req-6e310ed7-421c-4be1-ae9d-7eabf984c1ac service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG nova.compute.manager [req-fff91644-38bd-4754-836c-87623e1e5f2f req-6e310ed7-421c-4be1-ae9d-7eabf984c1ac service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] No waiting events found dispatching network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:23 user nova-compute[72874]: WARNING nova.compute.manager [req-fff91644-38bd-4754-836c-87623e1e5f2f req-6e310ed7-421c-4be1-ae9d-7eabf984c1ac service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received unexpected event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae for instance with vm_state active and task_state None.
Aug 17 18:22:23 user nova-compute[72874]: DEBUG nova.compute.manager [req-fff91644-38bd-4754-836c-87623e1e5f2f req-6e310ed7-421c-4be1-ae9d-7eabf984c1ac service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fff91644-38bd-4754-836c-87623e1e5f2f req-6e310ed7-421c-4be1-ae9d-7eabf984c1ac service nova] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fff91644-38bd-4754-836c-87623e1e5f2f req-6e310ed7-421c-4be1-ae9d-7eabf984c1ac service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fff91644-38bd-4754-836c-87623e1e5f2f req-6e310ed7-421c-4be1-ae9d-7eabf984c1ac service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:23 user nova-compute[72874]: DEBUG nova.compute.manager [req-fff91644-38bd-4754-836c-87623e1e5f2f req-6e310ed7-421c-4be1-ae9d-7eabf984c1ac service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] No waiting events found dispatching network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:23 user nova-compute[72874]: WARNING nova.compute.manager [req-fff91644-38bd-4754-836c-87623e1e5f2f req-6e310ed7-421c-4be1-ae9d-7eabf984c1ac service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received unexpected event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae for instance with vm_state active and task_state None.
Aug 17 18:22:24 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:22:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdqhSUaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:22:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.488s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:22:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] <== connect_volume: return (1491ms) {'type': 'block', 'scsi_wwn': '26535333866366530', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:22:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535333866366530', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:22:24 user nova-compute[72874]: DEBUG nova.objects.instance [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'flavor' on Instance uuid 3a2a5fdd-3a21-413b-981a-ecc33051c87b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:22:24 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:22:24 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 18:22:24 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:22:24 user nova-compute[72874]:   <serial>4a51f77d-20d8-47d0-b4b9-92bed472f30a</serial>
Aug 17 18:22:24 user nova-compute[72874]: </disk>
Aug 17 18:22:24 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:22:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] No VIF found with MAC fa:16:3e:15:fc:2c, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid c27fc8b6-cc8c-426a-859d-04722c569cd4 {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid f027045c-d121-45ec-af61-e1a2399c4a43 {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid b143e572-9116-4dc0-8fc3-ba586b290ddd {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid 8c2eb160-5b94-4d53-bd36-b712c62d9100 {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid 2ace97e1-c2ee-462e-a929-22c7cb2584d2 {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid 3a2a5fdd-3a21-413b-981a-ecc33051c87b {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid 857d43f7-6f53-4c82-9e68-fca3078e97ea {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid 9b638f7b-ba47-403f-be22-a65a39ed8438 {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "f027045c-d121-45ec-af61-e1a2399c4a43" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "b143e572-9116-4dc0-8fc3-ba586b290ddd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "9b638f7b-ba47-403f-be22-a65a39ed8438" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "f027045c-d121-45ec-af61-e1a2399c4a43" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f9ac197c-f469-472a-a91e-acb0027a7a9d tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.215s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.157s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.157s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:27 user nova-compute[72874]: INFO nova.compute.manager [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Rebuilding instance
Aug 17 18:22:27 user nova-compute[72874]: DEBUG nova.objects.instance [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3a2a5fdd-3a21-413b-981a-ecc33051c87b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:27 user nova-compute[72874]: DEBUG nova.compute.manager [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:22:27 user nova-compute[72874]: DEBUG nova.objects.instance [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'pci_requests' on Instance uuid 3a2a5fdd-3a21-413b-981a-ecc33051c87b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:27 user nova-compute[72874]: DEBUG nova.objects.instance [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a2a5fdd-3a21-413b-981a-ecc33051c87b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:27 user nova-compute[72874]: DEBUG nova.objects.instance [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'resources' on Instance uuid 3a2a5fdd-3a21-413b-981a-ecc33051c87b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:27 user nova-compute[72874]: DEBUG nova.objects.instance [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'migration_context' on Instance uuid 3a2a5fdd-3a21-413b-981a-ecc33051c87b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:27 user nova-compute[72874]: DEBUG nova.objects.instance [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72874) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 18:22:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:28 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Instance destroyed successfully.
Aug 17 18:22:28 user nova-compute[72874]: INFO nova.compute.manager [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Detaching volume 4a51f77d-20d8-47d0-b4b9-92bed472f30a
Aug 17 18:22:28 user nova-compute[72874]: INFO nova.virt.block_device [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Attempting to driver detach volume 4a51f77d-20d8-47d0-b4b9-92bed472f30a from mountpoint /dev/vdb
Aug 17 18:22:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Attempting to detach device vdb from instance 3a2a5fdd-3a21-413b-981a-ecc33051c87b from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:22:28 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:22:28 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 18:22:28 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:22:28 user nova-compute[72874]:   <serial>4a51f77d-20d8-47d0-b4b9-92bed472f30a</serial>
Aug 17 18:22:28 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:22:28 user nova-compute[72874]: </disk>
Aug 17 18:22:28 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:22:28 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Successfully detached device vdb from instance 3a2a5fdd-3a21-413b-981a-ecc33051c87b from the persistent domain config.
Aug 17 18:22:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdqhSUaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:22:28 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aadbadf-08fc-48f4-a314-4fbc71e1e829]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad51ae6-e586-400d-9c9d-c958a2692c65]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:22:28 user nova-compute[72874]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:22:28 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:22:28 user nova-compute[72874]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:22:28 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a0751360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[285272b9-b817-4ced-8628-6272a959f8c2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bfe9f5-18b2-4e75-a588-493fddcdebac]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d859f2-c949-4c13-8cb5-012a2e06ffff]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1a3984-4d6b-4fc4-9c02-d95bccaa9a7c]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ece9768-b557-4517-8217-c6bf2e72ac67]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffa747c-a17f-4437-923d-1f2d5f7358f1]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a, portal: 172.16.0.220,3260]
Aug 17 18:22:28 user nova-compute[72874]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a, portal: 172.16.0.220,3260] successful.
Aug 17 18:22:28 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3446b97-11f3-4b99-bfd4-94a0f3985b08]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] <== disconnect_volume: return (318ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:22:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:22:29 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Instance destroyed successfully.
Aug 17 18:22:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1964684843',display_name='tempest-ServerActionsTestOtherA-server-1764804288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1964684843',id=14,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMpdpfwA+5BzocXAcrapnfCncndWRFtxZCCWpFGlZmI4prUOsZ4cc20CF7Cba6pgb2rHGqRdFOT249RYmqz/f4penXjArDXnxaMRBbAPn+IOmceDrtZRM7Mttzd+GNOXw==',key_name='tempest-keypair-1182001619',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4aa04d3ed68a4542b32e2efeca25222a',ramdisk_id='',reservation_id='r-f8meq89l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1332351935',owner_user_name='tempest-ServerActionsTestOtherA-1332351935-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:22:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaaa47a37543427eaa1712d29c419dd9',uuid=3a2a5fdd-3a21-413b-981a-ecc33051c87b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converting VIF {"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=fd5a0e28-4b48-4668-b9d6-2108a63c618f,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5a0e28-4b') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG os_vif [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=fd5a0e28-4b48-4668-b9d6-2108a63c618f,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5a0e28-4b') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd5a0e28-4b, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:22:29 user nova-compute[72874]: INFO os_vif [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=fd5a0e28-4b48-4668-b9d6-2108a63c618f,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5a0e28-4b')
Aug 17 18:22:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdqhSUaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:22:29 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 18:22:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4837e47c-7996-40cb-b5fb-4f9b3ea9f724]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[506d3e78-abfd-4e41-ada3-e0b49fcfafcd]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:22:29 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:22:29 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a079f880>, {}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Disconnecting from: [] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.053s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] <== disconnect_volume: return (54ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:22:29 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Deleting instance files /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b_del
Aug 17 18:22:29 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Deletion of /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b_del complete
Aug 17 18:22:29 user nova-compute[72874]: INFO nova.virt.block_device [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Booting with volume 4a51f77d-20d8-47d0-b4b9-92bed472f30a at /dev/vdb
Aug 17 18:22:29 user nova-compute[72874]: DEBUG os_brick.utils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6259358-1a24-4c9c-83f2-ea76b9009851]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce45bed-f056-49c5-8ec6-0e82d2646613]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4893a36-8d28-4ab7-9187-bd2c6d4d976d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[353185b0-224d-45ef-887d-cc2c1b400594]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:22:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:22:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:22:30 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:22:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[118bbf19-ef48-4f56-ac51-410abfc0f243]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:22:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:22:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:22:30 user nova-compute[72874]: DEBUG os_brick.utils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:22:30 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Updating existing volume attachment record: 5b0db98e-c00d-44b2-974d-1f66113afc24 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:22:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-b63264f7-21ff-4169-9e05-95a169266803 req-7b065682-e450-4e0a-a72e-039f6b7e390c service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received event network-vif-unplugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b63264f7-21ff-4169-9e05-95a169266803 req-7b065682-e450-4e0a-a72e-039f6b7e390c service nova] Acquiring lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b63264f7-21ff-4169-9e05-95a169266803 req-7b065682-e450-4e0a-a72e-039f6b7e390c service nova] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b63264f7-21ff-4169-9e05-95a169266803 req-7b065682-e450-4e0a-a72e-039f6b7e390c service nova] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-b63264f7-21ff-4169-9e05-95a169266803 req-7b065682-e450-4e0a-a72e-039f6b7e390c service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] No waiting events found dispatching network-vif-unplugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:33 user nova-compute[72874]: WARNING nova.compute.manager [req-b63264f7-21ff-4169-9e05-95a169266803 req-7b065682-e450-4e0a-a72e-039f6b7e390c service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received unexpected event network-vif-unplugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 17 18:22:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-e92785d5-29cd-462a-baad-c0695905e7b8 req-2b92435d-0dc4-43bb-9495-eda6ca00b4b0 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received event network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e92785d5-29cd-462a-baad-c0695905e7b8 req-2b92435d-0dc4-43bb-9495-eda6ca00b4b0 service nova] Acquiring lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e92785d5-29cd-462a-baad-c0695905e7b8 req-2b92435d-0dc4-43bb-9495-eda6ca00b4b0 service nova] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e92785d5-29cd-462a-baad-c0695905e7b8 req-2b92435d-0dc4-43bb-9495-eda6ca00b4b0 service nova] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-e92785d5-29cd-462a-baad-c0695905e7b8 req-2b92435d-0dc4-43bb-9495-eda6ca00b4b0 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] No waiting events found dispatching network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:35 user nova-compute[72874]: WARNING nova.compute.manager [req-e92785d5-29cd-462a-baad-c0695905e7b8 req-2b92435d-0dc4-43bb-9495-eda6ca00b4b0 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received unexpected event network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f for instance with vm_state active and task_state rebuild_block_device_mapping.
Aug 17 18:22:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:22:42 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Creating image(s)
Aug 17 18:22:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "/opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "/opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.267s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.193s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk 1073741824" returned: 0 in 0.054s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.226s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296548.1895418, 3a2a5fdd-3a21-413b-981a-ecc33051c87b => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:22:43 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] VM Stopped (Lifecycle Event)
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.compute.manager [None req-dcf01b1d-a416-4400-bc93-aaebe08ebdb4 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Cannot resize image /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Ensure instance console log exists: /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Start _get_guest_xml network_info=[{"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdqhSUaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3a2a5fdd-3a21-413b-981a-ecc33051c87b', 'attached_at': '', 'detached_at': '', 'volume_id': '4a51f77d-20d8-47d0-b4b9-92bed472f30a', 'serial': '4a51f77d-20d8-47d0-b4b9-92bed472f30a'}, 'delete_on_termination': False, 'attachment_id': '5b0db98e-c00d-44b2-974d-1f66113afc24', 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:22:43 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 18:22:43 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.objects.instance [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3a2a5fdd-3a21-413b-981a-ecc33051c87b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdqhSUaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:22:43 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:22:43 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:22:43 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe0595b-1d4a-4676-89c8-b236fdf0d9af]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:22:43 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[02489b58-191c-4cd4-b238-446ce8d265ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a] added
Aug 17 18:22:43 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b87eec-59c2-42ef-8a8d-c27020fe7968]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cbd62f-fe76-4006-bf3d-36211a48deda]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XdqhSUaC {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XdqhSUaC" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2763374-deb9-45f1-9d15-dac140653c8e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XdqhSUaC'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee60942-aa6f-436f-904b-623f06e3c1d3]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5348be25-7c0b-4bc4-a7c6-ab301beefe6c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:22:43 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:22:43 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a69caad-3d13-46c8-a2fb-9bd90a4c83a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a, portal: 172.16.0.220,3260]
Aug 17 18:22:43 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a, portal: 172.16.0.220,3260] successful.
Aug 17 18:22:43 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[86580335-716b-4a94-8634-458af70ebba3]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1840796-cdc5-405b-8be7-27cd2b122be6]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:22:43 user nova-compute[72874]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:22:43 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:22:43 user nova-compute[72874]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:22:43 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0ee305-d552-4812-b48d-44d5d2da7a03]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:43 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdqhSUaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '26535333866366530', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535333866366530', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "544132d3-3dc4-445c-9a63-5f39e50eb34a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T18:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1964684843',display_name='tempest-ServerActionsTestOtherA-server-1764804288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1964684843',id=14,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMpdpfwA+5BzocXAcrapnfCncndWRFtxZCCWpFGlZmI4prUOsZ4cc20CF7Cba6pgb2rHGqRdFOT249RYmqz/f4penXjArDXnxaMRBbAPn+IOmceDrtZRM7Mttzd+GNOXw==',key_name='tempest-keypair-1182001619',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4aa04d3ed68a4542b32e2efeca25222a',ramdisk_id='',reservation_id='r-f8meq89l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1332351935',owner_user_name='tempest-ServerActionsTestOtherA-1332351935-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaaa47a37543427eaa1712d29c419dd9',uuid=3a2a5fdd-3a21-413b-981a-ecc33051c87b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converting VIF {"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=fd5a0e28-4b48-4668-b9d6-2108a63c618f,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5a0e28-4b') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:22:44 user nova-compute[72874]:   <uuid>3a2a5fdd-3a21-413b-981a-ecc33051c87b</uuid>
Aug 17 18:22:44 user nova-compute[72874]:   <name>instance-0000000e</name>
Aug 17 18:22:44 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:22:44 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:22:44 user nova-compute[72874]:   <metadata>
Aug 17 18:22:44 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:22:44 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:22:44 user nova-compute[72874]:       <nova:name>tempest-ServerActionsTestOtherA-server-1764804288</nova:name>
Aug 17 18:22:44 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:22:43</nova:creationTime>
Aug 17 18:22:44 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:22:44 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:22:44 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:22:44 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:22:44 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:22:44 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:22:44 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:22:44 user nova-compute[72874]:       <nova:owner>
Aug 17 18:22:44 user nova-compute[72874]:         <nova:user uuid="aaaa47a37543427eaa1712d29c419dd9">tempest-ServerActionsTestOtherA-1332351935-project-member</nova:user>
Aug 17 18:22:44 user nova-compute[72874]:         <nova:project uuid="4aa04d3ed68a4542b32e2efeca25222a">tempest-ServerActionsTestOtherA-1332351935</nova:project>
Aug 17 18:22:44 user nova-compute[72874]:       </nova:owner>
Aug 17 18:22:44 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:22:44 user nova-compute[72874]:       <nova:ports>
Aug 17 18:22:44 user nova-compute[72874]:         <nova:port uuid="fd5a0e28-4b48-4668-b9d6-2108a63c618f">
Aug 17 18:22:44 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 18:22:44 user nova-compute[72874]:         </nova:port>
Aug 17 18:22:44 user nova-compute[72874]:       </nova:ports>
Aug 17 18:22:44 user nova-compute[72874]:     </nova:instance>
Aug 17 18:22:44 user nova-compute[72874]:   </metadata>
Aug 17 18:22:44 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:22:44 user nova-compute[72874]:     <system>
Aug 17 18:22:44 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:22:44 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:22:44 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:22:44 user nova-compute[72874]:       <entry name="serial">3a2a5fdd-3a21-413b-981a-ecc33051c87b</entry>
Aug 17 18:22:44 user nova-compute[72874]:       <entry name="uuid">3a2a5fdd-3a21-413b-981a-ecc33051c87b</entry>
Aug 17 18:22:44 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:22:44 user nova-compute[72874]:     </system>
Aug 17 18:22:44 user nova-compute[72874]:   </sysinfo>
Aug 17 18:22:44 user nova-compute[72874]:   <os>
Aug 17 18:22:44 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:22:44 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:22:44 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:22:44 user nova-compute[72874]:   </os>
Aug 17 18:22:44 user nova-compute[72874]:   <features>
Aug 17 18:22:44 user nova-compute[72874]:     <acpi/>
Aug 17 18:22:44 user nova-compute[72874]:     <apic/>
Aug 17 18:22:44 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:22:44 user nova-compute[72874]:   </features>
Aug 17 18:22:44 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:22:44 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:22:44 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:22:44 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:22:44 user nova-compute[72874]:   </clock>
Aug 17 18:22:44 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:22:44 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:22:44 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:22:44 user nova-compute[72874]:   </cpu>
Aug 17 18:22:44 user nova-compute[72874]:   <devices>
Aug 17 18:22:44 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:22:44 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:22:44 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk"/>
Aug 17 18:22:44 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:22:44 user nova-compute[72874]:     </disk>
Aug 17 18:22:44 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:22:44 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:22:44 user nova-compute[72874]:       <source dev="/dev/sdb"/>
Aug 17 18:22:44 user nova-compute[72874]:       <target dev="vdb" bus="virtio"/>
Aug 17 18:22:44 user nova-compute[72874]:       <serial>4a51f77d-20d8-47d0-b4b9-92bed472f30a</serial>
Aug 17 18:22:44 user nova-compute[72874]:     </disk>
Aug 17 18:22:44 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:22:44 user nova-compute[72874]:       <mac address="fa:16:3e:15:fc:2c"/>
Aug 17 18:22:44 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:22:44 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:22:44 user nova-compute[72874]:       <target dev="tapfd5a0e28-4b"/>
Aug 17 18:22:44 user nova-compute[72874]:     </interface>
Aug 17 18:22:44 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:22:44 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/console.log" append="off"/>
Aug 17 18:22:44 user nova-compute[72874]:     </serial>
Aug 17 18:22:44 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:22:44 user nova-compute[72874]:     <video>
Aug 17 18:22:44 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:22:44 user nova-compute[72874]:     </video>
Aug 17 18:22:44 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:22:44 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:22:44 user nova-compute[72874]:     </rng>
Aug 17 18:22:44 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:22:44 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:22:44 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:22:44 user nova-compute[72874]:     </memballoon>
Aug 17 18:22:44 user nova-compute[72874]:   </devices>
Aug 17 18:22:44 user nova-compute[72874]: </domain>
Aug 17 18:22:44 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T18:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1964684843',display_name='tempest-ServerActionsTestOtherA-server-1764804288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1964684843',id=14,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMpdpfwA+5BzocXAcrapnfCncndWRFtxZCCWpFGlZmI4prUOsZ4cc20CF7Cba6pgb2rHGqRdFOT249RYmqz/f4penXjArDXnxaMRBbAPn+IOmceDrtZRM7Mttzd+GNOXw==',key_name='tempest-keypair-1182001619',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4aa04d3ed68a4542b32e2efeca25222a',ramdisk_id='',reservation_id='r-f8meq89l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1332351935',owner_user_name='tempest-ServerActionsTestOtherA-1332351935-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:22:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaaa47a37543427eaa1712d29c419dd9',uuid=3a2a5fdd-3a21-413b-981a-ecc33051c87b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converting VIF {"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=fd5a0e28-4b48-4668-b9d6-2108a63c618f,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5a0e28-4b') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG os_vif [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=fd5a0e28-4b48-4668-b9d6-2108a63c618f,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5a0e28-4b') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd5a0e28-4b, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd5a0e28-4b, col_values=(('external_ids', {'iface-id': 'fd5a0e28-4b48-4668-b9d6-2108a63c618f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:fc:2c', 'vm-uuid': '3a2a5fdd-3a21-413b-981a-ecc33051c87b'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:44 user nova-compute[72874]: INFO os_vif [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=fd5a0e28-4b48-4668-b9d6-2108a63c618f,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5a0e28-4b')
Aug 17 18:22:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] No VIF found with MAC fa:16:3e:15:fc:2c, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:22:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:45 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:22:45 user nova-compute[72874]: INFO nova.compute.claims [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Claim successful on node user
Aug 17 18:22:45 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Refreshing inventories for resource provider b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 18:22:45 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Updating ProviderTree inventory for provider b677d836-b01b-4674-8972-53d526f1b5f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 18:22:45 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Updating inventory in ProviderTree for provider b677d836-b01b-4674-8972-53d526f1b5f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 18:22:45 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Refreshing aggregate associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, aggregates: None {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 18:22:45 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Refreshing trait associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, traits: HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 18:22:45 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:22:45 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:22:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:22:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:22:45 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:22:45 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:22:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:22:45 user nova-compute[72874]: DEBUG nova.policy [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55c7ca8d3b6d4d42b656d9a4a9bc11a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f96ef08868f45aea64ddf76a0bb68f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:22:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:22:46 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Creating image(s)
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "/opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "/opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "/opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.238s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.228s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk 1073741824" returned: 0 in 0.058s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG nova.compute.manager [req-4fabb156-68a6-43f1-bb1c-e852bff81a16 req-0272bd5e-6b38-4607-bd69-b794833a5a6d service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received event network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4fabb156-68a6-43f1-bb1c-e852bff81a16 req-0272bd5e-6b38-4607-bd69-b794833a5a6d service nova] Acquiring lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4fabb156-68a6-43f1-bb1c-e852bff81a16 req-0272bd5e-6b38-4607-bd69-b794833a5a6d service nova] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4fabb156-68a6-43f1-bb1c-e852bff81a16 req-0272bd5e-6b38-4607-bd69-b794833a5a6d service nova] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG nova.compute.manager [req-4fabb156-68a6-43f1-bb1c-e852bff81a16 req-0272bd5e-6b38-4607-bd69-b794833a5a6d service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] No waiting events found dispatching network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:46 user nova-compute[72874]: WARNING nova.compute.manager [req-4fabb156-68a6-43f1-bb1c-e852bff81a16 req-0272bd5e-6b38-4607-bd69-b794833a5a6d service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received unexpected event network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f for instance with vm_state active and task_state rebuild_spawning.
Aug 17 18:22:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.230s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Cannot resize image /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:22:46 user nova-compute[72874]: DEBUG nova.objects.instance [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lazy-loading 'migration_context' on Instance uuid 544132d3-3dc4-445c-9a63-5f39e50eb34a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:22:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Ensure instance console log exists: /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:22:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:47 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Successfully created port: 733196aa-d083-4db2-a729-9e43b83eecdd {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:22:47 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Successfully updated port: 733196aa-d083-4db2-a729-9e43b83eecdd {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "refresh_cache-544132d3-3dc4-445c-9a63-5f39e50eb34a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquired lock "refresh_cache-544132d3-3dc4-445c-9a63-5f39e50eb34a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-593d1c60-87a0-458c-ba64-705959fb7e14 req-ef6dbee3-3ca6-43a3-bfae-d410e439bb57 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Received event network-changed-733196aa-d083-4db2-a729-9e43b83eecdd {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-593d1c60-87a0-458c-ba64-705959fb7e14 req-ef6dbee3-3ca6-43a3-bfae-d410e439bb57 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Refreshing instance network info cache due to event network-changed-733196aa-d083-4db2-a729-9e43b83eecdd. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-593d1c60-87a0-458c-ba64-705959fb7e14 req-ef6dbee3-3ca6-43a3-bfae-d410e439bb57 service nova] Acquiring lock "refresh_cache-544132d3-3dc4-445c-9a63-5f39e50eb34a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Updating instance_info_cache with network_info: [{"id": "733196aa-d083-4db2-a729-9e43b83eecdd", "address": "fa:16:3e:05:14:91", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733196aa-d0", "ovs_interfaceid": "733196aa-d083-4db2-a729-9e43b83eecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Releasing lock "refresh_cache-544132d3-3dc4-445c-9a63-5f39e50eb34a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Instance network_info: |[{"id": "733196aa-d083-4db2-a729-9e43b83eecdd", "address": "fa:16:3e:05:14:91", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733196aa-d0", "ovs_interfaceid": "733196aa-d083-4db2-a729-9e43b83eecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-593d1c60-87a0-458c-ba64-705959fb7e14 req-ef6dbee3-3ca6-43a3-bfae-d410e439bb57 service nova] Acquired lock "refresh_cache-544132d3-3dc4-445c-9a63-5f39e50eb34a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-593d1c60-87a0-458c-ba64-705959fb7e14 req-ef6dbee3-3ca6-43a3-bfae-d410e439bb57 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Refreshing network info cache for port 733196aa-d083-4db2-a729-9e43b83eecdd {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Start _get_guest_xml network_info=[{"id": "733196aa-d083-4db2-a729-9e43b83eecdd", "address": "fa:16:3e:05:14:91", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733196aa-d0", "ovs_interfaceid": "733196aa-d083-4db2-a729-9e43b83eecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:22:48 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:22:48 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1014061497',display_name='tempest-VolumesSnapshotTestJSON-instance-1014061497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1014061497',id=17,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5LXFuTiw8gMDOeBACF5hR8jfTiOjPaRWj3uunQWqtwyjlVUGfNTL9R4K/FJMrf7KSKSPuk/eW8E+ffp0TaJrS8EDPeg2LOfaN+7/zXUPwA3VIVIWXPk484l8hPFUdu/w==',key_name='tempest-keypair-182360089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f96ef08868f45aea64ddf76a0bb68f5',ramdisk_id='',reservation_id='r-wizc70gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1222672370',owner_user_name='tempest-VolumesSnapshotTestJSON-1222672370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55c7ca8d3b6d4d42b656d9a4a9bc11a5',uuid=544132d3-3dc4-445c-9a63-5f39e50eb34a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "733196aa-d083-4db2-a729-9e43b83eecdd", "address": "fa:16:3e:05:14:91", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733196aa-d0", "ovs_interfaceid": "733196aa-d083-4db2-a729-9e43b83eecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Converting VIF {"id": "733196aa-d083-4db2-a729-9e43b83eecdd", "address": "fa:16:3e:05:14:91", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733196aa-d0", "ovs_interfaceid": "733196aa-d083-4db2-a729-9e43b83eecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:14:91,bridge_name='br-int',has_traffic_filtering=True,id=733196aa-d083-4db2-a729-9e43b83eecdd,network=Network(b0620144-0532-4223-82f2-0fe7d1bd449e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733196aa-d0') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.objects.instance [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lazy-loading 'pci_devices' on Instance uuid 544132d3-3dc4-445c-9a63-5f39e50eb34a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:22:48 user nova-compute[72874]:   <uuid>544132d3-3dc4-445c-9a63-5f39e50eb34a</uuid>
Aug 17 18:22:48 user nova-compute[72874]:   <name>instance-00000011</name>
Aug 17 18:22:48 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:22:48 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:22:48 user nova-compute[72874]:   <metadata>
Aug 17 18:22:48 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:22:48 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:22:48 user nova-compute[72874]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1014061497</nova:name>
Aug 17 18:22:48 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:22:48</nova:creationTime>
Aug 17 18:22:48 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:22:48 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:22:48 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:22:48 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:22:48 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:22:48 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:22:48 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:22:48 user nova-compute[72874]:       <nova:owner>
Aug 17 18:22:48 user nova-compute[72874]:         <nova:user uuid="55c7ca8d3b6d4d42b656d9a4a9bc11a5">tempest-VolumesSnapshotTestJSON-1222672370-project-member</nova:user>
Aug 17 18:22:48 user nova-compute[72874]:         <nova:project uuid="1f96ef08868f45aea64ddf76a0bb68f5">tempest-VolumesSnapshotTestJSON-1222672370</nova:project>
Aug 17 18:22:48 user nova-compute[72874]:       </nova:owner>
Aug 17 18:22:48 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:22:48 user nova-compute[72874]:       <nova:ports>
Aug 17 18:22:48 user nova-compute[72874]:         <nova:port uuid="733196aa-d083-4db2-a729-9e43b83eecdd">
Aug 17 18:22:48 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 18:22:48 user nova-compute[72874]:         </nova:port>
Aug 17 18:22:48 user nova-compute[72874]:       </nova:ports>
Aug 17 18:22:48 user nova-compute[72874]:     </nova:instance>
Aug 17 18:22:48 user nova-compute[72874]:   </metadata>
Aug 17 18:22:48 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:22:48 user nova-compute[72874]:     <system>
Aug 17 18:22:48 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:22:48 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:22:48 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:22:48 user nova-compute[72874]:       <entry name="serial">544132d3-3dc4-445c-9a63-5f39e50eb34a</entry>
Aug 17 18:22:48 user nova-compute[72874]:       <entry name="uuid">544132d3-3dc4-445c-9a63-5f39e50eb34a</entry>
Aug 17 18:22:48 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:22:48 user nova-compute[72874]:     </system>
Aug 17 18:22:48 user nova-compute[72874]:   </sysinfo>
Aug 17 18:22:48 user nova-compute[72874]:   <os>
Aug 17 18:22:48 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:22:48 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:22:48 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:22:48 user nova-compute[72874]:   </os>
Aug 17 18:22:48 user nova-compute[72874]:   <features>
Aug 17 18:22:48 user nova-compute[72874]:     <acpi/>
Aug 17 18:22:48 user nova-compute[72874]:     <apic/>
Aug 17 18:22:48 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:22:48 user nova-compute[72874]:   </features>
Aug 17 18:22:48 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:22:48 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:22:48 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:22:48 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:22:48 user nova-compute[72874]:   </clock>
Aug 17 18:22:48 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:22:48 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:22:48 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:22:48 user nova-compute[72874]:   </cpu>
Aug 17 18:22:48 user nova-compute[72874]:   <devices>
Aug 17 18:22:48 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:22:48 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:22:48 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk"/>
Aug 17 18:22:48 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:22:48 user nova-compute[72874]:     </disk>
Aug 17 18:22:48 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:22:48 user nova-compute[72874]:       <mac address="fa:16:3e:05:14:91"/>
Aug 17 18:22:48 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:22:48 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:22:48 user nova-compute[72874]:       <target dev="tap733196aa-d0"/>
Aug 17 18:22:48 user nova-compute[72874]:     </interface>
Aug 17 18:22:48 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:22:48 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/console.log" append="off"/>
Aug 17 18:22:48 user nova-compute[72874]:     </serial>
Aug 17 18:22:48 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:22:48 user nova-compute[72874]:     <video>
Aug 17 18:22:48 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:22:48 user nova-compute[72874]:     </video>
Aug 17 18:22:48 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:22:48 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:22:48 user nova-compute[72874]:     </rng>
Aug 17 18:22:48 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:22:48 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:22:48 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:22:48 user nova-compute[72874]:     </memballoon>
Aug 17 18:22:48 user nova-compute[72874]:   </devices>
Aug 17 18:22:48 user nova-compute[72874]: </domain>
Aug 17 18:22:48 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1014061497',display_name='tempest-VolumesSnapshotTestJSON-instance-1014061497',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1014061497',id=17,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5LXFuTiw8gMDOeBACF5hR8jfTiOjPaRWj3uunQWqtwyjlVUGfNTL9R4K/FJMrf7KSKSPuk/eW8E+ffp0TaJrS8EDPeg2LOfaN+7/zXUPwA3VIVIWXPk484l8hPFUdu/w==',key_name='tempest-keypair-182360089',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f96ef08868f45aea64ddf76a0bb68f5',ramdisk_id='',reservation_id='r-wizc70gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1222672370',owner_user_name='tempest-VolumesSnapshotTestJSON-1222672370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55c7ca8d3b6d4d42b656d9a4a9bc11a5',uuid=544132d3-3dc4-445c-9a63-5f39e50eb34a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "733196aa-d083-4db2-a729-9e43b83eecdd", "address": "fa:16:3e:05:14:91", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733196aa-d0", "ovs_interfaceid": "733196aa-d083-4db2-a729-9e43b83eecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Converting VIF {"id": "733196aa-d083-4db2-a729-9e43b83eecdd", "address": "fa:16:3e:05:14:91", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733196aa-d0", "ovs_interfaceid": "733196aa-d083-4db2-a729-9e43b83eecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:14:91,bridge_name='br-int',has_traffic_filtering=True,id=733196aa-d083-4db2-a729-9e43b83eecdd,network=Network(b0620144-0532-4223-82f2-0fe7d1bd449e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733196aa-d0') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG os_vif [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:14:91,bridge_name='br-int',has_traffic_filtering=True,id=733196aa-d083-4db2-a729-9e43b83eecdd,network=Network(b0620144-0532-4223-82f2-0fe7d1bd449e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733196aa-d0') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap733196aa-d0, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap733196aa-d0, col_values=(('external_ids', {'iface-id': '733196aa-d083-4db2-a729-9e43b83eecdd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:14:91', 'vm-uuid': '544132d3-3dc4-445c-9a63-5f39e50eb34a'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:48 user nova-compute[72874]: INFO os_vif [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:14:91,bridge_name='br-int',has_traffic_filtering=True,id=733196aa-d083-4db2-a729-9e43b83eecdd,network=Network(b0620144-0532-4223-82f2-0fe7d1bd449e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733196aa-d0')
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] No VIF found with MAC fa:16:3e:05:14:91, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-752ca0fc-6622-48de-bf62-e8c503acd3d1 req-ad1a0161-2910-47be-bee2-279ef81f9a80 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received event network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-752ca0fc-6622-48de-bf62-e8c503acd3d1 req-ad1a0161-2910-47be-bee2-279ef81f9a80 service nova] Acquiring lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-752ca0fc-6622-48de-bf62-e8c503acd3d1 req-ad1a0161-2910-47be-bee2-279ef81f9a80 service nova] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-752ca0fc-6622-48de-bf62-e8c503acd3d1 req-ad1a0161-2910-47be-bee2-279ef81f9a80 service nova] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-752ca0fc-6622-48de-bf62-e8c503acd3d1 req-ad1a0161-2910-47be-bee2-279ef81f9a80 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] No waiting events found dispatching network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:48 user nova-compute[72874]: WARNING nova.compute.manager [req-752ca0fc-6622-48de-bf62-e8c503acd3d1 req-ad1a0161-2910-47be-bee2-279ef81f9a80 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received unexpected event network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f for instance with vm_state active and task_state rebuild_spawning.
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296568.8993137, 3a2a5fdd-3a21-413b-981a-ecc33051c87b => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:22:48 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] VM Resumed (Lifecycle Event)
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:22:48 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Instance spawned successfully.
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:48 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296568.903273, 3a2a5fdd-3a21-413b-981a-ecc33051c87b => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:22:48 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] VM Started (Lifecycle Event)
Aug 17 18:22:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:22:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:22:49 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 18:22:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:22:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:49 user nova-compute[72874]: DEBUG nova.objects.instance [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72874) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 18:22:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86f71872-9894-45d4-a519-0178af13428e tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.074s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:49 user nova-compute[72874]: DEBUG nova.network.neutron [req-593d1c60-87a0-458c-ba64-705959fb7e14 req-ef6dbee3-3ca6-43a3-bfae-d410e439bb57 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Updated VIF entry in instance network info cache for port 733196aa-d083-4db2-a729-9e43b83eecdd. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:22:49 user nova-compute[72874]: DEBUG nova.network.neutron [req-593d1c60-87a0-458c-ba64-705959fb7e14 req-ef6dbee3-3ca6-43a3-bfae-d410e439bb57 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Updating instance_info_cache with network_info: [{"id": "733196aa-d083-4db2-a729-9e43b83eecdd", "address": "fa:16:3e:05:14:91", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733196aa-d0", "ovs_interfaceid": "733196aa-d083-4db2-a729-9e43b83eecdd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:22:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-593d1c60-87a0-458c-ba64-705959fb7e14 req-ef6dbee3-3ca6-43a3-bfae-d410e439bb57 service nova] Releasing lock "refresh_cache-544132d3-3dc4-445c-9a63-5f39e50eb34a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:22:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "f027045c-d121-45ec-af61-e1a2399c4a43" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:49 user nova-compute[72874]: INFO nova.compute.manager [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Detaching volume caba3b52-d6d2-42de-ad5c-c7501d2aab3b
Aug 17 18:22:49 user nova-compute[72874]: INFO nova.virt.block_device [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Attempting to driver detach volume caba3b52-d6d2-42de-ad5c-c7501d2aab3b from mountpoint /dev/vdb
Aug 17 18:22:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Attempting to detach device vdb from instance f027045c-d121-45ec-af61-e1a2399c4a43 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:22:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:22:49 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:22:49 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:22:49 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:22:49 user nova-compute[72874]:   <serial>caba3b52-d6d2-42de-ad5c-c7501d2aab3b</serial>
Aug 17 18:22:49 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:22:49 user nova-compute[72874]: </disk>
Aug 17 18:22:49 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:22:49 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Successfully detached device vdb from instance f027045c-d121-45ec-af61-e1a2399c4a43 from the persistent domain config.
Aug 17 18:22:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f027045c-d121-45ec-af61-e1a2399c4a43 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:22:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:22:49 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:22:49 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:22:49 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:22:49 user nova-compute[72874]:   <serial>caba3b52-d6d2-42de-ad5c-c7501d2aab3b</serial>
Aug 17 18:22:49 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:22:49 user nova-compute[72874]: </disk>
Aug 17 18:22:49 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:22:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-a298f8f4-e055-4fcb-82c7-93a3fe2c9388 req-88b8d005-f895-4f4a-b8a1-d5671daf5c7c service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Received event network-vif-plugged-733196aa-d083-4db2-a729-9e43b83eecdd {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a298f8f4-e055-4fcb-82c7-93a3fe2c9388 req-88b8d005-f895-4f4a-b8a1-d5671daf5c7c service nova] Acquiring lock "544132d3-3dc4-445c-9a63-5f39e50eb34a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a298f8f4-e055-4fcb-82c7-93a3fe2c9388 req-88b8d005-f895-4f4a-b8a1-d5671daf5c7c service nova] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a298f8f4-e055-4fcb-82c7-93a3fe2c9388 req-88b8d005-f895-4f4a-b8a1-d5671daf5c7c service nova] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-a298f8f4-e055-4fcb-82c7-93a3fe2c9388 req-88b8d005-f895-4f4a-b8a1-d5671daf5c7c service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] No waiting events found dispatching network-vif-plugged-733196aa-d083-4db2-a729-9e43b83eecdd {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:50 user nova-compute[72874]: WARNING nova.compute.manager [req-a298f8f4-e055-4fcb-82c7-93a3fe2c9388 req-88b8d005-f895-4f4a-b8a1-d5671daf5c7c service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Received unexpected event network-vif-plugged-733196aa-d083-4db2-a729-9e43b83eecdd for instance with vm_state building and task_state spawning.
Aug 17 18:22:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692296570.5941882, f027045c-d121-45ec-af61-e1a2399c4a43 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f027045c-d121-45ec-af61-e1a2399c4a43 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:22:50 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Successfully detached device vdb from instance f027045c-d121-45ec-af61-e1a2399c4a43 from the live domain config.
Aug 17 18:22:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lGRYpTgL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:22:50 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.035s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6e6261-62a5-472b-84bd-6b277a12b198]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4b1eb9-f36f-467f-adcd-e09e71608670]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:22:50 user nova-compute[72874]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:22:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b (non-flash)
Aug 17 18:22:50 user nova-compute[72874]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:22:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c0461fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b'): ({'sdc'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Removing single pathed devices sdc {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c93e79-9b5c-4f1a-816f-44e8c097fb75]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f367779-86c8-47b5-9b3f-85909482172a]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Flushing IO for device /dev/sdc {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a06e0a-3380-40d7-8911-64e59584985b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.062s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e725e41-ccdc-41b5-90bd-4151d8bae6a7]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c190d451-e08a-431f-883c-a2759ae56ffd]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c935a737-0721-44b2-9776-caabeecb0fd6]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b, portal: 172.16.0.220,3260]
Aug 17 18:22:50 user nova-compute[72874]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b, portal: 172.16.0.220,3260] successful.
Aug 17 18:22:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:caba3b52-d6d2-42de-ad5c-c7501d2aab3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[30614ef6-e887-4638-b071-4f77989478d3]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] <== disconnect_volume: return (373ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:22:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:51 user nova-compute[72874]: INFO nova.compute.manager [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Terminating instance
Aug 17 18:22:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG nova.compute.manager [req-ae4d0e75-c818-4858-b7f7-d26d9ae4b2ad req-a441fdfa-53b7-4ce6-9edb-29c700c51b46 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received event network-vif-unplugged-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ae4d0e75-c818-4858-b7f7-d26d9ae4b2ad req-a441fdfa-53b7-4ce6-9edb-29c700c51b46 service nova] Acquiring lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ae4d0e75-c818-4858-b7f7-d26d9ae4b2ad req-a441fdfa-53b7-4ce6-9edb-29c700c51b46 service nova] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ae4d0e75-c818-4858-b7f7-d26d9ae4b2ad req-a441fdfa-53b7-4ce6-9edb-29c700c51b46 service nova] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG nova.compute.manager [req-ae4d0e75-c818-4858-b7f7-d26d9ae4b2ad req-a441fdfa-53b7-4ce6-9edb-29c700c51b46 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] No waiting events found dispatching network-vif-unplugged-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG nova.compute.manager [req-ae4d0e75-c818-4858-b7f7-d26d9ae4b2ad req-a441fdfa-53b7-4ce6-9edb-29c700c51b46 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received event network-vif-unplugged-63ec6fca-872d-4e61-b76a-c39215266088 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:22:51 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Instance destroyed successfully.
Aug 17 18:22:51 user nova-compute[72874]: DEBUG nova.objects.instance [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'resources' on Instance uuid c27fc8b6-cc8c-426a-859d-04722c569cd4 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T18:16:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-432713260',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-432713260',id=1,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtzSGb/RTg0RRgVw0I27O9/BIQT9JNqUYiaCVzRF/ZiyzbxLbQ3ogj5i0iMmVI1YnyWXTX4BFGtidL7oy3scdKgIgmM9URa5HU3gOM2Lg8cRYOCgIsNeC1jsau2L7myZA==',key_name='tempest-keypair-271521945',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:20:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c20349a873f4ec7a0f72a7d64c636e4',ramdisk_id='',reservation_id='r-xtamjwzg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1376162523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1376162523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:20:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b47defaba840e1ba8f91603d99caac',uuid=c27fc8b6-cc8c-426a-859d-04722c569cd4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converting VIF {"id": "63ec6fca-872d-4e61-b76a-c39215266088", "address": "fa:16:3e:1d:fb:6f", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.86", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63ec6fca-87", "ovs_interfaceid": "63ec6fca-872d-4e61-b76a-c39215266088", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:fb:6f,bridge_name='br-int',has_traffic_filtering=True,id=63ec6fca-872d-4e61-b76a-c39215266088,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ec6fca-87') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG os_vif [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:fb:6f,bridge_name='br-int',has_traffic_filtering=True,id=63ec6fca-872d-4e61-b76a-c39215266088,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ec6fca-87') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63ec6fca-87, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:22:51 user nova-compute[72874]: INFO os_vif [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:fb:6f,bridge_name='br-int',has_traffic_filtering=True,id=63ec6fca-872d-4e61-b76a-c39215266088,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63ec6fca-87')
Aug 17 18:22:51 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Deleting instance files /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4_del
Aug 17 18:22:51 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Deletion of /opt/stack/data/nova/instances/c27fc8b6-cc8c-426a-859d-04722c569cd4_del complete
Aug 17 18:22:52 user nova-compute[72874]: INFO nova.compute.manager [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 17 18:22:52 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:22:52 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:22:52 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:22:52 user nova-compute[72874]: DEBUG nova.objects.instance [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lazy-loading 'flavor' on Instance uuid f027045c-d121-45ec-af61-e1a2399c4a43 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-90d96571-a46b-4a41-8a26-0a31bde2a213 tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "f027045c-d121-45ec-af61-e1a2399c4a43" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.433s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-807c44f1-1056-48c6-afba-b170bfe26b6b req-b09d429e-dd45-405f-b363-c50027a0402e service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Received event network-vif-plugged-733196aa-d083-4db2-a729-9e43b83eecdd {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-807c44f1-1056-48c6-afba-b170bfe26b6b req-b09d429e-dd45-405f-b363-c50027a0402e service nova] Acquiring lock "544132d3-3dc4-445c-9a63-5f39e50eb34a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-807c44f1-1056-48c6-afba-b170bfe26b6b req-b09d429e-dd45-405f-b363-c50027a0402e service nova] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-807c44f1-1056-48c6-afba-b170bfe26b6b req-b09d429e-dd45-405f-b363-c50027a0402e service nova] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-807c44f1-1056-48c6-afba-b170bfe26b6b req-b09d429e-dd45-405f-b363-c50027a0402e service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] No waiting events found dispatching network-vif-plugged-733196aa-d083-4db2-a729-9e43b83eecdd {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:52 user nova-compute[72874]: WARNING nova.compute.manager [req-807c44f1-1056-48c6-afba-b170bfe26b6b req-b09d429e-dd45-405f-b363-c50027a0402e service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Received unexpected event network-vif-plugged-733196aa-d083-4db2-a729-9e43b83eecdd for instance with vm_state building and task_state spawning.
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296573.2800643, 544132d3-3dc4-445c-9a63-5f39e50eb34a => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:22:53 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] VM Resumed (Lifecycle Event)
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:22:53 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Instance spawned successfully.
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:22:53 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Took 1.28 seconds to deallocate network for instance.
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:22:53 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296573.2818372, 544132d3-3dc4-445c-9a63-5f39e50eb34a => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:22:53 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] VM Started (Lifecycle Event)
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:22:53 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:22:53 user nova-compute[72874]: INFO nova.compute.manager [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Took 7.51 seconds to spawn the instance on the hypervisor.
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-6e6a3773-1d7e-4a7e-9254-df8486bd1965 req-ffd635d2-94ef-426e-b2a0-6e7906ee5f90 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received event network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6e6a3773-1d7e-4a7e-9254-df8486bd1965 req-ffd635d2-94ef-426e-b2a0-6e7906ee5f90 service nova] Acquiring lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6e6a3773-1d7e-4a7e-9254-df8486bd1965 req-ffd635d2-94ef-426e-b2a0-6e7906ee5f90 service nova] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6e6a3773-1d7e-4a7e-9254-df8486bd1965 req-ffd635d2-94ef-426e-b2a0-6e7906ee5f90 service nova] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-6e6a3773-1d7e-4a7e-9254-df8486bd1965 req-ffd635d2-94ef-426e-b2a0-6e7906ee5f90 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] No waiting events found dispatching network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:53 user nova-compute[72874]: WARNING nova.compute.manager [req-6e6a3773-1d7e-4a7e-9254-df8486bd1965 req-ffd635d2-94ef-426e-b2a0-6e7906ee5f90 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received unexpected event network-vif-plugged-63ec6fca-872d-4e61-b76a-c39215266088 for instance with vm_state deleted and task_state None.
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-6e6a3773-1d7e-4a7e-9254-df8486bd1965 req-ffd635d2-94ef-426e-b2a0-6e7906ee5f90 service nova] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Received event network-vif-deleted-63ec6fca-872d-4e61-b76a-c39215266088 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:53 user nova-compute[72874]: INFO nova.compute.manager [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Took 8.79 seconds to build instance.
Aug 17 18:22:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2bed5215-b19a-4607-832b-9554b99b1f21 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.907s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:22:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:53 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Deleted allocations for instance c27fc8b6-cc8c-426a-859d-04722c569cd4
Aug 17 18:22:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6d653181-9a2a-468c-a81b-c4896c93f6c8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "c27fc8b6-cc8c-426a-859d-04722c569cd4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.978s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "8c2eb160-5b94-4d53-bd36-b712c62d9100-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:54 user nova-compute[72874]: INFO nova.compute.manager [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Terminating instance
Aug 17 18:22:54 user nova-compute[72874]: DEBUG nova.compute.manager [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:22:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-ee609668-cce3-483b-a82e-fd411e74904a req-f72f2b88-de79-4092-beee-6dc4ec6b5aef service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Received event network-vif-unplugged-99361343-b109-451a-9ce9-50e5fd738b0e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ee609668-cce3-483b-a82e-fd411e74904a req-f72f2b88-de79-4092-beee-6dc4ec6b5aef service nova] Acquiring lock "8c2eb160-5b94-4d53-bd36-b712c62d9100-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ee609668-cce3-483b-a82e-fd411e74904a req-f72f2b88-de79-4092-beee-6dc4ec6b5aef service nova] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ee609668-cce3-483b-a82e-fd411e74904a req-f72f2b88-de79-4092-beee-6dc4ec6b5aef service nova] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-ee609668-cce3-483b-a82e-fd411e74904a req-f72f2b88-de79-4092-beee-6dc4ec6b5aef service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] No waiting events found dispatching network-vif-unplugged-99361343-b109-451a-9ce9-50e5fd738b0e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-ee609668-cce3-483b-a82e-fd411e74904a req-f72f2b88-de79-4092-beee-6dc4ec6b5aef service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Received event network-vif-unplugged-99361343-b109-451a-9ce9-50e5fd738b0e for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:22:55 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Instance destroyed successfully.
Aug 17 18:22:55 user nova-compute[72874]: DEBUG nova.objects.instance [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lazy-loading 'resources' on Instance uuid 8c2eb160-5b94-4d53-bd36-b712c62d9100 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:22:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-322280',display_name='tempest-VolumesAdminNegativeTest-server-322280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-322280',id=6,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDpEOaoYo26PEfZFcqO9UOHlaIdiRVW3+dfCfmTHSW2OBiXiZ3nIGXG5JNWP8Mcrm33TV4w7LWhBbwwdrS1phsUEawsqL5zB9iaOi4MzvWZ8AYr4Lbs8ZvmgF404b+F9g==',key_name='tempest-keypair-1361343294',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:17:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b3fe8a83be9b440b95aa258c4dff6af4',ramdisk_id='',reservation_id='r-jkv7g83t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1606846933',owner_user_name='tempest-VolumesAdminNegativeTest-1606846933-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:17:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f400334282b4272a8f78d682f3816d0',uuid=8c2eb160-5b94-4d53-bd36-b712c62d9100,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99361343-b109-451a-9ce9-50e5fd738b0e", "address": "fa:16:3e:a7:7a:4b", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99361343-b1", "ovs_interfaceid": "99361343-b109-451a-9ce9-50e5fd738b0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:22:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Converting VIF {"id": "99361343-b109-451a-9ce9-50e5fd738b0e", "address": "fa:16:3e:a7:7a:4b", "network": {"id": "92a988c2-183c-41cc-9b97-59474938a618", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1789807250-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b3fe8a83be9b440b95aa258c4dff6af4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99361343-b1", "ovs_interfaceid": "99361343-b109-451a-9ce9-50e5fd738b0e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:22:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:7a:4b,bridge_name='br-int',has_traffic_filtering=True,id=99361343-b109-451a-9ce9-50e5fd738b0e,network=Network(92a988c2-183c-41cc-9b97-59474938a618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99361343-b1') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:22:55 user nova-compute[72874]: DEBUG os_vif [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:7a:4b,bridge_name='br-int',has_traffic_filtering=True,id=99361343-b109-451a-9ce9-50e5fd738b0e,network=Network(92a988c2-183c-41cc-9b97-59474938a618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99361343-b1') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:22:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99361343-b1, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:22:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:22:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:22:55 user nova-compute[72874]: INFO os_vif [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:7a:4b,bridge_name='br-int',has_traffic_filtering=True,id=99361343-b109-451a-9ce9-50e5fd738b0e,network=Network(92a988c2-183c-41cc-9b97-59474938a618),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99361343-b1')
Aug 17 18:22:55 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Deleting instance files /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100_del
Aug 17 18:22:55 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Deletion of /opt/stack/data/nova/instances/8c2eb160-5b94-4d53-bd36-b712c62d9100_del complete
Aug 17 18:22:55 user nova-compute[72874]: INFO nova.compute.manager [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 17 18:22:55 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:22:55 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:22:55 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:22:56 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:22:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-15218896-117b-49ec-aec3-267c2d83ac80 req-56ff367c-0bcf-4c61-aaa6-1ffc1960916d service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Received event network-vif-deleted-99361343-b109-451a-9ce9-50e5fd738b0e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:56 user nova-compute[72874]: INFO nova.compute.manager [req-15218896-117b-49ec-aec3-267c2d83ac80 req-56ff367c-0bcf-4c61-aaa6-1ffc1960916d service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Neutron deleted interface 99361343-b109-451a-9ce9-50e5fd738b0e; detaching it from the instance and deleting it from the info cache
Aug 17 18:22:56 user nova-compute[72874]: DEBUG nova.network.neutron [req-15218896-117b-49ec-aec3-267c2d83ac80 req-56ff367c-0bcf-4c61-aaa6-1ffc1960916d service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:22:56 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Took 1.26 seconds to deallocate network for instance.
Aug 17 18:22:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-15218896-117b-49ec-aec3-267c2d83ac80 req-56ff367c-0bcf-4c61-aaa6-1ffc1960916d service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Detach interface failed, port_id=99361343-b109-451a-9ce9-50e5fd738b0e, reason: Instance 8c2eb160-5b94-4d53-bd36-b712c62d9100 could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:22:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-9b420682-02bf-45b3-bacd-d605a4d1bafa req-152dd9c7-20f6-4717-b243-e82d52f362f4 service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Received event network-vif-plugged-99361343-b109-451a-9ce9-50e5fd738b0e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:22:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b420682-02bf-45b3-bacd-d605a4d1bafa req-152dd9c7-20f6-4717-b243-e82d52f362f4 service nova] Acquiring lock "8c2eb160-5b94-4d53-bd36-b712c62d9100-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:22:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b420682-02bf-45b3-bacd-d605a4d1bafa req-152dd9c7-20f6-4717-b243-e82d52f362f4 service nova] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:22:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b420682-02bf-45b3-bacd-d605a4d1bafa req-152dd9c7-20f6-4717-b243-e82d52f362f4 service nova] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-9b420682-02bf-45b3-bacd-d605a4d1bafa req-152dd9c7-20f6-4717-b243-e82d52f362f4 service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] No waiting events found dispatching network-vif-plugged-99361343-b109-451a-9ce9-50e5fd738b0e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:22:57 user nova-compute[72874]: WARNING nova.compute.manager [req-9b420682-02bf-45b3-bacd-d605a4d1bafa req-152dd9c7-20f6-4717-b243-e82d52f362f4 service nova] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Received unexpected event network-vif-plugged-99361343-b109-451a-9ce9-50e5fd738b0e for instance with vm_state deleted and task_state None.
Aug 17 18:22:57 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:22:57 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:22:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:22:57 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Deleted allocations for instance 8c2eb160-5b94-4d53-bd36-b712c62d9100
Aug 17 18:22:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-556b2cee-501a-4332-b48f-f310d3bfd0ae tempest-VolumesAdminNegativeTest-1606846933 tempest-VolumesAdminNegativeTest-1606846933-project-member] Lock "8c2eb160-5b94-4d53-bd36-b712c62d9100" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.824s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:23:06 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296571.9068458, c27fc8b6-cc8c-426a-859d-04722c569cd4 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:23:06 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] VM Stopped (Lifecycle Event)
Aug 17 18:23:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-927df5a6-918d-4bd2-8ce9-bf83e05e16f9 None None] [instance: c27fc8b6-cc8c-426a-859d-04722c569cd4] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:23:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:23:09 user nova-compute[72874]: INFO nova.compute.claims [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Claim successful on node user
Aug 17 18:23:09 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:23:09 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:23:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:23:09 user nova-compute[72874]: INFO nova.virt.block_device [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Booting with volume c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 at /dev/vda
Aug 17 18:23:09 user nova-compute[72874]: DEBUG os_brick.utils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a11a36-5416-4265-b9a9-014bbff761ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda7dae1-589c-4f89-a7e3-25b8d9c36a99]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d3332c-d749-40f1-8eab-a18fcd9b5504]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd34ff9-f52e-46d8-b8ab-1bfb9640d961]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:23:09 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:23:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbb2f79-18d4-4c89-b489-11093293f8d5]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG os_brick.utils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:23:09 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Updating existing volume attachment record: 4c9a83f0-0426-4052-899e-2a71a8c76244 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG nova.policy [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '909454bbec8446d4beeba819352180e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31af41fdde924ec880875f5b31ba1a87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296575.291378, 8c2eb160-5b94-4d53-bd36-b712c62d9100 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:23:10 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] VM Stopped (Lifecycle Event)
Aug 17 18:23:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-c1a6f322-ff02-40c2-823f-0d478e7372aa None None] [instance: 8c2eb160-5b94-4d53-bd36-b712c62d9100] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Successfully created port: fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:11 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Successfully created port: fdfe9b78-3799-41b0-87e0-88219cdaad87 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:23:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:12 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Successfully created port: 4aa59cbf-eda8-40ba-a155-1826ecc9d850 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:23:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:23:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-5972e4be-015f-4ad3-969c-e66766d6bcfd req-3283b0e2-36b5-4213-ac45-450b896e169b service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Received event network-changed-903af9b8-b067-4ada-adc9-3183fe6654ed {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-5972e4be-015f-4ad3-969c-e66766d6bcfd req-3283b0e2-36b5-4213-ac45-450b896e169b service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Refreshing instance network info cache due to event network-changed-903af9b8-b067-4ada-adc9-3183fe6654ed. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:23:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5972e4be-015f-4ad3-969c-e66766d6bcfd req-3283b0e2-36b5-4213-ac45-450b896e169b service nova] Acquiring lock "refresh_cache-857d43f7-6f53-4c82-9e68-fca3078e97ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:23:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5972e4be-015f-4ad3-969c-e66766d6bcfd req-3283b0e2-36b5-4213-ac45-450b896e169b service nova] Acquired lock "refresh_cache-857d43f7-6f53-4c82-9e68-fca3078e97ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:23:12 user nova-compute[72874]: DEBUG nova.network.neutron [req-5972e4be-015f-4ad3-969c-e66766d6bcfd req-3283b0e2-36b5-4213-ac45-450b896e169b service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Refreshing network info cache for port 903af9b8-b067-4ada-adc9-3183fe6654ed {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:23:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:13 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:23:13 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:23:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7518MB free_disk=25.425914764404297GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:23:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance f027045c-d121-45ec-af61-e1a2399c4a43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:23:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:23:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2ace97e1-c2ee-462e-a929-22c7cb2584d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:23:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 3a2a5fdd-3a21-413b-981a-ecc33051c87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:23:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 857d43f7-6f53-4c82-9e68-fca3078e97ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:23:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:23:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 544132d3-3dc4-445c-9a63-5f39e50eb34a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:23:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c998fa1-9430-4f03-bae7-ce510509a9be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:23:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:23:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:23:14 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:23:14 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:23:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:23:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.511s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:14 user nova-compute[72874]: DEBUG nova.network.neutron [req-5972e4be-015f-4ad3-969c-e66766d6bcfd req-3283b0e2-36b5-4213-ac45-450b896e169b service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Updated VIF entry in instance network info cache for port 903af9b8-b067-4ada-adc9-3183fe6654ed. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:23:14 user nova-compute[72874]: DEBUG nova.network.neutron [req-5972e4be-015f-4ad3-969c-e66766d6bcfd req-3283b0e2-36b5-4213-ac45-450b896e169b service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Updating instance_info_cache with network_info: [{"id": "903af9b8-b067-4ada-adc9-3183fe6654ed", "address": "fa:16:3e:85:9f:87", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903af9b8-b0", "ovs_interfaceid": "903af9b8-b067-4ada-adc9-3183fe6654ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:14 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Successfully created port: 5e8d3da0-5572-4024-9d00-cc5b185bff71 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:23:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5972e4be-015f-4ad3-969c-e66766d6bcfd req-3283b0e2-36b5-4213-ac45-450b896e169b service nova] Releasing lock "refresh_cache-857d43f7-6f53-4c82-9e68-fca3078e97ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:23:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:15 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Successfully created port: e86b5e91-071c-4b9e-80f0-7ce24ada55f5 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:23:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:16 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Successfully updated port: fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:23:16 user nova-compute[72874]: DEBUG nova.compute.manager [req-84bb7915-b4cd-451b-9801-bb5be98ddeba req-17e12572-58d6-4b18-9b09-764efc1b9b07 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-changed-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:16 user nova-compute[72874]: DEBUG nova.compute.manager [req-84bb7915-b4cd-451b-9801-bb5be98ddeba req-17e12572-58d6-4b18-9b09-764efc1b9b07 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Refreshing instance network info cache due to event network-changed-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:23:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-84bb7915-b4cd-451b-9801-bb5be98ddeba req-17e12572-58d6-4b18-9b09-764efc1b9b07 service nova] Acquiring lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:23:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-84bb7915-b4cd-451b-9801-bb5be98ddeba req-17e12572-58d6-4b18-9b09-764efc1b9b07 service nova] Acquired lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:23:16 user nova-compute[72874]: DEBUG nova.network.neutron [req-84bb7915-b4cd-451b-9801-bb5be98ddeba req-17e12572-58d6-4b18-9b09-764efc1b9b07 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Refreshing network info cache for port fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:23:16 user nova-compute[72874]: DEBUG nova.network.neutron [req-84bb7915-b4cd-451b-9801-bb5be98ddeba req-17e12572-58d6-4b18-9b09-764efc1b9b07 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:23:16 user nova-compute[72874]: DEBUG nova.network.neutron [req-84bb7915-b4cd-451b-9801-bb5be98ddeba req-17e12572-58d6-4b18-9b09-764efc1b9b07 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-84bb7915-b4cd-451b-9801-bb5be98ddeba req-17e12572-58d6-4b18-9b09-764efc1b9b07 service nova] Releasing lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:23:17 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Successfully updated port: 2a06f651-218f-42e4-aee0-40e733d5a891 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:23:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:17 user nova-compute[72874]: DEBUG nova.objects.instance [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'flavor' on Instance uuid 857d43f7-6f53-4c82-9e68-fca3078e97ea {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:23:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:18 user nova-compute[72874]: INFO nova.compute.manager [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Attaching volume 55359bd1-db03-480e-b33c-29e2c6decfb5 to /dev/vdb
Aug 17 18:23:18 user nova-compute[72874]: DEBUG os_brick.utils [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da6b918-478d-4fd2-beaa-b5a603c89afb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac36f349-7202-435e-9189-a6be86e97a17]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9656ad1d-336e-4327-89f6-cb1f6e049226]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b1f6ce-0840-418d-8783-1d724b134ab0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:23:18 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf897429-3e93-4206-8173-a47b5f8a7bba]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG os_brick.utils [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Updating existing volume attachment record: 64f54477-eade-4a4d-9594-b888cb063ec1 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Skipping network cache update for instance because it is Building. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG nova.compute.manager [req-8ceb5e38-211d-41fb-90da-2af60f8ada7d req-81ac5a94-b315-4cae-97a0-aab01b4c77fa service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-changed-2a06f651-218f-42e4-aee0-40e733d5a891 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG nova.compute.manager [req-8ceb5e38-211d-41fb-90da-2af60f8ada7d req-81ac5a94-b315-4cae-97a0-aab01b4c77fa service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Refreshing instance network info cache due to event network-changed-2a06f651-218f-42e4-aee0-40e733d5a891. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8ceb5e38-211d-41fb-90da-2af60f8ada7d req-81ac5a94-b315-4cae-97a0-aab01b4c77fa service nova] Acquiring lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8ceb5e38-211d-41fb-90da-2af60f8ada7d req-81ac5a94-b315-4cae-97a0-aab01b4c77fa service nova] Acquired lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG nova.network.neutron [req-8ceb5e38-211d-41fb-90da-2af60f8ada7d req-81ac5a94-b315-4cae-97a0-aab01b4c77fa service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Refreshing network info cache for port 2a06f651-218f-42e4-aee0-40e733d5a891 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG nova.network.neutron [req-8ceb5e38-211d-41fb-90da-2af60f8ada7d req-81ac5a94-b315-4cae-97a0-aab01b4c77fa service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid f027045c-d121-45ec-af61-e1a2399c4a43 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG nova.network.neutron [req-8ceb5e38-211d-41fb-90da-2af60f8ada7d req-81ac5a94-b315-4cae-97a0-aab01b4c77fa service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8ceb5e38-211d-41fb-90da-2af60f8ada7d req-81ac5a94-b315-4cae-97a0-aab01b4c77fa service nova] Releasing lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:23:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:19 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Successfully updated port: 025bb037-5e0c-45f3-96c2-09a83b224502 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:23:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG nova.compute.manager [req-7fe1a6fb-2be4-4849-ac99-8a644dd6f0d9 req-3dc39fc3-1987-4df4-955f-cdef4df84ecc service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-changed-025bb037-5e0c-45f3-96c2-09a83b224502 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG nova.compute.manager [req-7fe1a6fb-2be4-4849-ac99-8a644dd6f0d9 req-3dc39fc3-1987-4df4-955f-cdef4df84ecc service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Refreshing instance network info cache due to event network-changed-025bb037-5e0c-45f3-96c2-09a83b224502. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7fe1a6fb-2be4-4849-ac99-8a644dd6f0d9 req-3dc39fc3-1987-4df4-955f-cdef4df84ecc service nova] Acquiring lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7fe1a6fb-2be4-4849-ac99-8a644dd6f0d9 req-3dc39fc3-1987-4df4-955f-cdef4df84ecc service nova] Acquired lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG nova.network.neutron [req-7fe1a6fb-2be4-4849-ac99-8a644dd6f0d9 req-3dc39fc3-1987-4df4-955f-cdef4df84ecc service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Refreshing network info cache for port 025bb037-5e0c-45f3-96c2-09a83b224502 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG nova.network.neutron [req-7fe1a6fb-2be4-4849-ac99-8a644dd6f0d9 req-3dc39fc3-1987-4df4-955f-cdef4df84ecc service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG nova.network.neutron [req-7fe1a6fb-2be4-4849-ac99-8a644dd6f0d9 req-3dc39fc3-1987-4df4-955f-cdef4df84ecc service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7fe1a6fb-2be4-4849-ac99-8a644dd6f0d9 req-3dc39fc3-1987-4df4-955f-cdef4df84ecc service nova] Releasing lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updating instance_info_cache with network_info: [{"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-f027045c-d121-45ec-af61-e1a2399c4a43" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:23:20 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:23:21 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Successfully updated port: fdfe9b78-3799-41b0-87e0-88219cdaad87 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Successfully updated port: 4aa59cbf-eda8-40ba-a155-1826ecc9d850 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG nova.compute.manager [req-eaf2cbff-f944-4d9d-b735-53af97bbc5ee req-d39c279f-0cac-4ad6-b8fd-5189c9ef54b5 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-changed-fdfe9b78-3799-41b0-87e0-88219cdaad87 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG nova.compute.manager [req-eaf2cbff-f944-4d9d-b735-53af97bbc5ee req-d39c279f-0cac-4ad6-b8fd-5189c9ef54b5 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Refreshing instance network info cache due to event network-changed-fdfe9b78-3799-41b0-87e0-88219cdaad87. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eaf2cbff-f944-4d9d-b735-53af97bbc5ee req-d39c279f-0cac-4ad6-b8fd-5189c9ef54b5 service nova] Acquiring lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eaf2cbff-f944-4d9d-b735-53af97bbc5ee req-d39c279f-0cac-4ad6-b8fd-5189c9ef54b5 service nova] Acquired lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG nova.network.neutron [req-eaf2cbff-f944-4d9d-b735-53af97bbc5ee req-d39c279f-0cac-4ad6-b8fd-5189c9ef54b5 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Refreshing network info cache for port fdfe9b78-3799-41b0-87e0-88219cdaad87 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:23:22 user nova-compute[72874]: INFO nova.virt.block_device [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Booting with volume 8e77b595-57f6-40df-85ef-c933cf5a1b53 at /dev/vdb
Aug 17 18:23:22 user nova-compute[72874]: DEBUG nova.network.neutron [req-eaf2cbff-f944-4d9d-b735-53af97bbc5ee req-d39c279f-0cac-4ad6-b8fd-5189c9ef54b5 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG os_brick.utils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de63190-c9e9-4df8-8fbe-31fa28bf1ffa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[874f8dd9-63fe-455a-be46-79eb05ed130d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f065d3-329c-4b4c-9323-851da6bc012c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfced335-61c5-44b3-b9bc-1642551d8d14]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:23:22 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:23:22 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db9cf2b-d278-4a08-a5fb-5c61cdfd6989]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG os_brick.utils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:23:22 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Updating existing volume attachment record: 57b8eff9-ffe8-4b24-99e4-8c3ccf13492b {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG nova.network.neutron [req-eaf2cbff-f944-4d9d-b735-53af97bbc5ee req-d39c279f-0cac-4ad6-b8fd-5189c9ef54b5 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eaf2cbff-f944-4d9d-b735-53af97bbc5ee req-d39c279f-0cac-4ad6-b8fd-5189c9ef54b5 service nova] Releasing lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG nova.compute.manager [req-eaf2cbff-f944-4d9d-b735-53af97bbc5ee req-d39c279f-0cac-4ad6-b8fd-5189c9ef54b5 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-changed-4aa59cbf-eda8-40ba-a155-1826ecc9d850 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG nova.compute.manager [req-eaf2cbff-f944-4d9d-b735-53af97bbc5ee req-d39c279f-0cac-4ad6-b8fd-5189c9ef54b5 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Refreshing instance network info cache due to event network-changed-4aa59cbf-eda8-40ba-a155-1826ecc9d850. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eaf2cbff-f944-4d9d-b735-53af97bbc5ee req-d39c279f-0cac-4ad6-b8fd-5189c9ef54b5 service nova] Acquiring lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eaf2cbff-f944-4d9d-b735-53af97bbc5ee req-d39c279f-0cac-4ad6-b8fd-5189c9ef54b5 service nova] Acquired lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG nova.network.neutron [req-eaf2cbff-f944-4d9d-b735-53af97bbc5ee req-d39c279f-0cac-4ad6-b8fd-5189c9ef54b5 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Refreshing network info cache for port 4aa59cbf-eda8-40ba-a155-1826ecc9d850 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG nova.network.neutron [req-eaf2cbff-f944-4d9d-b735-53af97bbc5ee req-d39c279f-0cac-4ad6-b8fd-5189c9ef54b5 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "7044ab36-115d-454b-a787-b3199a815d4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "7044ab36-115d-454b-a787-b3199a815d4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:23:23 user nova-compute[72874]: INFO nova.compute.claims [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Claim successful on node user
Aug 17 18:23:23 user nova-compute[72874]: DEBUG nova.network.neutron [req-eaf2cbff-f944-4d9d-b735-53af97bbc5ee req-d39c279f-0cac-4ad6-b8fd-5189c9ef54b5 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eaf2cbff-f944-4d9d-b735-53af97bbc5ee req-d39c279f-0cac-4ad6-b8fd-5189c9ef54b5 service nova] Releasing lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:23:23 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Successfully updated port: 5e8d3da0-5572-4024-9d00-cc5b185bff71 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:23:24 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:23:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:23:24 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Creating image(s)
Aug 17 18:23:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "/opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "/opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "/opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG nova.policy [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '576a655170bb4dc3b1c45cb9bbfe5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a608a48fc27947bcbbc84e5c078cea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f.part --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-6cb65912-f1ba-4b3d-88ea-f061a25eb337 req-11e8384c-e676-4c73-861f-1e89ffdcaf8a service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-changed-5e8d3da0-5572-4024-9d00-cc5b185bff71 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-6cb65912-f1ba-4b3d-88ea-f061a25eb337 req-11e8384c-e676-4c73-861f-1e89ffdcaf8a service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Refreshing instance network info cache due to event network-changed-5e8d3da0-5572-4024-9d00-cc5b185bff71. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6cb65912-f1ba-4b3d-88ea-f061a25eb337 req-11e8384c-e676-4c73-861f-1e89ffdcaf8a service nova] Acquiring lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6cb65912-f1ba-4b3d-88ea-f061a25eb337 req-11e8384c-e676-4c73-861f-1e89ffdcaf8a service nova] Acquired lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG nova.network.neutron [req-6cb65912-f1ba-4b3d-88ea-f061a25eb337 req-11e8384c-e676-4c73-861f-1e89ffdcaf8a service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Refreshing network info cache for port 5e8d3da0-5572-4024-9d00-cc5b185bff71 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG nova.network.neutron [req-6cb65912-f1ba-4b3d-88ea-f061a25eb337 req-11e8384c-e676-4c73-861f-1e89ffdcaf8a service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f.part --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG nova.virt.images [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] 61db7187-9851-4469-83f6-e39a4e544055 was qcow2, converting to raw {{(pid=72874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f.part /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f.converted {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG nova.network.neutron [req-6cb65912-f1ba-4b3d-88ea-f061a25eb337 req-11e8384c-e676-4c73-861f-1e89ffdcaf8a service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6cb65912-f1ba-4b3d-88ea-f061a25eb337 req-11e8384c-e676-4c73-861f-1e89ffdcaf8a service nova] Releasing lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f.part /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f.converted" returned: 0 in 0.197s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f.converted --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.080s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f --force-share --output=json" returned: 0 in 0.170s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f,backing_fmt=raw /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f,backing_fmt=raw /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk 1073741824" returned: 0 in 0.047s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f --force-share --output=json" returned: 0 in 0.201s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:25 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Successfully created port: 51bbddc6-885b-4d2e-a436-a08f1ee3a204 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:23:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:26 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Cannot resize image /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:23:26 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lazy-loading 'migration_context' on Instance uuid 7044ab36-115d-454b-a787-b3199a815d4e {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:23:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:23:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Ensure instance console log exists: /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:23:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:26 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Successfully updated port: e86b5e91-071c-4b9e-80f0-7ce24ada55f5 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:23:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquiring lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:23:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquired lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:23:26 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:23:26 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:23:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-0d50df31-0c5f-4d5a-8dca-84502eb293df req-f939b1e0-6299-4f75-b120-25c97efbdf3a service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-changed-e86b5e91-071c-4b9e-80f0-7ce24ada55f5 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-0d50df31-0c5f-4d5a-8dca-84502eb293df req-f939b1e0-6299-4f75-b120-25c97efbdf3a service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Refreshing instance network info cache due to event network-changed-e86b5e91-071c-4b9e-80f0-7ce24ada55f5. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:23:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0d50df31-0c5f-4d5a-8dca-84502eb293df req-f939b1e0-6299-4f75-b120-25c97efbdf3a service nova] Acquiring lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:23:27 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Successfully updated port: 51bbddc6-885b-4d2e-a436-a08f1ee3a204 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:23:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "refresh_cache-7044ab36-115d-454b-a787-b3199a815d4e" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:23:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquired lock "refresh_cache-7044ab36-115d-454b-a787-b3199a815d4e" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:23:27 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:23:27 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Updating instance_info_cache with network_info: [{"id": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "address": "fa:16:3e:03:c0:3f", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51bbddc6-88", "ovs_interfaceid": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Releasing lock "refresh_cache-7044ab36-115d-454b-a787-b3199a815d4e" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Instance network_info: |[{"id": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "address": "fa:16:3e:03:c0:3f", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51bbddc6-88", "ovs_interfaceid": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Start _get_guest_xml network_info=[{"id": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "address": "fa:16:3e:03:c0:3f", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51bbddc6-88", "ovs_interfaceid": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:23:20Z,direct_url=<?>,disk_format='qcow2',id=61db7187-9851-4469-83f6-e39a4e544055,min_disk=0,min_ram=0,name='tempest-scenario-img--2129681756',owner='a608a48fc27947bcbbc84e5c078cea4c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:23:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '61db7187-9851-4469-83f6-e39a4e544055'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:23:28 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:23:28 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:23:20Z,direct_url=<?>,disk_format='qcow2',id=61db7187-9851-4469-83f6-e39a4e544055,min_disk=0,min_ram=0,name='tempest-scenario-img--2129681756',owner='a608a48fc27947bcbbc84e5c078cea4c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:23:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:23:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1393165526',display_name='tempest-TestMinimumBasicScenario-server-1393165526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1393165526',id=19,image_ref='61db7187-9851-4469-83f6-e39a4e544055',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOW3GIoziXYjj2lk4gqitkMchmuo16RuJkN8+50HTf9poMcymF9ysUVFLkF+/fBftEiqELbyd25ohsRktPfhXRsaCAyz83dIVGDhOdBWBrdtsKxEC4QaVkPbr3WzkkztqQ==',key_name='tempest-TestMinimumBasicScenario-285091982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a608a48fc27947bcbbc84e5c078cea4c',ramdisk_id='',reservation_id='r-kjrmrs2s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61db7187-9851-4469-83f6-e39a4e544055',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1549406810',owner_user_name='tempest-TestMinimumBasicScenario-1549406810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:24Z,user_data=None,user_id='576a655170bb4dc3b1c45cb9bbfe5ae7',uuid=7044ab36-115d-454b-a787-b3199a815d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "address": "fa:16:3e:03:c0:3f", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51bbddc6-88", "ovs_interfaceid": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Converting VIF {"id": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "address": "fa:16:3e:03:c0:3f", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51bbddc6-88", "ovs_interfaceid": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:c0:3f,bridge_name='br-int',has_traffic_filtering=True,id=51bbddc6-885b-4d2e-a436-a08f1ee3a204,network=Network(6badf08e-0db0-44c7-a8e8-1825dc05ee9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51bbddc6-88') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lazy-loading 'pci_devices' on Instance uuid 7044ab36-115d-454b-a787-b3199a815d4e {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:23:28 user nova-compute[72874]:   <uuid>7044ab36-115d-454b-a787-b3199a815d4e</uuid>
Aug 17 18:23:28 user nova-compute[72874]:   <name>instance-00000013</name>
Aug 17 18:23:28 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:23:28 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:23:28 user nova-compute[72874]:   <metadata>
Aug 17 18:23:28 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:23:28 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:23:28 user nova-compute[72874]:       <nova:name>tempest-TestMinimumBasicScenario-server-1393165526</nova:name>
Aug 17 18:23:28 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:23:28</nova:creationTime>
Aug 17 18:23:28 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:23:28 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:23:28 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:23:28 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:23:28 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:23:28 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:23:28 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:23:28 user nova-compute[72874]:       <nova:owner>
Aug 17 18:23:28 user nova-compute[72874]:         <nova:user uuid="576a655170bb4dc3b1c45cb9bbfe5ae7">tempest-TestMinimumBasicScenario-1549406810-project-member</nova:user>
Aug 17 18:23:28 user nova-compute[72874]:         <nova:project uuid="a608a48fc27947bcbbc84e5c078cea4c">tempest-TestMinimumBasicScenario-1549406810</nova:project>
Aug 17 18:23:28 user nova-compute[72874]:       </nova:owner>
Aug 17 18:23:28 user nova-compute[72874]:       <nova:root type="image" uuid="61db7187-9851-4469-83f6-e39a4e544055"/>
Aug 17 18:23:28 user nova-compute[72874]:       <nova:ports>
Aug 17 18:23:28 user nova-compute[72874]:         <nova:port uuid="51bbddc6-885b-4d2e-a436-a08f1ee3a204">
Aug 17 18:23:28 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 18:23:28 user nova-compute[72874]:         </nova:port>
Aug 17 18:23:28 user nova-compute[72874]:       </nova:ports>
Aug 17 18:23:28 user nova-compute[72874]:     </nova:instance>
Aug 17 18:23:28 user nova-compute[72874]:   </metadata>
Aug 17 18:23:28 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:23:28 user nova-compute[72874]:     <system>
Aug 17 18:23:28 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:23:28 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:23:28 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:23:28 user nova-compute[72874]:       <entry name="serial">7044ab36-115d-454b-a787-b3199a815d4e</entry>
Aug 17 18:23:28 user nova-compute[72874]:       <entry name="uuid">7044ab36-115d-454b-a787-b3199a815d4e</entry>
Aug 17 18:23:28 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:23:28 user nova-compute[72874]:     </system>
Aug 17 18:23:28 user nova-compute[72874]:   </sysinfo>
Aug 17 18:23:28 user nova-compute[72874]:   <os>
Aug 17 18:23:28 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:23:28 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:23:28 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:23:28 user nova-compute[72874]:   </os>
Aug 17 18:23:28 user nova-compute[72874]:   <features>
Aug 17 18:23:28 user nova-compute[72874]:     <acpi/>
Aug 17 18:23:28 user nova-compute[72874]:     <apic/>
Aug 17 18:23:28 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:23:28 user nova-compute[72874]:   </features>
Aug 17 18:23:28 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:23:28 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:23:28 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:23:28 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:23:28 user nova-compute[72874]:   </clock>
Aug 17 18:23:28 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:23:28 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:23:28 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:23:28 user nova-compute[72874]:   </cpu>
Aug 17 18:23:28 user nova-compute[72874]:   <devices>
Aug 17 18:23:28 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:23:28 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:23:28 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk"/>
Aug 17 18:23:28 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:23:28 user nova-compute[72874]:     </disk>
Aug 17 18:23:28 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:23:28 user nova-compute[72874]:       <mac address="fa:16:3e:03:c0:3f"/>
Aug 17 18:23:28 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:23:28 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:23:28 user nova-compute[72874]:       <target dev="tap51bbddc6-88"/>
Aug 17 18:23:28 user nova-compute[72874]:     </interface>
Aug 17 18:23:28 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:23:28 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/console.log" append="off"/>
Aug 17 18:23:28 user nova-compute[72874]:     </serial>
Aug 17 18:23:28 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:23:28 user nova-compute[72874]:     <video>
Aug 17 18:23:28 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:23:28 user nova-compute[72874]:     </video>
Aug 17 18:23:28 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:23:28 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:23:28 user nova-compute[72874]:     </rng>
Aug 17 18:23:28 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:23:28 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:23:28 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:23:28 user nova-compute[72874]:     </memballoon>
Aug 17 18:23:28 user nova-compute[72874]:   </devices>
Aug 17 18:23:28 user nova-compute[72874]: </domain>
Aug 17 18:23:28 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:23:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1393165526',display_name='tempest-TestMinimumBasicScenario-server-1393165526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1393165526',id=19,image_ref='61db7187-9851-4469-83f6-e39a4e544055',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOW3GIoziXYjj2lk4gqitkMchmuo16RuJkN8+50HTf9poMcymF9ysUVFLkF+/fBftEiqELbyd25ohsRktPfhXRsaCAyz83dIVGDhOdBWBrdtsKxEC4QaVkPbr3WzkkztqQ==',key_name='tempest-TestMinimumBasicScenario-285091982',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a608a48fc27947bcbbc84e5c078cea4c',ramdisk_id='',reservation_id='r-kjrmrs2s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61db7187-9851-4469-83f6-e39a4e544055',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1549406810',owner_user_name='tempest-TestMinimumBasicScenario-1549406810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:24Z,user_data=None,user_id='576a655170bb4dc3b1c45cb9bbfe5ae7',uuid=7044ab36-115d-454b-a787-b3199a815d4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "address": "fa:16:3e:03:c0:3f", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51bbddc6-88", "ovs_interfaceid": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Converting VIF {"id": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "address": "fa:16:3e:03:c0:3f", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51bbddc6-88", "ovs_interfaceid": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:c0:3f,bridge_name='br-int',has_traffic_filtering=True,id=51bbddc6-885b-4d2e-a436-a08f1ee3a204,network=Network(6badf08e-0db0-44c7-a8e8-1825dc05ee9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51bbddc6-88') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG os_vif [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:c0:3f,bridge_name='br-int',has_traffic_filtering=True,id=51bbddc6-885b-4d2e-a436-a08f1ee3a204,network=Network(6badf08e-0db0-44c7-a8e8-1825dc05ee9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51bbddc6-88') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51bbddc6-88, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51bbddc6-88, col_values=(('external_ids', {'iface-id': '51bbddc6-885b-4d2e-a436-a08f1ee3a204', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:c0:3f', 'vm-uuid': '7044ab36-115d-454b-a787-b3199a815d4e'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:28 user nova-compute[72874]: INFO os_vif [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:c0:3f,bridge_name='br-int',has_traffic_filtering=True,id=51bbddc6-885b-4d2e-a436-a08f1ee3a204,network=Network(6badf08e-0db0-44c7-a8e8-1825dc05ee9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51bbddc6-88')
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] No VIF found with MAC fa:16:3e:03:c0:3f, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.compute.manager [req-9e8ce095-a32d-4e22-bbc7-d9b7124ac89a req-7426bc4c-4e71-49d8-8bff-c39459d04dbc service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Received event network-changed-51bbddc6-885b-4d2e-a436-a08f1ee3a204 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.compute.manager [req-9e8ce095-a32d-4e22-bbc7-d9b7124ac89a req-7426bc4c-4e71-49d8-8bff-c39459d04dbc service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Refreshing instance network info cache due to event network-changed-51bbddc6-885b-4d2e-a436-a08f1ee3a204. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e8ce095-a32d-4e22-bbc7-d9b7124ac89a req-7426bc4c-4e71-49d8-8bff-c39459d04dbc service nova] Acquiring lock "refresh_cache-7044ab36-115d-454b-a787-b3199a815d4e" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e8ce095-a32d-4e22-bbc7-d9b7124ac89a req-7426bc4c-4e71-49d8-8bff-c39459d04dbc service nova] Acquired lock "refresh_cache-7044ab36-115d-454b-a787-b3199a815d4e" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:23:28 user nova-compute[72874]: DEBUG nova.network.neutron [req-9e8ce095-a32d-4e22-bbc7-d9b7124ac89a req-7426bc4c-4e71-49d8-8bff-c39459d04dbc service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Refreshing network info cache for port 51bbddc6-885b-4d2e-a436-a08f1ee3a204 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:23:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG nova.network.neutron [req-9e8ce095-a32d-4e22-bbc7-d9b7124ac89a req-7426bc4c-4e71-49d8-8bff-c39459d04dbc service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Updated VIF entry in instance network info cache for port 51bbddc6-885b-4d2e-a436-a08f1ee3a204. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG nova.network.neutron [req-9e8ce095-a32d-4e22-bbc7-d9b7124ac89a req-7426bc4c-4e71-49d8-8bff-c39459d04dbc service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Updating instance_info_cache with network_info: [{"id": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "address": "fa:16:3e:03:c0:3f", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51bbddc6-88", "ovs_interfaceid": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e8ce095-a32d-4e22-bbc7-d9b7124ac89a req-7426bc4c-4e71-49d8-8bff-c39459d04dbc service nova] Releasing lock "refresh_cache-7044ab36-115d-454b-a787-b3199a815d4e" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Updating instance_info_cache with network_info: [{"id": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "address": "fa:16:3e:c8:a8:2b", "network": {"id": "51ce5fe7-85ba-4c8a-9ba3-4b8823afea51", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-341654396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb19bfac-de", "ovs_interfaceid": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a06f651-218f-42e4-aee0-40e733d5a891", "address": "fa:16:3e:46:26:f0", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a06f651-21", "ovs_interfaceid": "2a06f651-218f-42e4-aee0-40e733d5a891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "025bb037-5e0c-45f3-96c2-09a83b224502", "address": "fa:16:3e:06:ed:ab", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025bb037-5e", "ovs_interfaceid": "025bb037-5e0c-45f3-96c2-09a83b224502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "address": "fa:16:3e:1c:de:6d", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdfe9b78-37", "ovs_interfaceid": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "address": "fa:16:3e:67:28:cb", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa59cbf-ed", "ovs_interfaceid": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "address": "fa:16:3e:0d:77:c0", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8d3da0-55", "ovs_interfaceid": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "address": "fa:16:3e:f7:68:17", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86b5e91-07", "ovs_interfaceid": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Releasing lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Instance network_info: |[{"id": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "address": "fa:16:3e:c8:a8:2b", "network": {"id": "51ce5fe7-85ba-4c8a-9ba3-4b8823afea51", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-341654396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb19bfac-de", "ovs_interfaceid": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a06f651-218f-42e4-aee0-40e733d5a891", "address": "fa:16:3e:46:26:f0", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a06f651-21", "ovs_interfaceid": "2a06f651-218f-42e4-aee0-40e733d5a891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "025bb037-5e0c-45f3-96c2-09a83b224502", "address": "fa:16:3e:06:ed:ab", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025bb037-5e", "ovs_interfaceid": "025bb037-5e0c-45f3-96c2-09a83b224502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "address": "fa:16:3e:1c:de:6d", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdfe9b78-37", "ovs_interfaceid": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "address": "fa:16:3e:67:28:cb", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa59cbf-ed", "ovs_interfaceid": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "address": "fa:16:3e:0d:77:c0", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8d3da0-55", "ovs_interfaceid": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "address": "fa:16:3e:f7:68:17", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86b5e91-07", "ovs_interfaceid": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0d50df31-0c5f-4d5a-8dca-84502eb293df req-f939b1e0-6299-4f75-b120-25c97efbdf3a service nova] Acquired lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG nova.network.neutron [req-0d50df31-0c5f-4d5a-8dca-84502eb293df req-f939b1e0-6299-4f75-b120-25c97efbdf3a service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Refreshing network info cache for port e86b5e91-071c-4b9e-80f0-7ce24ada55f5 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG nova.compute.manager [req-7a10c497-806f-4e97-9d2e-9ad552096ce5 req-951fb550-3f17-4a1b-a629-a956b36d5835 service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Received event network-vif-plugged-51bbddc6-885b-4d2e-a436-a08f1ee3a204 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7a10c497-806f-4e97-9d2e-9ad552096ce5 req-951fb550-3f17-4a1b-a629-a956b36d5835 service nova] Acquiring lock "7044ab36-115d-454b-a787-b3199a815d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7a10c497-806f-4e97-9d2e-9ad552096ce5 req-951fb550-3f17-4a1b-a629-a956b36d5835 service nova] Lock "7044ab36-115d-454b-a787-b3199a815d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7a10c497-806f-4e97-9d2e-9ad552096ce5 req-951fb550-3f17-4a1b-a629-a956b36d5835 service nova] Lock "7044ab36-115d-454b-a787-b3199a815d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG nova.compute.manager [req-7a10c497-806f-4e97-9d2e-9ad552096ce5 req-951fb550-3f17-4a1b-a629-a956b36d5835 service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] No waiting events found dispatching network-vif-plugged-51bbddc6-885b-4d2e-a436-a08f1ee3a204 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:30 user nova-compute[72874]: WARNING nova.compute.manager [req-7a10c497-806f-4e97-9d2e-9ad552096ce5 req-951fb550-3f17-4a1b-a629-a956b36d5835 service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Received unexpected event network-vif-plugged-51bbddc6-885b-4d2e-a436-a08f1ee3a204 for instance with vm_state building and task_state spawning.
Aug 17 18:23:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUptiyMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:23:30 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:23:30 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:23:30 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4450b47-3166-40ff-bd46-5e2a7c496def]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:23:30 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[40de7548-c09f-401b-bc1d-99b9e0c62990]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5] added
Aug 17 18:23:30 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5110ee-3c19-4e37-b1fb-78eeffdb5651]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc7d618-7aef-4e44-8190-16731194c13a]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUptiyMr {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUptiyMr" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0756185-44e8-4ffe-ad7c-201d57cf239a]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUptiyMr'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[835b17d3-ac90-48b8-8a04-9c3d79ecdda1]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2617eccf-f71a-44bb-821a-2d1d0b5778b1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:30 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:30 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG nova.network.neutron [req-0d50df31-0c5f-4d5a-8dca-84502eb293df req-f939b1e0-6299-4f75-b120-25c97efbdf3a service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Updated VIF entry in instance network info cache for port e86b5e91-071c-4b9e-80f0-7ce24ada55f5. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG nova.network.neutron [req-0d50df31-0c5f-4d5a-8dca-84502eb293df req-f939b1e0-6299-4f75-b120-25c97efbdf3a service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Updating instance_info_cache with network_info: [{"id": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "address": "fa:16:3e:c8:a8:2b", "network": {"id": "51ce5fe7-85ba-4c8a-9ba3-4b8823afea51", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-341654396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb19bfac-de", "ovs_interfaceid": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a06f651-218f-42e4-aee0-40e733d5a891", "address": "fa:16:3e:46:26:f0", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a06f651-21", "ovs_interfaceid": "2a06f651-218f-42e4-aee0-40e733d5a891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "025bb037-5e0c-45f3-96c2-09a83b224502", "address": "fa:16:3e:06:ed:ab", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025bb037-5e", "ovs_interfaceid": "025bb037-5e0c-45f3-96c2-09a83b224502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "address": "fa:16:3e:1c:de:6d", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdfe9b78-37", "ovs_interfaceid": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "address": "fa:16:3e:67:28:cb", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa59cbf-ed", "ovs_interfaceid": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "address": "fa:16:3e:0d:77:c0", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8d3da0-55", "ovs_interfaceid": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "address": "fa:16:3e:f7:68:17", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86b5e91-07", "ovs_interfaceid": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc5d6e4-e8ce-4229-b2aa-901517b46b03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5, portal: 172.16.0.220,3260]
Aug 17 18:23:30 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5, portal: 172.16.0.220,3260] successful.
Aug 17 18:23:30 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0d50df31-0c5f-4d5a-8dca-84502eb293df req-f939b1e0-6299-4f75-b120-25c97efbdf3a service nova] Releasing lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6993c7d5-8f1b-4d91-8039-00a1b5f7e43d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f44e38-0696-4b98-9675-d0bb4f8dcdef]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:30 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:30 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:30 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:30 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd333a80-db5b-40ea-bd81-0e217766bf26]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:30 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:23:31 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:23:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUptiyMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:23:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:23:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23439396661613137', 'path': '/dev/sdc'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:23:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439396661613137', 'path': '/dev/sdc'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:23:31 user nova-compute[72874]: DEBUG nova.objects.instance [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'flavor' on Instance uuid 857d43f7-6f53-4c82-9e68-fca3078e97ea {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:23:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:23:31 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:23:31 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:23:31 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:23:31 user nova-compute[72874]:   <serial>55359bd1-db03-480e-b33c-29e2c6decfb5</serial>
Aug 17 18:23:31 user nova-compute[72874]: </disk>
Aug 17 18:23:31 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296612.2797227, 7044ab36-115d-454b-a787-b3199a815d4e => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:23:32 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] VM Resumed (Lifecycle Event)
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:23:32 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Instance spawned successfully.
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:23:32 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296612.2805133, 7044ab36-115d-454b-a787-b3199a815d4e => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:23:32 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] VM Started (Lifecycle Event)
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.compute.manager [req-0c0091d8-cd20-4b52-8ad3-720e2a006122 req-30de061e-8946-44a3-8d96-c387383073d5 service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Received event network-vif-plugged-51bbddc6-885b-4d2e-a436-a08f1ee3a204 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0c0091d8-cd20-4b52-8ad3-720e2a006122 req-30de061e-8946-44a3-8d96-c387383073d5 service nova] Acquiring lock "7044ab36-115d-454b-a787-b3199a815d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0c0091d8-cd20-4b52-8ad3-720e2a006122 req-30de061e-8946-44a3-8d96-c387383073d5 service nova] Lock "7044ab36-115d-454b-a787-b3199a815d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0c0091d8-cd20-4b52-8ad3-720e2a006122 req-30de061e-8946-44a3-8d96-c387383073d5 service nova] Lock "7044ab36-115d-454b-a787-b3199a815d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.compute.manager [req-0c0091d8-cd20-4b52-8ad3-720e2a006122 req-30de061e-8946-44a3-8d96-c387383073d5 service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] No waiting events found dispatching network-vif-plugged-51bbddc6-885b-4d2e-a436-a08f1ee3a204 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:32 user nova-compute[72874]: WARNING nova.compute.manager [req-0c0091d8-cd20-4b52-8ad3-720e2a006122 req-30de061e-8946-44a3-8d96-c387383073d5 service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Received unexpected event network-vif-plugged-51bbddc6-885b-4d2e-a436-a08f1ee3a204 for instance with vm_state building and task_state spawning.
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] No VIF found with MAC fa:16:3e:85:9f:87, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:23:32 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:23:32 user nova-compute[72874]: INFO nova.compute.manager [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Took 8.44 seconds to spawn the instance on the hypervisor.
Aug 17 18:23:32 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:23:32 user nova-compute[72874]: INFO nova.compute.manager [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Took 9.22 seconds to build instance.
Aug 17 18:23:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-323aebce-9666-4525-ac99-4e88a83ce057 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.569s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e9410af-a4d0-4d5a-a150-4b2c93eea073 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "7044ab36-115d-454b-a787-b3199a815d4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.323s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:34 user nova-compute[72874]: INFO nova.virt.block_device [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Booting with volume 121f656c-b13e-49e9-923f-4929ec5b7bfb at /dev/vdc
Aug 17 18:23:34 user nova-compute[72874]: DEBUG os_brick.utils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:23:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[490da87e-d8a4-41ea-a918-d8a12217418e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5333ff-661d-4c30-9977-1481456d4671]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05d49d7-54ce-4135-a852-812c6185c990]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e9a78d-be3e-46d8-af25-5a9b5e92375d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:23:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:23:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:23:35 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:23:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c9a862-7161-4d7f-9792-54eb58ecd596]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:23:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:23:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:23:35 user nova-compute[72874]: DEBUG os_brick.utils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:23:35 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Updating existing volume attachment record: 3022b024-4d09-480f-8dc7-c7b4d1724568 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:23:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "2ee31c9c-6630-4a20-b986-e041951a8522" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "2ee31c9c-6630-4a20-b986-e041951a8522" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:23:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:36 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:23:36 user nova-compute[72874]: INFO nova.compute.claims [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Claim successful on node user
Aug 17 18:23:36 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:23:36 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:23:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG nova.network.neutron [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:23:37 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:23:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG nova.policy [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37eba99d36a842ca93af2d82be67dea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d44ed4bf46e4f6bb8d9f9255bfceded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:23:37 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Creating image(s)
Aug 17 18:23:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "/opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "/opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.228s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk 1073741824" returned: 0 in 0.056s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.184s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:37 user nova-compute[72874]: DEBUG nova.network.neutron [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Successfully created port: beda2544-577f-4426-9393-9dccda2812fc {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:23:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:38 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Cannot resize image /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:23:38 user nova-compute[72874]: DEBUG nova.objects.instance [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'migration_context' on Instance uuid 2ee31c9c-6630-4a20-b986-e041951a8522 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:23:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:23:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Ensure instance console log exists: /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:23:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:38 user nova-compute[72874]: DEBUG nova.network.neutron [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Successfully updated port: beda2544-577f-4426-9393-9dccda2812fc {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:23:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "refresh_cache-2ee31c9c-6630-4a20-b986-e041951a8522" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:23:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquired lock "refresh_cache-2ee31c9c-6630-4a20-b986-e041951a8522" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:23:38 user nova-compute[72874]: DEBUG nova.network.neutron [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-24017ced-3de7-4e97-a07f-e7ffeb707751 req-a1e247de-b450-425b-9a3d-d6d03fd15100 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Received event network-changed-beda2544-577f-4426-9393-9dccda2812fc {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-24017ced-3de7-4e97-a07f-e7ffeb707751 req-a1e247de-b450-425b-9a3d-d6d03fd15100 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Refreshing instance network info cache due to event network-changed-beda2544-577f-4426-9393-9dccda2812fc. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-24017ced-3de7-4e97-a07f-e7ffeb707751 req-a1e247de-b450-425b-9a3d-d6d03fd15100 service nova] Acquiring lock "refresh_cache-2ee31c9c-6630-4a20-b986-e041951a8522" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.network.neutron [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.network.neutron [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Updating instance_info_cache with network_info: [{"id": "beda2544-577f-4426-9393-9dccda2812fc", "address": "fa:16:3e:fa:38:d3", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeda2544-57", "ovs_interfaceid": "beda2544-577f-4426-9393-9dccda2812fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Releasing lock "refresh_cache-2ee31c9c-6630-4a20-b986-e041951a8522" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Instance network_info: |[{"id": "beda2544-577f-4426-9393-9dccda2812fc", "address": "fa:16:3e:fa:38:d3", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeda2544-57", "ovs_interfaceid": "beda2544-577f-4426-9393-9dccda2812fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-24017ced-3de7-4e97-a07f-e7ffeb707751 req-a1e247de-b450-425b-9a3d-d6d03fd15100 service nova] Acquired lock "refresh_cache-2ee31c9c-6630-4a20-b986-e041951a8522" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.network.neutron [req-24017ced-3de7-4e97-a07f-e7ffeb707751 req-a1e247de-b450-425b-9a3d-d6d03fd15100 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Refreshing network info cache for port beda2544-577f-4426-9393-9dccda2812fc {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Start _get_guest_xml network_info=[{"id": "beda2544-577f-4426-9393-9dccda2812fc", "address": "fa:16:3e:fa:38:d3", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeda2544-57", "ovs_interfaceid": "beda2544-577f-4426-9393-9dccda2812fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:23:39 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:23:39 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:23:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1707464321',display_name='tempest-AttachVolumeNegativeTest-server-1707464321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1707464321',id=20,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ/B7PBGROD8GDVWnTOKYFa2ugUYgKiBxlcmmbyOjQ1z5mkIkLZlE64mFT44HITrfGAnsJxScuDyqbu8a3arGzNcs71mLEZHQoqWyUM7Kqan9Xc9LmWoVUbl1ZGf7rWIQ==',key_name='tempest-keypair-1462900200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d44ed4bf46e4f6bb8d9f9255bfceded',ramdisk_id='',reservation_id='r-oiyhb50y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1092460488',owner_user_name='tempest-AttachVolumeNegativeTest-1092460488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eba99d36a842ca93af2d82be67dea1',uuid=2ee31c9c-6630-4a20-b986-e041951a8522,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "beda2544-577f-4426-9393-9dccda2812fc", "address": "fa:16:3e:fa:38:d3", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeda2544-57", "ovs_interfaceid": "beda2544-577f-4426-9393-9dccda2812fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converting VIF {"id": "beda2544-577f-4426-9393-9dccda2812fc", "address": "fa:16:3e:fa:38:d3", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeda2544-57", "ovs_interfaceid": "beda2544-577f-4426-9393-9dccda2812fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:38:d3,bridge_name='br-int',has_traffic_filtering=True,id=beda2544-577f-4426-9393-9dccda2812fc,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeda2544-57') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.objects.instance [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ee31c9c-6630-4a20-b986-e041951a8522 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:23:39 user nova-compute[72874]:   <uuid>2ee31c9c-6630-4a20-b986-e041951a8522</uuid>
Aug 17 18:23:39 user nova-compute[72874]:   <name>instance-00000014</name>
Aug 17 18:23:39 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:23:39 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:23:39 user nova-compute[72874]:   <metadata>
Aug 17 18:23:39 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:23:39 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:23:39 user nova-compute[72874]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1707464321</nova:name>
Aug 17 18:23:39 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:23:39</nova:creationTime>
Aug 17 18:23:39 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:23:39 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:23:39 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:23:39 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:23:39 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:23:39 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:23:39 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:23:39 user nova-compute[72874]:       <nova:owner>
Aug 17 18:23:39 user nova-compute[72874]:         <nova:user uuid="37eba99d36a842ca93af2d82be67dea1">tempest-AttachVolumeNegativeTest-1092460488-project-member</nova:user>
Aug 17 18:23:39 user nova-compute[72874]:         <nova:project uuid="9d44ed4bf46e4f6bb8d9f9255bfceded">tempest-AttachVolumeNegativeTest-1092460488</nova:project>
Aug 17 18:23:39 user nova-compute[72874]:       </nova:owner>
Aug 17 18:23:39 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:23:39 user nova-compute[72874]:       <nova:ports>
Aug 17 18:23:39 user nova-compute[72874]:         <nova:port uuid="beda2544-577f-4426-9393-9dccda2812fc">
Aug 17 18:23:39 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 18:23:39 user nova-compute[72874]:         </nova:port>
Aug 17 18:23:39 user nova-compute[72874]:       </nova:ports>
Aug 17 18:23:39 user nova-compute[72874]:     </nova:instance>
Aug 17 18:23:39 user nova-compute[72874]:   </metadata>
Aug 17 18:23:39 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:23:39 user nova-compute[72874]:     <system>
Aug 17 18:23:39 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:23:39 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:23:39 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:23:39 user nova-compute[72874]:       <entry name="serial">2ee31c9c-6630-4a20-b986-e041951a8522</entry>
Aug 17 18:23:39 user nova-compute[72874]:       <entry name="uuid">2ee31c9c-6630-4a20-b986-e041951a8522</entry>
Aug 17 18:23:39 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:23:39 user nova-compute[72874]:     </system>
Aug 17 18:23:39 user nova-compute[72874]:   </sysinfo>
Aug 17 18:23:39 user nova-compute[72874]:   <os>
Aug 17 18:23:39 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:23:39 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:23:39 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:23:39 user nova-compute[72874]:   </os>
Aug 17 18:23:39 user nova-compute[72874]:   <features>
Aug 17 18:23:39 user nova-compute[72874]:     <acpi/>
Aug 17 18:23:39 user nova-compute[72874]:     <apic/>
Aug 17 18:23:39 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:23:39 user nova-compute[72874]:   </features>
Aug 17 18:23:39 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:23:39 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:23:39 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:23:39 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:23:39 user nova-compute[72874]:   </clock>
Aug 17 18:23:39 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:23:39 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:23:39 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:23:39 user nova-compute[72874]:   </cpu>
Aug 17 18:23:39 user nova-compute[72874]:   <devices>
Aug 17 18:23:39 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:23:39 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:23:39 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk"/>
Aug 17 18:23:39 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:23:39 user nova-compute[72874]:     </disk>
Aug 17 18:23:39 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:23:39 user nova-compute[72874]:       <mac address="fa:16:3e:fa:38:d3"/>
Aug 17 18:23:39 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:23:39 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:23:39 user nova-compute[72874]:       <target dev="tapbeda2544-57"/>
Aug 17 18:23:39 user nova-compute[72874]:     </interface>
Aug 17 18:23:39 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:23:39 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/console.log" append="off"/>
Aug 17 18:23:39 user nova-compute[72874]:     </serial>
Aug 17 18:23:39 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:23:39 user nova-compute[72874]:     <video>
Aug 17 18:23:39 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:23:39 user nova-compute[72874]:     </video>
Aug 17 18:23:39 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:23:39 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:23:39 user nova-compute[72874]:     </rng>
Aug 17 18:23:39 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:23:39 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:23:39 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:23:39 user nova-compute[72874]:     </memballoon>
Aug 17 18:23:39 user nova-compute[72874]:   </devices>
Aug 17 18:23:39 user nova-compute[72874]: </domain>
Aug 17 18:23:39 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:23:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1707464321',display_name='tempest-AttachVolumeNegativeTest-server-1707464321',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1707464321',id=20,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ/B7PBGROD8GDVWnTOKYFa2ugUYgKiBxlcmmbyOjQ1z5mkIkLZlE64mFT44HITrfGAnsJxScuDyqbu8a3arGzNcs71mLEZHQoqWyUM7Kqan9Xc9LmWoVUbl1ZGf7rWIQ==',key_name='tempest-keypair-1462900200',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d44ed4bf46e4f6bb8d9f9255bfceded',ramdisk_id='',reservation_id='r-oiyhb50y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1092460488',owner_user_name='tempest-AttachVolumeNegativeTest-1092460488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eba99d36a842ca93af2d82be67dea1',uuid=2ee31c9c-6630-4a20-b986-e041951a8522,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "beda2544-577f-4426-9393-9dccda2812fc", "address": "fa:16:3e:fa:38:d3", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeda2544-57", "ovs_interfaceid": "beda2544-577f-4426-9393-9dccda2812fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converting VIF {"id": "beda2544-577f-4426-9393-9dccda2812fc", "address": "fa:16:3e:fa:38:d3", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeda2544-57", "ovs_interfaceid": "beda2544-577f-4426-9393-9dccda2812fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:38:d3,bridge_name='br-int',has_traffic_filtering=True,id=beda2544-577f-4426-9393-9dccda2812fc,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeda2544-57') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG os_vif [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:38:d3,bridge_name='br-int',has_traffic_filtering=True,id=beda2544-577f-4426-9393-9dccda2812fc,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeda2544-57') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbeda2544-57, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbeda2544-57, col_values=(('external_ids', {'iface-id': 'beda2544-577f-4426-9393-9dccda2812fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:38:d3', 'vm-uuid': '2ee31c9c-6630-4a20-b986-e041951a8522'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:39 user nova-compute[72874]: INFO os_vif [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:38:d3,bridge_name='br-int',has_traffic_filtering=True,id=beda2544-577f-4426-9393-9dccda2812fc,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeda2544-57')
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] No VIF found with MAC fa:16:3e:fa:38:d3, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.network.neutron [req-24017ced-3de7-4e97-a07f-e7ffeb707751 req-a1e247de-b450-425b-9a3d-d6d03fd15100 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Updated VIF entry in instance network info cache for port beda2544-577f-4426-9393-9dccda2812fc. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG nova.network.neutron [req-24017ced-3de7-4e97-a07f-e7ffeb707751 req-a1e247de-b450-425b-9a3d-d6d03fd15100 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Updating instance_info_cache with network_info: [{"id": "beda2544-577f-4426-9393-9dccda2812fc", "address": "fa:16:3e:fa:38:d3", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeda2544-57", "ovs_interfaceid": "beda2544-577f-4426-9393-9dccda2812fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-24017ced-3de7-4e97-a07f-e7ffeb707751 req-a1e247de-b450-425b-9a3d-d6d03fd15100 service nova] Releasing lock "refresh_cache-2ee31c9c-6630-4a20-b986-e041951a8522" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:23:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "f027045c-d121-45ec-af61-e1a2399c4a43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:40 user nova-compute[72874]: INFO nova.compute.manager [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Terminating instance
Aug 17 18:23:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG nova.objects.instance [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lazy-loading 'flavor' on Instance uuid 2ace97e1-c2ee-462e-a929-22c7cb2584d2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG nova.compute.manager [req-fcd14581-dbc6-4148-b430-849339fb44ed req-c988287b-d474-43cd-94ff-473072638a29 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-unplugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fcd14581-dbc6-4148-b430-849339fb44ed req-c988287b-d474-43cd-94ff-473072638a29 service nova] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fcd14581-dbc6-4148-b430-849339fb44ed req-c988287b-d474-43cd-94ff-473072638a29 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fcd14581-dbc6-4148-b430-849339fb44ed req-c988287b-d474-43cd-94ff-473072638a29 service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG nova.compute.manager [req-fcd14581-dbc6-4148-b430-849339fb44ed req-c988287b-d474-43cd-94ff-473072638a29 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] No waiting events found dispatching network-vif-unplugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG nova.compute.manager [req-fcd14581-dbc6-4148-b430-849339fb44ed req-c988287b-d474-43cd-94ff-473072638a29 service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-unplugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:41 user nova-compute[72874]: INFO nova.compute.manager [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Attaching volume 19c92b6f-990a-4e2a-97df-5bb870e61913 to /dev/vdb
Aug 17 18:23:41 user nova-compute[72874]: DEBUG os_brick.utils [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48c2318-f4f5-4622-8305-6fc4da5aeee5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0931fc83-2b0c-469b-abcb-c92434311445]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb0814d-be52-4d87-a1e0-456b83c8ecb9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca82eaf-e874-4f2d-b54d-765f03f6e211]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:23:41 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb50817-b62f-4ad2-9175-ef8de0baedcf]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG os_brick.utils [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updating existing volume attachment record: 2257213e-0b4f-4f38-831c-42e8c5e89ecf {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:23:41 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Instance destroyed successfully.
Aug 17 18:23:41 user nova-compute[72874]: DEBUG nova.objects.instance [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lazy-loading 'resources' on Instance uuid f027045c-d121-45ec-af61-e1a2399c4a43 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1822661416',display_name='tempest-ServerStableDeviceRescueTest-server-1822661416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1822661416',id=3,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCOelasHdGoL+Cq5kCerVY3gWowEdYqles28HBqmjG9V1QMXJ5MTrhbBjfmX+uWP1TCA19y7eC/lFWOzs/7uQdIP7uyNX9gKjvHQlPelnMJ6yDDVVohaqn7Usr0KYj2/rw==',key_name='tempest-keypair-1229666427',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:20:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='010744e63b35476d85e61945c50dc586',ramdisk_id='',reservation_id='r-ie3dxk98',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1978576596',owner_user_name='tempest-ServerStableDeviceRescueTest-1978576596-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:22:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f824595c9ce4775bc021075a7eb7047',uuid=f027045c-d121-45ec-af61-e1a2399c4a43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Converting VIF {"id": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "address": "fa:16:3e:50:ac:00", "network": {"id": "6d517d31-387e-4eff-a4ec-a4d9b046ff16", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-679530161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.110", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "010744e63b35476d85e61945c50dc586", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3598a27-6f", "ovs_interfaceid": "b3598a27-6f66-4999-8ed8-835ffb3d6cae", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:ac:00,bridge_name='br-int',has_traffic_filtering=True,id=b3598a27-6f66-4999-8ed8-835ffb3d6cae,network=Network(6d517d31-387e-4eff-a4ec-a4d9b046ff16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3598a27-6f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG os_vif [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:ac:00,bridge_name='br-int',has_traffic_filtering=True,id=b3598a27-6f66-4999-8ed8-835ffb3d6cae,network=Network(6d517d31-387e-4eff-a4ec-a4d9b046ff16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3598a27-6f') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3598a27-6f, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:23:41 user nova-compute[72874]: INFO os_vif [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:ac:00,bridge_name='br-int',has_traffic_filtering=True,id=b3598a27-6f66-4999-8ed8-835ffb3d6cae,network=Network(6d517d31-387e-4eff-a4ec-a4d9b046ff16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3598a27-6f')
Aug 17 18:23:41 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Deleting instance files /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43_del
Aug 17 18:23:41 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Deletion of /opt/stack/data/nova/instances/f027045c-d121-45ec-af61-e1a2399c4a43_del complete
Aug 17 18:23:41 user nova-compute[72874]: INFO nova.compute.manager [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Took 1.43 seconds to destroy the instance on the hypervisor.
Aug 17 18:23:41 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:23:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:42 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:42 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Took 1.11 seconds to deallocate network for instance.
Aug 17 18:23:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] Acquiring lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] Lock "f027045c-d121-45ec-af61-e1a2399c4a43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] No waiting events found dispatching network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:42 user nova-compute[72874]: WARNING nova.compute.manager [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received unexpected event network-vif-plugged-b3598a27-6f66-4999-8ed8-835ffb3d6cae for instance with vm_state active and task_state deleting.
Aug 17 18:23:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Received event network-vif-plugged-beda2544-577f-4426-9393-9dccda2812fc {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] Acquiring lock "2ee31c9c-6630-4a20-b986-e041951a8522-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] Lock "2ee31c9c-6630-4a20-b986-e041951a8522-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] Lock "2ee31c9c-6630-4a20-b986-e041951a8522-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] No waiting events found dispatching network-vif-plugged-beda2544-577f-4426-9393-9dccda2812fc {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:42 user nova-compute[72874]: WARNING nova.compute.manager [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Received unexpected event network-vif-plugged-beda2544-577f-4426-9393-9dccda2812fc for instance with vm_state building and task_state spawning.
Aug 17 18:23:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Received event network-vif-plugged-beda2544-577f-4426-9393-9dccda2812fc {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] Acquiring lock "2ee31c9c-6630-4a20-b986-e041951a8522-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] Lock "2ee31c9c-6630-4a20-b986-e041951a8522-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] Lock "2ee31c9c-6630-4a20-b986-e041951a8522-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] No waiting events found dispatching network-vif-plugged-beda2544-577f-4426-9393-9dccda2812fc {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:42 user nova-compute[72874]: WARNING nova.compute.manager [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Received unexpected event network-vif-plugged-beda2544-577f-4426-9393-9dccda2812fc for instance with vm_state building and task_state spawning.
Aug 17 18:23:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-29854be3-5fec-4c32-b372-c9b60304708a req-0a655b31-0c2f-4570-89b5-990cc8bae28d service nova] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Received event network-vif-deleted-b3598a27-6f66-4999-8ed8-835ffb3d6cae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:23:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:43 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Deleted allocations for instance f027045c-d121-45ec-af61-e1a2399c4a43
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296623.4727612, 2ee31c9c-6630-4a20-b986-e041951a8522 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:23:43 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] VM Resumed (Lifecycle Event)
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.compute.manager [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:23:43 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Instance spawned successfully.
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:23:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f4ebec89-f811-421d-9aff-53a5e0ed292f tempest-ServerStableDeviceRescueTest-1978576596 tempest-ServerStableDeviceRescueTest-1978576596-project-member] Lock "f027045c-d121-45ec-af61-e1a2399c4a43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.210s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:23:43 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296623.4879072, 2ee31c9c-6630-4a20-b986-e041951a8522 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:23:43 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] VM Started (Lifecycle Event)
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:23:43 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:23:43 user nova-compute[72874]: INFO nova.compute.manager [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Took 6.45 seconds to spawn the instance on the hypervisor.
Aug 17 18:23:43 user nova-compute[72874]: DEBUG nova.compute.manager [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:23:43 user nova-compute[72874]: INFO nova.compute.manager [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Took 7.33 seconds to build instance.
Aug 17 18:23:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1c2055ca-a61c-4d8f-b9eb-f0674a6a933d tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "2ee31c9c-6630-4a20-b986-e041951a8522" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.439s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "cf9f3116-5e42-4858-a391-ab75d2046f1a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:23:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:45 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:23:45 user nova-compute[72874]: INFO nova.compute.claims [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Claim successful on node user
Aug 17 18:23:45 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:23:45 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:23:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:23:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:23:45 user nova-compute[72874]: DEBUG nova.network.neutron [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:23:45 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:23:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG nova.policy [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01b47defaba840e1ba8f91603d99caac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c20349a873f4ec7a0f72a7d64c636e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:23:46 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Creating image(s)
Aug 17 18:23:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "/opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "/opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.234s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.206s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk 1073741824" returned: 0 in 0.059s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.205s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:23:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Cannot resize image /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.objects.instance [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'migration_context' on Instance uuid cf9f3116-5e42-4858-a391-ab75d2046f1a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Ensure instance console log exists: /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.network.neutron [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Successfully created port: dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:23:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Creating image(s)
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Ensure instance console log exists: /opt/stack/data/nova/instances/8c998fa1-9430-4f03-bae7-ce510509a9be/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Start _get_guest_xml network_info=[{"id": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "address": "fa:16:3e:c8:a8:2b", "network": {"id": "51ce5fe7-85ba-4c8a-9ba3-4b8823afea51", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-341654396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb19bfac-de", "ovs_interfaceid": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a06f651-218f-42e4-aee0-40e733d5a891", "address": "fa:16:3e:46:26:f0", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a06f651-21", "ovs_interfaceid": "2a06f651-218f-42e4-aee0-40e733d5a891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "025bb037-5e0c-45f3-96c2-09a83b224502", "address": "fa:16:3e:06:ed:ab", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025bb037-5e", "ovs_interfaceid": "025bb037-5e0c-45f3-96c2-09a83b224502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "address": "fa:16:3e:1c:de:6d", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdfe9b78-37", "ovs_interfaceid": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "address": "fa:16:3e:67:28:cb", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa59cbf-ed", "ovs_interfaceid": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "address": "fa:16:3e:0d:77:c0", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8d3da0-55", "ovs_interfaceid": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "address": "fa:16:3e:f7:68:17", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86b5e91-07", "ovs_interfaceid": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqKPEulp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c998fa1-9430-4f03-bae7-ce510509a9be', 'attached_at': '', 'detached_at': '', 'volume_id': 'c8aa08fb-a17c-45fc-88f3-f1ec606dcc61', 'serial': 'c8aa08fb-a17c-45fc-88f3-f1ec606dcc61'}, 'delete_on_termination': False, 'attachment_id': '4c9a83f0-0426-4052-899e-2a71a8c76244', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqEYtgHK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c998fa1-9430-4f03-bae7-ce510509a9be', 'attached_at': '', 'detached_at': '', 'volume_id': '8e77b595-57f6-40df-85ef-c933cf5a1b53', 'serial': '8e77b595-57f6-40df-85ef-c933cf5a1b53'}, 'delete_on_termination': False, 'attachment_id': '57b8eff9-ffe8-4b24-99e4-8c3ccf13492b', 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}, {'device_type': 'disk', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFoTiUVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c998fa1-9430-4f03-bae7-ce510509a9be', 'attached_at': '', 'detached_at': '', 'volume_id': '121f656c-b13e-49e9-923f-4929ec5b7bfb', 'serial': '121f656c-b13e-49e9-923f-4929ec5b7bfb'}, 'delete_on_termination': False, 'attachment_id': '3022b024-4d09-480f-8dc7-c7b4d1724568', 'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:23:47 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:23:47 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqKPEulp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:23:47 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:23:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:23:47 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:23:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:23:47 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a892be-1f21-4ee6-baa4-b8a0c34d2500]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:23:47 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[304f8bda-6f05-4e30-9fa4-6b1f36f80300]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61] added
Aug 17 18:23:47 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b1ba61-08ef-4c19-ae82-57e72f8dd228]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bbb78f-10f2-49e1-a0d5-9ce0601dd16d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqKPEulp {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DqKPEulp" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[358eb1b5-d920-4e5b-8c2a-ddae6a7a2caf]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DqKPEulp'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[64603d2a-218c-4220-bfc6-a6898c34d637]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6e1303-6207-4e91-a8a5-4e2f4479a3a9]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:47 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:47 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:47 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:47 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8e429b-dcda-4642-afd9-377407f1cab0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61, portal: 172.16.0.220,3260]
Aug 17 18:23:47 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61, portal: 172.16.0.220,3260] successful.
Aug 17 18:23:47 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a55df96-b824-40eb-947e-5fc1c2298d0b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c352847f-1863-435f-9502-551eb4acb5e0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:48 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:48 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:23:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:48 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:48 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:23:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[55684c45-bfb7-4045-84ee-586760bfd02f]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqKPEulp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.network.neutron [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Successfully updated port: dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquired lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.network.neutron [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-eaf7b1ec-4e27-4b91-b41c-879c67752ce1 req-f20890f4-149d-4eeb-a707-a63c308c667c service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received event network-changed-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-eaf7b1ec-4e27-4b91-b41c-879c67752ce1 req-f20890f4-149d-4eeb-a707-a63c308c667c service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Refreshing instance network info cache due to event network-changed-dbb991ed-781f-4666-a0b6-c360ab742952. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eaf7b1ec-4e27-4b91-b41c-879c67752ce1 req-f20890f4-149d-4eeb-a707-a63c308c667c service nova] Acquiring lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.network.neutron [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.network.neutron [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Updating instance_info_cache with network_info: [{"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Releasing lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Instance network_info: |[{"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eaf7b1ec-4e27-4b91-b41c-879c67752ce1 req-f20890f4-149d-4eeb-a707-a63c308c667c service nova] Acquired lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-eaf7b1ec-4e27-4b91-b41c-879c67752ce1 req-f20890f4-149d-4eeb-a707-a63c308c667c service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Refreshing network info cache for port dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Start _get_guest_xml network_info=[{"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:23:48 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:23:48 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:23:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-256691474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-256691474',id=21,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRZJI30JvBIOo78Nc4E/vQZ4222PUz6M4VnJyBsVc8RG8pkgZHWCI+wS7Li89ZXnfRpzACIFODv16pw4feyE8jOEDhaILAHNfE95Q4vLeIyPLALwu/lIVovS9PV5DR+JQ==',key_name='tempest-keypair-1928119168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c20349a873f4ec7a0f72a7d64c636e4',ramdisk_id='',reservation_id='r-ju6xb3sz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1376162523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1376162523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b47defaba840e1ba8f91603d99caac',uuid=cf9f3116-5e42-4858-a391-ab75d2046f1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converting VIF {"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cd:60,bridge_name='br-int',has_traffic_filtering=True,id=dbb991ed-781f-4666-a0b6-c360ab742952,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb991ed-78') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.objects.instance [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'pci_devices' on Instance uuid cf9f3116-5e42-4858-a391-ab75d2046f1a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:23:48 user nova-compute[72874]:   <uuid>cf9f3116-5e42-4858-a391-ab75d2046f1a</uuid>
Aug 17 18:23:48 user nova-compute[72874]:   <name>instance-00000015</name>
Aug 17 18:23:48 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:23:48 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:23:48 user nova-compute[72874]:   <metadata>
Aug 17 18:23:48 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:23:48 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:23:48 user nova-compute[72874]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-256691474</nova:name>
Aug 17 18:23:48 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:23:48</nova:creationTime>
Aug 17 18:23:48 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:23:48 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:23:48 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:23:48 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:23:48 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:23:48 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:23:48 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:23:48 user nova-compute[72874]:       <nova:owner>
Aug 17 18:23:48 user nova-compute[72874]:         <nova:user uuid="01b47defaba840e1ba8f91603d99caac">tempest-AttachVolumeShelveTestJSON-1376162523-project-member</nova:user>
Aug 17 18:23:48 user nova-compute[72874]:         <nova:project uuid="5c20349a873f4ec7a0f72a7d64c636e4">tempest-AttachVolumeShelveTestJSON-1376162523</nova:project>
Aug 17 18:23:48 user nova-compute[72874]:       </nova:owner>
Aug 17 18:23:48 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:23:48 user nova-compute[72874]:       <nova:ports>
Aug 17 18:23:48 user nova-compute[72874]:         <nova:port uuid="dbb991ed-781f-4666-a0b6-c360ab742952">
Aug 17 18:23:48 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 18:23:48 user nova-compute[72874]:         </nova:port>
Aug 17 18:23:48 user nova-compute[72874]:       </nova:ports>
Aug 17 18:23:48 user nova-compute[72874]:     </nova:instance>
Aug 17 18:23:48 user nova-compute[72874]:   </metadata>
Aug 17 18:23:48 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:23:48 user nova-compute[72874]:     <system>
Aug 17 18:23:48 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:23:48 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:23:48 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:23:48 user nova-compute[72874]:       <entry name="serial">cf9f3116-5e42-4858-a391-ab75d2046f1a</entry>
Aug 17 18:23:48 user nova-compute[72874]:       <entry name="uuid">cf9f3116-5e42-4858-a391-ab75d2046f1a</entry>
Aug 17 18:23:48 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:23:48 user nova-compute[72874]:     </system>
Aug 17 18:23:48 user nova-compute[72874]:   </sysinfo>
Aug 17 18:23:48 user nova-compute[72874]:   <os>
Aug 17 18:23:48 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:23:48 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:23:48 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:23:48 user nova-compute[72874]:   </os>
Aug 17 18:23:48 user nova-compute[72874]:   <features>
Aug 17 18:23:48 user nova-compute[72874]:     <acpi/>
Aug 17 18:23:48 user nova-compute[72874]:     <apic/>
Aug 17 18:23:48 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:23:48 user nova-compute[72874]:   </features>
Aug 17 18:23:48 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:23:48 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:23:48 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:23:48 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:23:48 user nova-compute[72874]:   </clock>
Aug 17 18:23:48 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:23:48 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:23:48 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:23:48 user nova-compute[72874]:   </cpu>
Aug 17 18:23:48 user nova-compute[72874]:   <devices>
Aug 17 18:23:48 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:23:48 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:23:48 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk"/>
Aug 17 18:23:48 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:23:48 user nova-compute[72874]:     </disk>
Aug 17 18:23:48 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:23:48 user nova-compute[72874]:       <mac address="fa:16:3e:ac:cd:60"/>
Aug 17 18:23:48 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:23:48 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:23:48 user nova-compute[72874]:       <target dev="tapdbb991ed-78"/>
Aug 17 18:23:48 user nova-compute[72874]:     </interface>
Aug 17 18:23:48 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:23:48 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/console.log" append="off"/>
Aug 17 18:23:48 user nova-compute[72874]:     </serial>
Aug 17 18:23:48 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:23:48 user nova-compute[72874]:     <video>
Aug 17 18:23:48 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:23:48 user nova-compute[72874]:     </video>
Aug 17 18:23:48 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:23:48 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:23:48 user nova-compute[72874]:     </rng>
Aug 17 18:23:48 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:23:48 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:23:48 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:23:48 user nova-compute[72874]:     </memballoon>
Aug 17 18:23:48 user nova-compute[72874]:   </devices>
Aug 17 18:23:48 user nova-compute[72874]: </domain>
Aug 17 18:23:48 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:23:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-256691474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-256691474',id=21,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRZJI30JvBIOo78Nc4E/vQZ4222PUz6M4VnJyBsVc8RG8pkgZHWCI+wS7Li89ZXnfRpzACIFODv16pw4feyE8jOEDhaILAHNfE95Q4vLeIyPLALwu/lIVovS9PV5DR+JQ==',key_name='tempest-keypair-1928119168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c20349a873f4ec7a0f72a7d64c636e4',ramdisk_id='',reservation_id='r-ju6xb3sz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1376162523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1376162523-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b47defaba840e1ba8f91603d99caac',uuid=cf9f3116-5e42-4858-a391-ab75d2046f1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converting VIF {"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cd:60,bridge_name='br-int',has_traffic_filtering=True,id=dbb991ed-781f-4666-a0b6-c360ab742952,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb991ed-78') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG os_vif [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cd:60,bridge_name='br-int',has_traffic_filtering=True,id=dbb991ed-781f-4666-a0b6-c360ab742952,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb991ed-78') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbb991ed-78, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbb991ed-78, col_values=(('external_ids', {'iface-id': 'dbb991ed-781f-4666-a0b6-c360ab742952', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:cd:60', 'vm-uuid': 'cf9f3116-5e42-4858-a391-ab75d2046f1a'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:48 user nova-compute[72874]: INFO os_vif [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cd:60,bridge_name='br-int',has_traffic_filtering=True,id=dbb991ed-781f-4666-a0b6-c360ab742952,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb991ed-78')
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:23:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] No VIF found with MAC fa:16:3e:ac:cd:60, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG nova.network.neutron [req-eaf7b1ec-4e27-4b91-b41c-879c67752ce1 req-f20890f4-149d-4eeb-a707-a63c308c667c service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Updated VIF entry in instance network info cache for port dbb991ed-781f-4666-a0b6-c360ab742952. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG nova.network.neutron [req-eaf7b1ec-4e27-4b91-b41c-879c67752ce1 req-f20890f4-149d-4eeb-a707-a63c308c667c service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Updating instance_info_cache with network_info: [{"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eaf7b1ec-4e27-4b91-b41c-879c67752ce1 req-f20890f4-149d-4eeb-a707-a63c308c667c service nova] Releasing lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23332306462306363', 'path': '/dev/sdd'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332306462306363', 'path': '/dev/sdd'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqEYtgHK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:23:49 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:23:49 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:23:49 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[82320331-8a83-480c-b89b-4dc90adf513e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:23:49 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[911e4ffd-64fb-48f3-9a14-770ed8ca0e09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53] added
Aug 17 18:23:49 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e684fa77-3f6d-437a-9011-ea69adde686a]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4bc54a-e2bf-4139-8b33-6796da0fafa4]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqEYtgHK {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oqEYtgHK" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b10f48-a72d-4361-8696-1c89bb661858]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oqEYtgHK'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d007a2b4-01f1-47f4-b8cd-1988f27ef261]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d772202b-6148-4583-886e-ef2bb87c61cc]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:49 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:49 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:23:49 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:49 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:49 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:23:49 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eddb52-f842-4713-8e44-4a75de56c9a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53, portal: 172.16.0.220,3260]
Aug 17 18:23:49 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53, portal: 172.16.0.220,3260] successful.
Aug 17 18:23:49 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab01ed9f-85bf-40a1-8928-ecde091d34f6]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1cb5f7-2700-4bc3-bdac-6928dc5d306f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:49 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:49 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:23:49 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:23:49 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:49 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:49 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:23:49 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:23:49 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] HCTL ('36', '-', '-', 0) found on session 24 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e3be07-c3d2-4f13-9ab9-f97aa935039d]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Searching for a device in session 24 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqEYtgHK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:23:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23538356638396161', 'path': '/dev/sde'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538356638396161', 'path': '/dev/sde'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFoTiUVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:23:50 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:23:50 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:23:50 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-e3ae5ead-18f8-4ae0-b628-1ee407bd693a req-ba1d36a4-e74a-4aff-953a-bd8779682f45 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received event network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e3ae5ead-18f8-4ae0-b628-1ee407bd693a req-ba1d36a4-e74a-4aff-953a-bd8779682f45 service nova] Acquiring lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e3ae5ead-18f8-4ae0-b628-1ee407bd693a req-ba1d36a4-e74a-4aff-953a-bd8779682f45 service nova] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e3ae5ead-18f8-4ae0-b628-1ee407bd693a req-ba1d36a4-e74a-4aff-953a-bd8779682f45 service nova] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-e3ae5ead-18f8-4ae0-b628-1ee407bd693a req-ba1d36a4-e74a-4aff-953a-bd8779682f45 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] No waiting events found dispatching network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:50 user nova-compute[72874]: WARNING nova.compute.manager [req-e3ae5ead-18f8-4ae0-b628-1ee407bd693a req-ba1d36a4-e74a-4aff-953a-bd8779682f45 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received unexpected event network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 for instance with vm_state building and task_state spawning.
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd1557b-3d93-4c44-8640-63e1556c859d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:23:50 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[84458b4a-66b6-43e6-bdcc-df0695d6b8f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb] added
Aug 17 18:23:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b33428f-e9a7-4d5d-986c-269a8e0dcebd]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96509fb-4571-413a-b909-9b8cdd951c92]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OFoTiUVm {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OFoTiUVm" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d25d45d-6308-4853-a836-434034b4dd82]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OFoTiUVm'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd509f6-3d16-4c26-9680-4ab000d1e2aa]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ad923c-2094-4376-8009-601cad790de4]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:50 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:50 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:23:50 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:23:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:50 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:50 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:23:50 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:23:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2797bd6-395a-489e-b7d0-5c8a67af3260]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb, portal: 172.16.0.220,3260]
Aug 17 18:23:50 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb, portal: 172.16.0.220,3260] successful.
Aug 17 18:23:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[33235000-edab-4de9-be83-22c96c4639d8]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[698e3143-0f7d-475a-995d-4a30a7e313ac]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:50 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:50 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:23:50 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:23:50 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:23:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:50 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:50 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:23:50 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:23:50 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:23:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] HCTL ('37', '-', '-', 0) found on session 25 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b975035-ed91-4058-8237-091c767b850c]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Searching for a device in session 25 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFoTiUVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23737643839633037', 'path': '/dev/sdf'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737643839633037', 'path': '/dev/sdf'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "address": "fa:16:3e:c8:a8:2b", "network": {"id": "51ce5fe7-85ba-4c8a-9ba3-4b8823afea51", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-341654396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb19bfac-de", "ovs_interfaceid": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "address": "fa:16:3e:c8:a8:2b", "network": {"id": "51ce5fe7-85ba-4c8a-9ba3-4b8823afea51", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-341654396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb19bfac-de", "ovs_interfaceid": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3,network=Network(51ce5fe7-85ba-4c8a-9ba3-4b8823afea51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb19bfac-de') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a06f651-218f-42e4-aee0-40e733d5a891", "address": "fa:16:3e:46:26:f0", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a06f651-21", "ovs_interfaceid": "2a06f651-218f-42e4-aee0-40e733d5a891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "2a06f651-218f-42e4-aee0-40e733d5a891", "address": "fa:16:3e:46:26:f0", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a06f651-21", "ovs_interfaceid": "2a06f651-218f-42e4-aee0-40e733d5a891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:26:f0,bridge_name='br-int',has_traffic_filtering=True,id=2a06f651-218f-42e4-aee0-40e733d5a891,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2a06f651-21') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "025bb037-5e0c-45f3-96c2-09a83b224502", "address": "fa:16:3e:06:ed:ab", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025bb037-5e", "ovs_interfaceid": "025bb037-5e0c-45f3-96c2-09a83b224502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "025bb037-5e0c-45f3-96c2-09a83b224502", "address": "fa:16:3e:06:ed:ab", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025bb037-5e", "ovs_interfaceid": "025bb037-5e0c-45f3-96c2-09a83b224502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:ed:ab,bridge_name='br-int',has_traffic_filtering=True,id=025bb037-5e0c-45f3-96c2-09a83b224502,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap025bb037-5e') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "address": "fa:16:3e:1c:de:6d", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdfe9b78-37", "ovs_interfaceid": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "address": "fa:16:3e:1c:de:6d", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdfe9b78-37", "ovs_interfaceid": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:de:6d,bridge_name='br-int',has_traffic_filtering=True,id=fdfe9b78-3799-41b0-87e0-88219cdaad87,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdfe9b78-37') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "address": "fa:16:3e:67:28:cb", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa59cbf-ed", "ovs_interfaceid": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "address": "fa:16:3e:67:28:cb", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa59cbf-ed", "ovs_interfaceid": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:28:cb,bridge_name='br-int',has_traffic_filtering=True,id=4aa59cbf-eda8-40ba-a155-1826ecc9d850,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa59cbf-ed') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "address": "fa:16:3e:0d:77:c0", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8d3da0-55", "ovs_interfaceid": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "address": "fa:16:3e:0d:77:c0", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8d3da0-55", "ovs_interfaceid": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:77:c0,bridge_name='br-int',has_traffic_filtering=True,id=5e8d3da0-5572-4024-9d00-cc5b185bff71,network=Network(eff8425f-fbb1-4a34-a63a-a58df1b61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e8d3da0-55') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "address": "fa:16:3e:f7:68:17", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86b5e91-07", "ovs_interfaceid": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "address": "fa:16:3e:f7:68:17", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86b5e91-07", "ovs_interfaceid": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:68:17,bridge_name='br-int',has_traffic_filtering=True,id=e86b5e91-071c-4b9e-80f0-7ce24ada55f5,network=Network(eff8425f-fbb1-4a34-a63a-a58df1b61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86b5e91-07') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.objects.instance [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c998fa1-9430-4f03-bae7-ce510509a9be {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:23:52 user nova-compute[72874]:   <uuid>8c998fa1-9430-4f03-bae7-ce510509a9be</uuid>
Aug 17 18:23:52 user nova-compute[72874]:   <name>instance-00000012</name>
Aug 17 18:23:52 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:23:52 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:23:52 user nova-compute[72874]:   <metadata>
Aug 17 18:23:52 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:23:52 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:23:52 user nova-compute[72874]:       <nova:name>tempest-device-tagging-server-1448698696</nova:name>
Aug 17 18:23:52 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:23:47</nova:creationTime>
Aug 17 18:23:52 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:23:52 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:23:52 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:23:52 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:23:52 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:23:52 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:23:52 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:23:52 user nova-compute[72874]:       <nova:owner>
Aug 17 18:23:52 user nova-compute[72874]:         <nova:user uuid="909454bbec8446d4beeba819352180e1">tempest-TaggedBootDevicesTest_v242-15839607-project-member</nova:user>
Aug 17 18:23:52 user nova-compute[72874]:         <nova:project uuid="31af41fdde924ec880875f5b31ba1a87">tempest-TaggedBootDevicesTest_v242-15839607</nova:project>
Aug 17 18:23:52 user nova-compute[72874]:       </nova:owner>
Aug 17 18:23:52 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:23:52 user nova-compute[72874]:       <nova:ports>
Aug 17 18:23:52 user nova-compute[72874]:         <nova:port uuid="fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3">
Aug 17 18:23:52 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 18:23:52 user nova-compute[72874]:         </nova:port>
Aug 17 18:23:52 user nova-compute[72874]:         <nova:port uuid="2a06f651-218f-42e4-aee0-40e733d5a891">
Aug 17 18:23:52 user nova-compute[72874]:           <nova:ip type="fixed" address="10.1.1.240" ipVersion="4"/>
Aug 17 18:23:52 user nova-compute[72874]:         </nova:port>
Aug 17 18:23:52 user nova-compute[72874]:         <nova:port uuid="025bb037-5e0c-45f3-96c2-09a83b224502">
Aug 17 18:23:52 user nova-compute[72874]:           <nova:ip type="fixed" address="10.1.1.175" ipVersion="4"/>
Aug 17 18:23:52 user nova-compute[72874]:         </nova:port>
Aug 17 18:23:52 user nova-compute[72874]:         <nova:port uuid="fdfe9b78-3799-41b0-87e0-88219cdaad87">
Aug 17 18:23:52 user nova-compute[72874]:           <nova:ip type="fixed" address="10.1.1.173" ipVersion="4"/>
Aug 17 18:23:52 user nova-compute[72874]:         </nova:port>
Aug 17 18:23:52 user nova-compute[72874]:         <nova:port uuid="4aa59cbf-eda8-40ba-a155-1826ecc9d850">
Aug 17 18:23:52 user nova-compute[72874]:           <nova:ip type="fixed" address="10.1.1.100" ipVersion="4"/>
Aug 17 18:23:52 user nova-compute[72874]:         </nova:port>
Aug 17 18:23:52 user nova-compute[72874]:         <nova:port uuid="5e8d3da0-5572-4024-9d00-cc5b185bff71">
Aug 17 18:23:52 user nova-compute[72874]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 18:23:52 user nova-compute[72874]:         </nova:port>
Aug 17 18:23:52 user nova-compute[72874]:         <nova:port uuid="e86b5e91-071c-4b9e-80f0-7ce24ada55f5">
Aug 17 18:23:52 user nova-compute[72874]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 18:23:52 user nova-compute[72874]:         </nova:port>
Aug 17 18:23:52 user nova-compute[72874]:       </nova:ports>
Aug 17 18:23:52 user nova-compute[72874]:     </nova:instance>
Aug 17 18:23:52 user nova-compute[72874]:   </metadata>
Aug 17 18:23:52 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:23:52 user nova-compute[72874]:     <system>
Aug 17 18:23:52 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:23:52 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:23:52 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:23:52 user nova-compute[72874]:       <entry name="serial">8c998fa1-9430-4f03-bae7-ce510509a9be</entry>
Aug 17 18:23:52 user nova-compute[72874]:       <entry name="uuid">8c998fa1-9430-4f03-bae7-ce510509a9be</entry>
Aug 17 18:23:52 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:23:52 user nova-compute[72874]:     </system>
Aug 17 18:23:52 user nova-compute[72874]:   </sysinfo>
Aug 17 18:23:52 user nova-compute[72874]:   <os>
Aug 17 18:23:52 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:23:52 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:23:52 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:23:52 user nova-compute[72874]:   </os>
Aug 17 18:23:52 user nova-compute[72874]:   <features>
Aug 17 18:23:52 user nova-compute[72874]:     <acpi/>
Aug 17 18:23:52 user nova-compute[72874]:     <apic/>
Aug 17 18:23:52 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:23:52 user nova-compute[72874]:   </features>
Aug 17 18:23:52 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:23:52 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:23:52 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:23:52 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:23:52 user nova-compute[72874]:   </clock>
Aug 17 18:23:52 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:23:52 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:23:52 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:23:52 user nova-compute[72874]:   </cpu>
Aug 17 18:23:52 user nova-compute[72874]:   <devices>
Aug 17 18:23:52 user nova-compute[72874]:     <disk type="file" device="cdrom">
Aug 17 18:23:52 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 18:23:52 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/8c998fa1-9430-4f03-bae7-ce510509a9be/disk.config"/>
Aug 17 18:23:52 user nova-compute[72874]:       <target dev="hda" bus="ide"/>
Aug 17 18:23:52 user nova-compute[72874]:     </disk>
Aug 17 18:23:52 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:23:52 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:23:52 user nova-compute[72874]:       <source dev="/dev/sdd"/>
Aug 17 18:23:52 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:23:52 user nova-compute[72874]:       <serial>c8aa08fb-a17c-45fc-88f3-f1ec606dcc61</serial>
Aug 17 18:23:52 user nova-compute[72874]:     </disk>
Aug 17 18:23:52 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:23:52 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:23:52 user nova-compute[72874]:       <source dev="/dev/sde"/>
Aug 17 18:23:52 user nova-compute[72874]:       <target dev="vdb" bus="virtio"/>
Aug 17 18:23:52 user nova-compute[72874]:       <serial>8e77b595-57f6-40df-85ef-c933cf5a1b53</serial>
Aug 17 18:23:52 user nova-compute[72874]:     </disk>
Aug 17 18:23:52 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:23:52 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:23:52 user nova-compute[72874]:       <source dev="/dev/sdf"/>
Aug 17 18:23:52 user nova-compute[72874]:       <target dev="vdc" bus="virtio"/>
Aug 17 18:23:52 user nova-compute[72874]:       <serial>121f656c-b13e-49e9-923f-4929ec5b7bfb</serial>
Aug 17 18:23:52 user nova-compute[72874]:     </disk>
Aug 17 18:23:52 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:23:52 user nova-compute[72874]:       <mac address="fa:16:3e:c8:a8:2b"/>
Aug 17 18:23:52 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:23:52 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:23:52 user nova-compute[72874]:       <target dev="tapfb19bfac-de"/>
Aug 17 18:23:52 user nova-compute[72874]:     </interface>
Aug 17 18:23:52 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:23:52 user nova-compute[72874]:       <mac address="fa:16:3e:46:26:f0"/>
Aug 17 18:23:52 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:23:52 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:23:52 user nova-compute[72874]:       <target dev="tap2a06f651-21"/>
Aug 17 18:23:52 user nova-compute[72874]:     </interface>
Aug 17 18:23:52 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:23:52 user nova-compute[72874]:       <mac address="fa:16:3e:06:ed:ab"/>
Aug 17 18:23:52 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:23:52 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:23:52 user nova-compute[72874]:       <target dev="tap025bb037-5e"/>
Aug 17 18:23:52 user nova-compute[72874]:     </interface>
Aug 17 18:23:52 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:23:52 user nova-compute[72874]:       <mac address="fa:16:3e:1c:de:6d"/>
Aug 17 18:23:52 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:23:52 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:23:52 user nova-compute[72874]:       <target dev="tapfdfe9b78-37"/>
Aug 17 18:23:52 user nova-compute[72874]:     </interface>
Aug 17 18:23:52 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:23:52 user nova-compute[72874]:       <mac address="fa:16:3e:67:28:cb"/>
Aug 17 18:23:52 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:23:52 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:23:52 user nova-compute[72874]:       <target dev="tap4aa59cbf-ed"/>
Aug 17 18:23:52 user nova-compute[72874]:     </interface>
Aug 17 18:23:52 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:23:52 user nova-compute[72874]:       <mac address="fa:16:3e:0d:77:c0"/>
Aug 17 18:23:52 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:23:52 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:23:52 user nova-compute[72874]:       <target dev="tap5e8d3da0-55"/>
Aug 17 18:23:52 user nova-compute[72874]:     </interface>
Aug 17 18:23:52 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:23:52 user nova-compute[72874]:       <mac address="fa:16:3e:f7:68:17"/>
Aug 17 18:23:52 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:23:52 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:23:52 user nova-compute[72874]:       <target dev="tape86b5e91-07"/>
Aug 17 18:23:52 user nova-compute[72874]:     </interface>
Aug 17 18:23:52 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:23:52 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/8c998fa1-9430-4f03-bae7-ce510509a9be/console.log" append="off"/>
Aug 17 18:23:52 user nova-compute[72874]:     </serial>
Aug 17 18:23:52 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:23:52 user nova-compute[72874]:     <video>
Aug 17 18:23:52 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:23:52 user nova-compute[72874]:     </video>
Aug 17 18:23:52 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:23:52 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:23:52 user nova-compute[72874]:     </rng>
Aug 17 18:23:52 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:23:52 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:23:52 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:23:52 user nova-compute[72874]:     </memballoon>
Aug 17 18:23:52 user nova-compute[72874]:   </devices>
Aug 17 18:23:52 user nova-compute[72874]: </domain>
Aug 17 18:23:52 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "address": "fa:16:3e:c8:a8:2b", "network": {"id": "51ce5fe7-85ba-4c8a-9ba3-4b8823afea51", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-341654396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb19bfac-de", "ovs_interfaceid": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "address": "fa:16:3e:c8:a8:2b", "network": {"id": "51ce5fe7-85ba-4c8a-9ba3-4b8823afea51", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-341654396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb19bfac-de", "ovs_interfaceid": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3,network=Network(51ce5fe7-85ba-4c8a-9ba3-4b8823afea51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb19bfac-de') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG os_vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3,network=Network(51ce5fe7-85ba-4c8a-9ba3-4b8823afea51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb19bfac-de') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb19bfac-de, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfb19bfac-de, col_values=(('external_ids', {'iface-id': 'fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:a8:2b', 'vm-uuid': '8c998fa1-9430-4f03-bae7-ce510509a9be'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: INFO os_vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3,network=Network(51ce5fe7-85ba-4c8a-9ba3-4b8823afea51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb19bfac-de')
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a06f651-218f-42e4-aee0-40e733d5a891", "address": "fa:16:3e:46:26:f0", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a06f651-21", "ovs_interfaceid": "2a06f651-218f-42e4-aee0-40e733d5a891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "2a06f651-218f-42e4-aee0-40e733d5a891", "address": "fa:16:3e:46:26:f0", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a06f651-21", "ovs_interfaceid": "2a06f651-218f-42e4-aee0-40e733d5a891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:26:f0,bridge_name='br-int',has_traffic_filtering=True,id=2a06f651-218f-42e4-aee0-40e733d5a891,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2a06f651-21') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG os_vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:26:f0,bridge_name='br-int',has_traffic_filtering=True,id=2a06f651-218f-42e4-aee0-40e733d5a891,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2a06f651-21') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a06f651-21, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a06f651-21, col_values=(('external_ids', {'iface-id': '2a06f651-218f-42e4-aee0-40e733d5a891', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:26:f0', 'vm-uuid': '8c998fa1-9430-4f03-bae7-ce510509a9be'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: INFO os_vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:26:f0,bridge_name='br-int',has_traffic_filtering=True,id=2a06f651-218f-42e4-aee0-40e733d5a891,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2a06f651-21')
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "025bb037-5e0c-45f3-96c2-09a83b224502", "address": "fa:16:3e:06:ed:ab", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025bb037-5e", "ovs_interfaceid": "025bb037-5e0c-45f3-96c2-09a83b224502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "025bb037-5e0c-45f3-96c2-09a83b224502", "address": "fa:16:3e:06:ed:ab", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025bb037-5e", "ovs_interfaceid": "025bb037-5e0c-45f3-96c2-09a83b224502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:ed:ab,bridge_name='br-int',has_traffic_filtering=True,id=025bb037-5e0c-45f3-96c2-09a83b224502,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap025bb037-5e') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG os_vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:ed:ab,bridge_name='br-int',has_traffic_filtering=True,id=025bb037-5e0c-45f3-96c2-09a83b224502,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap025bb037-5e') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap025bb037-5e, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap025bb037-5e, col_values=(('external_ids', {'iface-id': '025bb037-5e0c-45f3-96c2-09a83b224502', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:ed:ab', 'vm-uuid': '8c998fa1-9430-4f03-bae7-ce510509a9be'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: INFO os_vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:ed:ab,bridge_name='br-int',has_traffic_filtering=True,id=025bb037-5e0c-45f3-96c2-09a83b224502,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap025bb037-5e')
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "address": "fa:16:3e:1c:de:6d", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdfe9b78-37", "ovs_interfaceid": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "address": "fa:16:3e:1c:de:6d", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdfe9b78-37", "ovs_interfaceid": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:de:6d,bridge_name='br-int',has_traffic_filtering=True,id=fdfe9b78-3799-41b0-87e0-88219cdaad87,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdfe9b78-37') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG os_vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:de:6d,bridge_name='br-int',has_traffic_filtering=True,id=fdfe9b78-3799-41b0-87e0-88219cdaad87,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdfe9b78-37') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdfe9b78-37, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfdfe9b78-37, col_values=(('external_ids', {'iface-id': 'fdfe9b78-3799-41b0-87e0-88219cdaad87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:de:6d', 'vm-uuid': '8c998fa1-9430-4f03-bae7-ce510509a9be'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: INFO os_vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:de:6d,bridge_name='br-int',has_traffic_filtering=True,id=fdfe9b78-3799-41b0-87e0-88219cdaad87,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdfe9b78-37')
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "address": "fa:16:3e:67:28:cb", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa59cbf-ed", "ovs_interfaceid": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "address": "fa:16:3e:67:28:cb", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa59cbf-ed", "ovs_interfaceid": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:28:cb,bridge_name='br-int',has_traffic_filtering=True,id=4aa59cbf-eda8-40ba-a155-1826ecc9d850,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa59cbf-ed') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG os_vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:28:cb,bridge_name='br-int',has_traffic_filtering=True,id=4aa59cbf-eda8-40ba-a155-1826ecc9d850,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa59cbf-ed') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4aa59cbf-ed, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4aa59cbf-ed, col_values=(('external_ids', {'iface-id': '4aa59cbf-eda8-40ba-a155-1826ecc9d850', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:28:cb', 'vm-uuid': '8c998fa1-9430-4f03-bae7-ce510509a9be'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: INFO os_vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:28:cb,bridge_name='br-int',has_traffic_filtering=True,id=4aa59cbf-eda8-40ba-a155-1826ecc9d850,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa59cbf-ed')
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "address": "fa:16:3e:0d:77:c0", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8d3da0-55", "ovs_interfaceid": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "address": "fa:16:3e:0d:77:c0", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8d3da0-55", "ovs_interfaceid": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:77:c0,bridge_name='br-int',has_traffic_filtering=True,id=5e8d3da0-5572-4024-9d00-cc5b185bff71,network=Network(eff8425f-fbb1-4a34-a63a-a58df1b61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e8d3da0-55') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG os_vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:77:c0,bridge_name='br-int',has_traffic_filtering=True,id=5e8d3da0-5572-4024-9d00-cc5b185bff71,network=Network(eff8425f-fbb1-4a34-a63a-a58df1b61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e8d3da0-55') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e8d3da0-55, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e8d3da0-55, col_values=(('external_ids', {'iface-id': '5e8d3da0-5572-4024-9d00-cc5b185bff71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:77:c0', 'vm-uuid': '8c998fa1-9430-4f03-bae7-ce510509a9be'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: INFO os_vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:77:c0,bridge_name='br-int',has_traffic_filtering=True,id=5e8d3da0-5572-4024-9d00-cc5b185bff71,network=Network(eff8425f-fbb1-4a34-a63a-a58df1b61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e8d3da0-55')
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:23:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "address": "fa:16:3e:f7:68:17", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86b5e91-07", "ovs_interfaceid": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "address": "fa:16:3e:f7:68:17", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86b5e91-07", "ovs_interfaceid": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:68:17,bridge_name='br-int',has_traffic_filtering=True,id=e86b5e91-071c-4b9e-80f0-7ce24ada55f5,network=Network(eff8425f-fbb1-4a34-a63a-a58df1b61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86b5e91-07') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG os_vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:68:17,bridge_name='br-int',has_traffic_filtering=True,id=e86b5e91-071c-4b9e-80f0-7ce24ada55f5,network=Network(eff8425f-fbb1-4a34-a63a-a58df1b61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86b5e91-07') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape86b5e91-07, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape86b5e91-07, col_values=(('external_ids', {'iface-id': 'e86b5e91-071c-4b9e-80f0-7ce24ada55f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:68:17', 'vm-uuid': '8c998fa1-9430-4f03-bae7-ce510509a9be'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:52 user nova-compute[72874]: INFO os_vif [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:68:17,bridge_name='br-int',has_traffic_filtering=True,id=e86b5e91-071c-4b9e-80f0-7ce24ada55f5,network=Network(eff8425f-fbb1-4a34-a63a-a58df1b61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86b5e91-07')
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] No BDM found with device name hda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] No VIF found with MAC fa:16:3e:c8:a8:2b, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] No VIF found with MAC fa:16:3e:67:28:cb, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:23:52 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Using config drive
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296632.5792756, cf9f3116-5e42-4858-a391-ab75d2046f1a => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:23:52 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] VM Resumed (Lifecycle Event)
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:23:52 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Instance spawned successfully.
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-e30ef982-e585-4551-8273-ddc748ff34a1 req-47332c44-ea1c-4eb6-b4be-b53c4511a47e service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received event network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e30ef982-e585-4551-8273-ddc748ff34a1 req-47332c44-ea1c-4eb6-b4be-b53c4511a47e service nova] Acquiring lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e30ef982-e585-4551-8273-ddc748ff34a1 req-47332c44-ea1c-4eb6-b4be-b53c4511a47e service nova] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e30ef982-e585-4551-8273-ddc748ff34a1 req-47332c44-ea1c-4eb6-b4be-b53c4511a47e service nova] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-e30ef982-e585-4551-8273-ddc748ff34a1 req-47332c44-ea1c-4eb6-b4be-b53c4511a47e service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] No waiting events found dispatching network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:52 user nova-compute[72874]: WARNING nova.compute.manager [req-e30ef982-e585-4551-8273-ddc748ff34a1 req-47332c44-ea1c-4eb6-b4be-b53c4511a47e service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received unexpected event network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 for instance with vm_state building and task_state spawning.
Aug 17 18:23:52 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296632.5877726, cf9f3116-5e42-4858-a391-ab75d2046f1a => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:23:52 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] VM Started (Lifecycle Event)
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:23:52 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Creating config drive at /opt/stack/data/nova/instances/8c998fa1-9430-4f03-bae7-ce510509a9be/disk.config
Aug 17 18:23:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8c998fa1-9430-4f03-bae7-ce510509a9be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp895xpxlq {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:23:52 user nova-compute[72874]: INFO nova.compute.manager [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Took 6.72 seconds to spawn the instance on the hypervisor.
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:23:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8c998fa1-9430-4f03-bae7-ce510509a9be/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp895xpxlq" returned: 0 in 0.095s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:52 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:23:52 user nova-compute[72874]: INFO nova.compute.manager [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Took 7.58 seconds to build instance.
Aug 17 18:23:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6325efa2-b91d-4ed8-bf0d-8bca800eae03 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.807s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:23:53 user nova-compute[72874]: INFO nova.compute.manager [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] instance snapshotting
Aug 17 18:23:53 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Beginning live snapshot process
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json -f qcow2 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJCicowN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:23:54 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:23:54 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:23:54 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:23:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75ff20f-6d5e-4ab6-a83e-e3924861dc3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:23:54 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5385a33c-93cf-4d7c-a4a5-c8c63ac06e65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913] added
Aug 17 18:23:54 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0d4516-2c30-463e-bdac-712788294edb]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json -f qcow2" returned: 0 in 0.205s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json -f qcow2 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a032e2-06bc-481e-9880-c2327be2ac8f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJCicowN {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJCicowN" returned: 0 in 0.039s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[348a0993-b378-4529-b1f6-82cfd2f4b809]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DJCicowN'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fe4856-72a9-40a1-b964-ad42bb9fa10d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.061s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d0d9722-2a9c-42c1-a343-a237d0ff9864]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:23:54 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:23:54 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json -f qcow2" returned: 0 in 0.226s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-8c72a9a0-82cc-45c5-8ec6-078d127f8188 req-e091a00b-0dd6-45cc-8bad-ef16f20578d2 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8c72a9a0-82cc-45c5-8ec6-078d127f8188 req-e091a00b-0dd6-45cc-8bad-ef16f20578d2 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8c72a9a0-82cc-45c5-8ec6-078d127f8188 req-e091a00b-0dd6-45cc-8bad-ef16f20578d2 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8c72a9a0-82cc-45c5-8ec6-078d127f8188 req-e091a00b-0dd6-45cc-8bad-ef16f20578d2 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-8c72a9a0-82cc-45c5-8ec6-078d127f8188 req-e091a00b-0dd6-45cc-8bad-ef16f20578d2 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:54 user nova-compute[72874]: WARNING nova.compute.manager [req-8c72a9a0-82cc-45c5-8ec6-078d127f8188 req-e091a00b-0dd6-45cc-8bad-ef16f20578d2 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 for instance with vm_state building and task_state spawning.
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --login" returned: 0 in 0.113s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0851cdbb-59df-4cd6-bac1-28fb0c241c8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260]
Aug 17 18:23:54 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260] successful.
Aug 17 18:23:54 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e707d99b-a21a-4fad-81c8-d7ea119d200d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f801d9be-6856-40c6-ba62-2e7e0d90dd99]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:23:54 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:23:54 user nova-compute[72874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:23:54 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.537s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] HCTL ('38', '-', '-', 0) found on session 26 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1901558f-def2-4f16-932b-ed1a97f09445]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJCicowN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.248s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2ljyksay/a10bb97b0beb49a884522cb08fa6b0f2.delta 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp2ljyksay/a10bb97b0beb49a884522cb08fa6b0f2.delta 1073741824" returned: 0 in 0.067s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:54 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 18:23:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-24a403b6-6841-44a2-b8c5-82ef92e30014 req-edbb469c-1363-4f3f-90e8-2a6eec248d5e service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-2a06f651-218f-42e4-aee0-40e733d5a891 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-24a403b6-6841-44a2-b8c5-82ef92e30014 req-edbb469c-1363-4f3f-90e8-2a6eec248d5e service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-24a403b6-6841-44a2-b8c5-82ef92e30014 req-edbb469c-1363-4f3f-90e8-2a6eec248d5e service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-24a403b6-6841-44a2-b8c5-82ef92e30014 req-edbb469c-1363-4f3f-90e8-2a6eec248d5e service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-24a403b6-6841-44a2-b8c5-82ef92e30014 req-edbb469c-1363-4f3f-90e8-2a6eec248d5e service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-2a06f651-218f-42e4-aee0-40e733d5a891 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:55 user nova-compute[72874]: WARNING nova.compute.manager [req-24a403b6-6841-44a2-b8c5-82ef92e30014 req-edbb469c-1363-4f3f-90e8-2a6eec248d5e service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-2a06f651-218f-42e4-aee0-40e733d5a891 for instance with vm_state building and task_state spawning.
Aug 17 18:23:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.584s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] <== connect_volume: return (1586ms) {'type': 'block', 'scsi_wwn': '26566643839373337', 'path': '/dev/sdg'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566643839373337', 'path': '/dev/sdg'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG nova.objects.instance [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lazy-loading 'flavor' on Instance uuid 2ace97e1-c2ee-462e-a929-22c7cb2584d2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:23:55 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:23:55 user nova-compute[72874]:   <source dev="/dev/sdg"/>
Aug 17 18:23:55 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:23:55 user nova-compute[72874]:   <serial>19c92b6f-990a-4e2a-97df-5bb870e61913</serial>
Aug 17 18:23:55 user nova-compute[72874]: </disk>
Aug 17 18:23:55 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:23:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-c07aa822-5c56-41e4-b9a5-d6f091ff416c req-a13be924-875f-4451-a775-035aa678e9b5 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-fdfe9b78-3799-41b0-87e0-88219cdaad87 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c07aa822-5c56-41e4-b9a5-d6f091ff416c req-a13be924-875f-4451-a775-035aa678e9b5 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c07aa822-5c56-41e4-b9a5-d6f091ff416c req-a13be924-875f-4451-a775-035aa678e9b5 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c07aa822-5c56-41e4-b9a5-d6f091ff416c req-a13be924-875f-4451-a775-035aa678e9b5 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-c07aa822-5c56-41e4-b9a5-d6f091ff416c req-a13be924-875f-4451-a775-035aa678e9b5 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-fdfe9b78-3799-41b0-87e0-88219cdaad87 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:56 user nova-compute[72874]: WARNING nova.compute.manager [req-c07aa822-5c56-41e4-b9a5-d6f091ff416c req-a13be924-875f-4451-a775-035aa678e9b5 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-fdfe9b78-3799-41b0-87e0-88219cdaad87 for instance with vm_state building and task_state spawning.
Aug 17 18:23:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] No VIF found with MAC fa:16:3e:80:58:cc, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296621.5364432, f027045c-d121-45ec-af61-e1a2399c4a43 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:23:56 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] VM Stopped (Lifecycle Event)
Aug 17 18:23:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-61f05dfe-be22-4037-8308-6f61d7ff3002 None None] [instance: f027045c-d121-45ec-af61-e1a2399c4a43] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-602c0cc4-63d9-4e41-ac7e-c5cb5a4010ea req-a9e765ea-2476-4cdd-84e0-3a6952e4c091 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-602c0cc4-63d9-4e41-ac7e-c5cb5a4010ea req-a9e765ea-2476-4cdd-84e0-3a6952e4c091 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-602c0cc4-63d9-4e41-ac7e-c5cb5a4010ea req-a9e765ea-2476-4cdd-84e0-3a6952e4c091 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-602c0cc4-63d9-4e41-ac7e-c5cb5a4010ea req-a9e765ea-2476-4cdd-84e0-3a6952e4c091 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-602c0cc4-63d9-4e41-ac7e-c5cb5a4010ea req-a9e765ea-2476-4cdd-84e0-3a6952e4c091 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:56 user nova-compute[72874]: WARNING nova.compute.manager [req-602c0cc4-63d9-4e41-ac7e-c5cb5a4010ea req-a9e765ea-2476-4cdd-84e0-3a6952e4c091 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 for instance with vm_state building and task_state spawning.
Aug 17 18:23:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1f4a2354-eacd-482d-bf16-4e5aea69b5d3 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.645s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-2a06f651-218f-42e4-aee0-40e733d5a891 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-2a06f651-218f-42e4-aee0-40e733d5a891 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:57 user nova-compute[72874]: WARNING nova.compute.manager [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-2a06f651-218f-42e4-aee0-40e733d5a891 for instance with vm_state building and task_state spawning.
Aug 17 18:23:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-025bb037-5e0c-45f3-96c2-09a83b224502 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-025bb037-5e0c-45f3-96c2-09a83b224502 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:57 user nova-compute[72874]: WARNING nova.compute.manager [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-025bb037-5e0c-45f3-96c2-09a83b224502 for instance with vm_state building and task_state spawning.
Aug 17 18:23:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-025bb037-5e0c-45f3-96c2-09a83b224502 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-025bb037-5e0c-45f3-96c2-09a83b224502 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:57 user nova-compute[72874]: WARNING nova.compute.manager [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-025bb037-5e0c-45f3-96c2-09a83b224502 for instance with vm_state building and task_state spawning.
Aug 17 18:23:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-4aa59cbf-eda8-40ba-a155-1826ecc9d850 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-4aa59cbf-eda8-40ba-a155-1826ecc9d850 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:57 user nova-compute[72874]: WARNING nova.compute.manager [req-9e1c2f41-61d6-492b-a1d3-1ef0ff26c8c4 req-15eaa445-56d3-471e-8725-20d386012055 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-4aa59cbf-eda8-40ba-a155-1826ecc9d850 for instance with vm_state building and task_state spawning.
Aug 17 18:23:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] COPY block job progress, current cursor: 15925248 final cursor: 75497472 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-fdfe9b78-3799-41b0-87e0-88219cdaad87 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-fdfe9b78-3799-41b0-87e0-88219cdaad87 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:58 user nova-compute[72874]: WARNING nova.compute.manager [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-fdfe9b78-3799-41b0-87e0-88219cdaad87 for instance with vm_state building and task_state spawning.
Aug 17 18:23:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-5e8d3da0-5572-4024-9d00-cc5b185bff71 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-5e8d3da0-5572-4024-9d00-cc5b185bff71 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:58 user nova-compute[72874]: WARNING nova.compute.manager [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-5e8d3da0-5572-4024-9d00-cc5b185bff71 for instance with vm_state building and task_state spawning.
Aug 17 18:23:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-5e8d3da0-5572-4024-9d00-cc5b185bff71 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-5e8d3da0-5572-4024-9d00-cc5b185bff71 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:58 user nova-compute[72874]: WARNING nova.compute.manager [req-4d351a75-4baa-4f21-b823-db82c4e6677b req-1de746b6-adb5-429e-97b5-d9102bb7466d service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-5e8d3da0-5572-4024-9d00-cc5b185bff71 for instance with vm_state building and task_state spawning.
Aug 17 18:23:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:23:58 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 18:23:58 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2ljyksay/a10bb97b0beb49a884522cb08fa6b0f2.delta /opt/stack/data/nova/instances/snapshots/tmp2ljyksay/a10bb97b0beb49a884522cb08fa6b0f2 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-e5fc485e-b2e8-484c-9224-2d16956c42ed req-db3ced4a-5677-4aaa-9b06-94ff194d09d2 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-e86b5e91-071c-4b9e-80f0-7ce24ada55f5 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e5fc485e-b2e8-484c-9224-2d16956c42ed req-db3ced4a-5677-4aaa-9b06-94ff194d09d2 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e5fc485e-b2e8-484c-9224-2d16956c42ed req-db3ced4a-5677-4aaa-9b06-94ff194d09d2 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e5fc485e-b2e8-484c-9224-2d16956c42ed req-db3ced4a-5677-4aaa-9b06-94ff194d09d2 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-e5fc485e-b2e8-484c-9224-2d16956c42ed req-db3ced4a-5677-4aaa-9b06-94ff194d09d2 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-e86b5e91-071c-4b9e-80f0-7ce24ada55f5 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:58 user nova-compute[72874]: WARNING nova.compute.manager [req-e5fc485e-b2e8-484c-9224-2d16956c42ed req-db3ced4a-5677-4aaa-9b06-94ff194d09d2 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-e86b5e91-071c-4b9e-80f0-7ce24ada55f5 for instance with vm_state building and task_state spawning.
Aug 17 18:23:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-e5fc485e-b2e8-484c-9224-2d16956c42ed req-db3ced4a-5677-4aaa-9b06-94ff194d09d2 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-e86b5e91-071c-4b9e-80f0-7ce24ada55f5 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e5fc485e-b2e8-484c-9224-2d16956c42ed req-db3ced4a-5677-4aaa-9b06-94ff194d09d2 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e5fc485e-b2e8-484c-9224-2d16956c42ed req-db3ced4a-5677-4aaa-9b06-94ff194d09d2 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e5fc485e-b2e8-484c-9224-2d16956c42ed req-db3ced4a-5677-4aaa-9b06-94ff194d09d2 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-e5fc485e-b2e8-484c-9224-2d16956c42ed req-db3ced4a-5677-4aaa-9b06-94ff194d09d2 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-e86b5e91-071c-4b9e-80f0-7ce24ada55f5 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:58 user nova-compute[72874]: WARNING nova.compute.manager [req-e5fc485e-b2e8-484c-9224-2d16956c42ed req-db3ced4a-5677-4aaa-9b06-94ff194d09d2 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-e86b5e91-071c-4b9e-80f0-7ce24ada55f5 for instance with vm_state building and task_state spawning.
Aug 17 18:23:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:23:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-734b1b2c-bbff-4aee-b19b-99ed0460db9c req-2bcc5d90-afc0-4316-8498-212c26d79380 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-4aa59cbf-eda8-40ba-a155-1826ecc9d850 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:23:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-734b1b2c-bbff-4aee-b19b-99ed0460db9c req-2bcc5d90-afc0-4316-8498-212c26d79380 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-734b1b2c-bbff-4aee-b19b-99ed0460db9c req-2bcc5d90-afc0-4316-8498-212c26d79380 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:23:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-734b1b2c-bbff-4aee-b19b-99ed0460db9c req-2bcc5d90-afc0-4316-8498-212c26d79380 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:23:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-734b1b2c-bbff-4aee-b19b-99ed0460db9c req-2bcc5d90-afc0-4316-8498-212c26d79380 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-4aa59cbf-eda8-40ba-a155-1826ecc9d850 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:23:59 user nova-compute[72874]: WARNING nova.compute.manager [req-734b1b2c-bbff-4aee-b19b-99ed0460db9c req-2bcc5d90-afc0-4316-8498-212c26d79380 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-4aa59cbf-eda8-40ba-a155-1826ecc9d850 for instance with vm_state building and task_state spawning.
Aug 17 18:23:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp2ljyksay/a10bb97b0beb49a884522cb08fa6b0f2.delta /opt/stack/data/nova/instances/snapshots/tmp2ljyksay/a10bb97b0beb49a884522cb08fa6b0f2" returned: 0 in 0.601s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:23:59 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Snapshot extracted, beginning image upload
Aug 17 18:23:59 user nova-compute[72874]: DEBUG nova.compute.manager [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Stashing vm_state: active {{(pid=72874) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 18:23:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:23:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.objects.instance [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lazy-loading 'pci_requests' on Instance uuid 2ace97e1-c2ee-462e-a929-22c7cb2584d2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:24:00 user nova-compute[72874]: INFO nova.compute.claims [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Claim successful on node user
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.objects.instance [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lazy-loading 'resources' on Instance uuid 2ace97e1-c2ee-462e-a929-22c7cb2584d2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.objects.instance [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ace97e1-c2ee-462e-a929-22c7cb2584d2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:24:00 user nova-compute[72874]: INFO nova.compute.resource_tracker [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updating resource usage from migration d05bb49b-d48d-421b-8d68-afb2f6058907
Aug 17 18:24:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.498s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:00 user nova-compute[72874]: INFO nova.compute.manager [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Migrating
Aug 17 18:24:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:24:00 user nova-compute[72874]: INFO nova.compute.rpcapi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 17 18:24:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquired lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.network.neutron [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296640.6389024, 8c998fa1-9430-4f03-bae7-ce510509a9be => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:24:00 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] VM Resumed (Lifecycle Event)
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:24:00 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Instance spawned successfully.
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:24:00 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296640.6405182, 8c998fa1-9430-4f03-bae7-ce510509a9be => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:24:00 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] VM Started (Lifecycle Event)
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:24:00 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:24:00 user nova-compute[72874]: INFO nova.compute.manager [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Took 13.26 seconds to spawn the instance on the hypervisor.
Aug 17 18:24:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:24:00 user nova-compute[72874]: INFO nova.compute.manager [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Took 51.84 seconds to build instance.
Aug 17 18:24:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bce51ff8-4292-45ae-88fd-692c3b680599 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.962s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:01 user nova-compute[72874]: DEBUG nova.network.neutron [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updating instance_info_cache with network_info: [{"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:24:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Releasing lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:24:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Starting migrate_disk_and_power_off {{(pid=72874) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 18:24:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:02 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Snapshot image upload complete
Aug 17 18:24:02 user nova-compute[72874]: INFO nova.compute.manager [None req-98d3c0f9-ad8d-4519-8c82-4ae1b12571cb tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Took 8.17 seconds to snapshot the instance on the hypervisor.
Aug 17 18:24:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-3e445b49-febf-4bf2-8a76-a493c93f324f req-70732776-1bc9-4044-b2d4-0628d2307f7f service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received event network-vif-unplugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3e445b49-febf-4bf2-8a76-a493c93f324f req-70732776-1bc9-4044-b2d4-0628d2307f7f service nova] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3e445b49-febf-4bf2-8a76-a493c93f324f req-70732776-1bc9-4044-b2d4-0628d2307f7f service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3e445b49-febf-4bf2-8a76-a493c93f324f req-70732776-1bc9-4044-b2d4-0628d2307f7f service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-3e445b49-febf-4bf2-8a76-a493c93f324f req-70732776-1bc9-4044-b2d4-0628d2307f7f service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] No waiting events found dispatching network-vif-unplugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:24:02 user nova-compute[72874]: WARNING nova.compute.manager [req-3e445b49-febf-4bf2-8a76-a493c93f324f req-70732776-1bc9-4044-b2d4-0628d2307f7f service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received unexpected event network-vif-unplugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c for instance with vm_state active and task_state resize_migrating.
Aug 17 18:24:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:02 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Instance destroyed successfully.
Aug 17 18:24:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1594135899',display_name='tempest-ServerActionsTestOtherB-server-1594135899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1594135899',id=13,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJL0wGDO9yYxM59zaPj86jL9bZvPsFDy3YJOsbSwVi+3h9+DinmjEtIZue1FvAOYIc54lSepvgAxdfqkbFKLJ90/SAHzFU18VdJmA0Lh/YqOsAztJ9gMRfqGTMWDprprBA==',key_name='tempest-keypair-1720427808',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:20:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ad9005fd344e470482b0b90baeb97515',ramdisk_id='',reservation_id='r-5cqpdw10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1909498304',owner_user_name='tempest-ServerActionsTestOtherB-1909498304-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:24:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31f7828a072847dc9cb4d4fd51908366',uuid=2ace97e1-c2ee-462e-a929-22c7cb2584d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2007432489-network", "vif_mac": "fa:16:3e:80:58:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converting VIF {"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2007432489-network", "vif_mac": "fa:16:3e:80:58:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_vif [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6319754-2b, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:02 user nova-compute[72874]: INFO os_vif [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b')
Aug 17 18:24:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJCicowN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:24:02 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa15e27-7fba-40a5-b47d-4a1424fa89d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[163a96e8-ad28-4c07-bae3-1fab68f98cbd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:24:02 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:24:02 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:24:02 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:24:02 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:24:02 user nova-compute[72874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:24:02 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:24:02 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:24:02 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:24:02 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:24:02 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:24:02 user nova-compute[72874]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:24:02 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a07c57e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913'): ({'sdg'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Removing single pathed devices sdg {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eea70b-5bf8-4546-b464-5e583b2f64e7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb85ae5-ba7f-40fe-8436-2b0fbf9c5352]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Flushing IO for device /dev/sdg {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[520c40b7-860d-4aca-82eb-020409481579]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa82d55-2769-4b9c-b2f6-7befdf6543b6]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] SCSI volumes sdg have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e5ab532-7a68-434e-9f5e-0fb76efec71b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9c64f9-5721-465d-9cad-0f558abdae38]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260]
Aug 17 18:24:02 user nova-compute[72874]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260] successful.
Aug 17 18:24:02 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[06af50ac-e9f2-4680-9557-857a168f884e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] <== disconnect_volume: return (346ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:24:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:03 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:24:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2_resize/disk /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CMD "cp -r /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2_resize/disk /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk" returned: 0 in 0.529s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2_resize/disk.info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk.info {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CMD "cp -r /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2_resize/disk.info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk.info" returned: 0 in 0.039s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:04 user nova-compute[72874]: DEBUG nova.compute.manager [req-3fd25dc2-7545-4c03-bd07-f06e9eca5a20 req-ff4f6e42-2034-496e-94ec-4665182f3829 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:24:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3fd25dc2-7545-4c03-bd07-f06e9eca5a20 req-ff4f6e42-2034-496e-94ec-4665182f3829 service nova] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3fd25dc2-7545-4c03-bd07-f06e9eca5a20 req-ff4f6e42-2034-496e-94ec-4665182f3829 service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3fd25dc2-7545-4c03-bd07-f06e9eca5a20 req-ff4f6e42-2034-496e-94ec-4665182f3829 service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:04 user nova-compute[72874]: DEBUG nova.compute.manager [req-3fd25dc2-7545-4c03-bd07-f06e9eca5a20 req-ff4f6e42-2034-496e-94ec-4665182f3829 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] No waiting events found dispatching network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:24:04 user nova-compute[72874]: WARNING nova.compute.manager [req-3fd25dc2-7545-4c03-bd07-f06e9eca5a20 req-ff4f6e42-2034-496e-94ec-4665182f3829 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received unexpected event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c for instance with vm_state active and task_state resize_migrating.
Aug 17 18:24:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:05 user nova-compute[72874]: DEBUG nova.network.neutron [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Port d6319754-2bba-45a4-9db3-9fcf99c0c33c binding to destination host user is already ACTIVE {{(pid=72874) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 18:24:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:24:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquired lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:24:05 user nova-compute[72874]: DEBUG nova.network.neutron [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG nova.network.neutron [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updating instance_info_cache with network_info: [{"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Releasing lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG os_brick.utils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c9d78d-9b20-4f59-ab95-2ff5112a3dde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05d9fe2-2949-4c92-854a-07af0ddf9e93]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a83b3b6-9b2a-4cea-a402-be8a79e20d53]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[210cceda-5b7b-4d33-9baa-d1b9c3e42dbc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:24:06 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:24:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8606cd6-c80b-4d52-97b9-9ba1200f456a]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:24:06 user nova-compute[72874]: DEBUG os_brick.utils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:24:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:11 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:24:11 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:24:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:11 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:24:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:24:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:24:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:24:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:24:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:24:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:24:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:15 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:24:15 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:24:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7330MB free_disk=25.31072998046875GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Applying migration context for instance 2ace97e1-c2ee-462e-a929-22c7cb2584d2 as it has an incoming, in-progress migration d05bb49b-d48d-421b-8d68-afb2f6058907. Migration status is post-migrating {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 18:24:15 user nova-compute[72874]: INFO nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updating resource usage from migration d05bb49b-d48d-421b-8d68-afb2f6058907
Aug 17 18:24:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 3a2a5fdd-3a21-413b-981a-ecc33051c87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 857d43f7-6f53-4c82-9e68-fca3078e97ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 544132d3-3dc4-445c-9a63-5f39e50eb34a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c998fa1-9430-4f03-bae7-ce510509a9be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 7044ab36-115d-454b-a787-b3199a815d4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2ee31c9c-6630-4a20-b986-e041951a8522 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance cf9f3116-5e42-4858-a391-ab75d2046f1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Migration d05bb49b-d48d-421b-8d68-afb2f6058907 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2ace97e1-c2ee-462e-a929-22c7cb2584d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:24:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:24:16 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:24:16 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:24:16 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:24:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:17 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296642.546149, 2ace97e1-c2ee-462e-a929-22c7cb2584d2 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:24:17 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] VM Stopped (Lifecycle Event)
Aug 17 18:24:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-7caa934a-1046-491c-9eb4-445b3827800c None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:24:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-7caa934a-1046-491c-9eb4-445b3827800c None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:24:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:17 user nova-compute[72874]: INFO nova.compute.manager [None req-7caa934a-1046-491c-9eb4-445b3827800c None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 18:24:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Starting finish_migration {{(pid=72874) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 18:24:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Instance directory exists: not creating {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 18:24:18 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Creating image(s)
Aug 17 18:24:18 user nova-compute[72874]: DEBUG nova.objects.instance [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2ace97e1-c2ee-462e-a929-22c7cb2584d2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:24:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.254s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:18 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk. size=21474836480 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:24:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk 21474836480 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk 21474836480" returned: 0 in 0.049s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Ensure instance console log exists: /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Start _get_guest_xml network_info=[{"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2007432489-network", "vif_mac": "fa:16:3e:80:58:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJCicowN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2ace97e1-c2ee-462e-a929-22c7cb2584d2', 'attached_at': '2023-08-17T18:24:18.000000', 'detached_at': '', 'volume_id': '19c92b6f-990a-4e2a-97df-5bb870e61913', 'serial': '19c92b6f-990a-4e2a-97df-5bb870e61913'}, 'delete_on_termination': False, 'attachment_id': '362b689d-1727-4937-8fd8-12439779a184', 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:24:19 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:24:19 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.objects.instance [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2ace97e1-c2ee-462e-a929-22c7cb2584d2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJCicowN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:24:19 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:24:19 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:24:19 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[abba9bc7-396b-4c9d-8307-4c5d1c4ce7df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:24:19 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a68adc5-ddeb-4580-841e-883962dc5752]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913] added
Aug 17 18:24:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2906fc07-7e87-4470-871c-b0410b115482]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60d8723-b495-4474-95b3-3696835d9db3]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJCicowN {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJCicowN" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e94ca7a-d1c3-4c00-9888-8f61d0bb249d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DJCicowN'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf3a293-f9f4-466a-b8e3-2cea99123d6d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f91a13-7471-48d0-9138-9c33c220dc5a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:24:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:24:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de8e01b-defe-4d62-a9c3-014177924db1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260]
Aug 17 18:24:19 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260] successful.
Aug 17 18:24:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01ea136-309a-4e7e-8c84-934a106f8f54]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c002ac04-5378-491e-aeca-d45a8c109b46]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:24:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:24:19 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:24:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.428s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] HCTL ('38', '-', '-', 0) found on session 27 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce471a5-b980-46df-b17f-41461cac10e6]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Searching for a device in session 27 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:24:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJCicowN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] <== connect_volume: return (1472ms) {'type': 'block', 'scsi_wwn': '26566643839373337', 'path': '/dev/sdg'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566643839373337', 'path': '/dev/sdg'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1594135899',display_name='tempest-ServerActionsTestOtherB-server-1594135899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1594135899',id=13,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJL0wGDO9yYxM59zaPj86jL9bZvPsFDy3YJOsbSwVi+3h9+DinmjEtIZue1FvAOYIc54lSepvgAxdfqkbFKLJ90/SAHzFU18VdJmA0Lh/YqOsAztJ9gMRfqGTMWDprprBA==',key_name='tempest-keypair-1720427808',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:20:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ad9005fd344e470482b0b90baeb97515',ramdisk_id='',reservation_id='r-5cqpdw10',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1909498304',owner_user_name='tempest-ServerActionsTestOtherB-1909498304-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:24:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31f7828a072847dc9cb4d4fd51908366',uuid=2ace97e1-c2ee-462e-a929-22c7cb2584d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2007432489-network", "vif_mac": "fa:16:3e:80:58:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converting VIF {"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2007432489-network", "vif_mac": "fa:16:3e:80:58:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:24:20 user nova-compute[72874]:   <uuid>2ace97e1-c2ee-462e-a929-22c7cb2584d2</uuid>
Aug 17 18:24:20 user nova-compute[72874]:   <name>instance-0000000d</name>
Aug 17 18:24:20 user nova-compute[72874]:   <memory>2097152</memory>
Aug 17 18:24:20 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:24:20 user nova-compute[72874]:   <metadata>
Aug 17 18:24:20 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:24:20 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:24:20 user nova-compute[72874]:       <nova:name>tempest-ServerActionsTestOtherB-server-1594135899</nova:name>
Aug 17 18:24:20 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:24:19</nova:creationTime>
Aug 17 18:24:20 user nova-compute[72874]:       <nova:flavor name="m1.small">
Aug 17 18:24:20 user nova-compute[72874]:         <nova:memory>2048</nova:memory>
Aug 17 18:24:20 user nova-compute[72874]:         <nova:disk>20</nova:disk>
Aug 17 18:24:20 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:24:20 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:24:20 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:24:20 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:24:20 user nova-compute[72874]:       <nova:owner>
Aug 17 18:24:20 user nova-compute[72874]:         <nova:user uuid="31f7828a072847dc9cb4d4fd51908366">tempest-ServerActionsTestOtherB-1909498304-project-member</nova:user>
Aug 17 18:24:20 user nova-compute[72874]:         <nova:project uuid="ad9005fd344e470482b0b90baeb97515">tempest-ServerActionsTestOtherB-1909498304</nova:project>
Aug 17 18:24:20 user nova-compute[72874]:       </nova:owner>
Aug 17 18:24:20 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:24:20 user nova-compute[72874]:       <nova:ports>
Aug 17 18:24:20 user nova-compute[72874]:         <nova:port uuid="d6319754-2bba-45a4-9db3-9fcf99c0c33c">
Aug 17 18:24:20 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 18:24:20 user nova-compute[72874]:         </nova:port>
Aug 17 18:24:20 user nova-compute[72874]:       </nova:ports>
Aug 17 18:24:20 user nova-compute[72874]:     </nova:instance>
Aug 17 18:24:20 user nova-compute[72874]:   </metadata>
Aug 17 18:24:20 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:24:20 user nova-compute[72874]:     <system>
Aug 17 18:24:20 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:24:20 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:24:20 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:24:20 user nova-compute[72874]:       <entry name="serial">2ace97e1-c2ee-462e-a929-22c7cb2584d2</entry>
Aug 17 18:24:20 user nova-compute[72874]:       <entry name="uuid">2ace97e1-c2ee-462e-a929-22c7cb2584d2</entry>
Aug 17 18:24:20 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:24:20 user nova-compute[72874]:     </system>
Aug 17 18:24:20 user nova-compute[72874]:   </sysinfo>
Aug 17 18:24:20 user nova-compute[72874]:   <os>
Aug 17 18:24:20 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:24:20 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:24:20 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:24:20 user nova-compute[72874]:   </os>
Aug 17 18:24:20 user nova-compute[72874]:   <features>
Aug 17 18:24:20 user nova-compute[72874]:     <acpi/>
Aug 17 18:24:20 user nova-compute[72874]:     <apic/>
Aug 17 18:24:20 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:24:20 user nova-compute[72874]:   </features>
Aug 17 18:24:20 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:24:20 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:24:20 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:24:20 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:24:20 user nova-compute[72874]:   </clock>
Aug 17 18:24:20 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:24:20 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:24:20 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:24:20 user nova-compute[72874]:   </cpu>
Aug 17 18:24:20 user nova-compute[72874]:   <devices>
Aug 17 18:24:20 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:24:20 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:24:20 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk"/>
Aug 17 18:24:20 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:24:20 user nova-compute[72874]:     </disk>
Aug 17 18:24:20 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:24:20 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:24:20 user nova-compute[72874]:       <source dev="/dev/sdg"/>
Aug 17 18:24:20 user nova-compute[72874]:       <target dev="vdb" bus="virtio"/>
Aug 17 18:24:20 user nova-compute[72874]:       <serial>19c92b6f-990a-4e2a-97df-5bb870e61913</serial>
Aug 17 18:24:20 user nova-compute[72874]:     </disk>
Aug 17 18:24:20 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:24:20 user nova-compute[72874]:       <mac address="fa:16:3e:80:58:cc"/>
Aug 17 18:24:20 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:24:20 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:24:20 user nova-compute[72874]:       <target dev="tapd6319754-2b"/>
Aug 17 18:24:20 user nova-compute[72874]:     </interface>
Aug 17 18:24:20 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:24:20 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/console.log" append="off"/>
Aug 17 18:24:20 user nova-compute[72874]:     </serial>
Aug 17 18:24:20 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:24:20 user nova-compute[72874]:     <video>
Aug 17 18:24:20 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:24:20 user nova-compute[72874]:     </video>
Aug 17 18:24:20 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:24:20 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:24:20 user nova-compute[72874]:     </rng>
Aug 17 18:24:20 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:24:20 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:24:20 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:24:20 user nova-compute[72874]:     </memballoon>
Aug 17 18:24:20 user nova-compute[72874]:   </devices>
Aug 17 18:24:20 user nova-compute[72874]: </domain>
Aug 17 18:24:20 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1594135899',display_name='tempest-ServerActionsTestOtherB-server-1594135899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1594135899',id=13,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJL0wGDO9yYxM59zaPj86jL9bZvPsFDy3YJOsbSwVi+3h9+DinmjEtIZue1FvAOYIc54lSepvgAxdfqkbFKLJ90/SAHzFU18VdJmA0Lh/YqOsAztJ9gMRfqGTMWDprprBA==',key_name='tempest-keypair-1720427808',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:20:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ad9005fd344e470482b0b90baeb97515',ramdisk_id='',reservation_id='r-5cqpdw10',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1909498304',owner_user_name='tempest-ServerActionsTestOtherB-1909498304-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:24:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31f7828a072847dc9cb4d4fd51908366',uuid=2ace97e1-c2ee-462e-a929-22c7cb2584d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2007432489-network", "vif_mac": "fa:16:3e:80:58:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converting VIF {"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2007432489-network", "vif_mac": "fa:16:3e:80:58:cc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG os_vif [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6319754-2b, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6319754-2b, col_values=(('external_ids', {'iface-id': 'd6319754-2bba-45a4-9db3-9fcf99c0c33c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:58:cc', 'vm-uuid': '2ace97e1-c2ee-462e-a929-22c7cb2584d2'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:20 user nova-compute[72874]: INFO os_vif [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b')
Aug 17 18:24:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:24:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] No VIF found with MAC fa:16:3e:80:58:cc, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:24:21 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:24:21 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:24:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:24:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:24:21 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:24:21 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Updating instance_info_cache with network_info: [{"id": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "address": "fa:16:3e:3a:30:bb", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17265426-d5", "ovs_interfaceid": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:24:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:24:21 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:24:21 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:24:21 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:24:21 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:24:21 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:24:21 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:24:21 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:24:21 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:24:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:24:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:22 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:24:22 user nova-compute[72874]: INFO nova.compute.claims [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Claim successful on node user
Aug 17 18:24:22 user nova-compute[72874]: DEBUG nova.compute.manager [req-9f6d1f7a-6fd4-47a4-86c8-d002cdf38069 req-273b5b19-b01c-4bfe-997a-dff03abe4e23 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:24:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9f6d1f7a-6fd4-47a4-86c8-d002cdf38069 req-273b5b19-b01c-4bfe-997a-dff03abe4e23 service nova] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9f6d1f7a-6fd4-47a4-86c8-d002cdf38069 req-273b5b19-b01c-4bfe-997a-dff03abe4e23 service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9f6d1f7a-6fd4-47a4-86c8-d002cdf38069 req-273b5b19-b01c-4bfe-997a-dff03abe4e23 service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:22 user nova-compute[72874]: DEBUG nova.compute.manager [req-9f6d1f7a-6fd4-47a4-86c8-d002cdf38069 req-273b5b19-b01c-4bfe-997a-dff03abe4e23 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] No waiting events found dispatching network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:24:22 user nova-compute[72874]: WARNING nova.compute.manager [req-9f6d1f7a-6fd4-47a4-86c8-d002cdf38069 req-273b5b19-b01c-4bfe-997a-dff03abe4e23 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received unexpected event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c for instance with vm_state active and task_state resize_finish.
Aug 17 18:24:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:22 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.681s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG nova.network.neutron [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:24:23 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:24:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG nova.policy [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb48e4d34e494fabbe1af3fd7eef2f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c8770bee784ba5af885002d30db7dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:24:23 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Creating image(s)
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "/opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "/opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "/opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.180s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.242s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk 1073741824" returned: 0 in 0.058s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG nova.network.neutron [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Successfully created port: 3a5303af-3fe8-41ec-a01c-5a0223d20dfa {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.205s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:24:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Cannot resize image /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.objects.instance [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lazy-loading 'migration_context' on Instance uuid e92e565e-c5d9-433e-8c6a-0cb049c000a7 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Ensure instance console log exists: /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-4c27adb4-38be-472a-a087-b0237daf0703 req-9d38fe5f-622a-4609-bc11-1c5529dd8bf8 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4c27adb4-38be-472a-a087-b0237daf0703 req-9d38fe5f-622a-4609-bc11-1c5529dd8bf8 service nova] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4c27adb4-38be-472a-a087-b0237daf0703 req-9d38fe5f-622a-4609-bc11-1c5529dd8bf8 service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4c27adb4-38be-472a-a087-b0237daf0703 req-9d38fe5f-622a-4609-bc11-1c5529dd8bf8 service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-4c27adb4-38be-472a-a087-b0237daf0703 req-9d38fe5f-622a-4609-bc11-1c5529dd8bf8 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] No waiting events found dispatching network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:24:24 user nova-compute[72874]: WARNING nova.compute.manager [req-4c27adb4-38be-472a-a087-b0237daf0703 req-9d38fe5f-622a-4609-bc11-1c5529dd8bf8 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received unexpected event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c for instance with vm_state active and task_state resize_finish.
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296664.6622722, 2ace97e1-c2ee-462e-a929-22c7cb2584d2 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:24:24 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] VM Resumed (Lifecycle Event)
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:24:24 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Instance running successfully.
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Failed to set time: agent not configured {{(pid=72874) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-14773e41-e3f9-41dd-a9fd-7aa82b3929f0 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] finish_migration finished successfully. {{(pid=72874) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Successfully updated port: 3a5303af-3fe8-41ec-a01c-5a0223d20dfa {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:24:24 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296664.6641889, 2ace97e1-c2ee-462e-a929-22c7cb2584d2 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:24:24 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] VM Started (Lifecycle Event)
Aug 17 18:24:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquired lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-568f531e-37f1-431b-ba4d-1a09583fbe32 req-c6459618-68da-4043-ae3a-989f607a3554 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received event network-changed-3a5303af-3fe8-41ec-a01c-5a0223d20dfa {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-568f531e-37f1-431b-ba4d-1a09583fbe32 req-c6459618-68da-4043-ae3a-989f607a3554 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Refreshing instance network info cache due to event network-changed-3a5303af-3fe8-41ec-a01c-5a0223d20dfa. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:24:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-568f531e-37f1-431b-ba4d-1a09583fbe32 req-c6459618-68da-4043-ae3a-989f607a3554 service nova] Acquiring lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:24:24 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 18:24:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.network.neutron [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Updating instance_info_cache with network_info: [{"id": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "address": "fa:16:3e:6d:2e:95", "network": {"id": "d73d605d-c67e-4657-9771-76c2544cbe76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-764769447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5303af-3f", "ovs_interfaceid": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Releasing lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Instance network_info: |[{"id": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "address": "fa:16:3e:6d:2e:95", "network": {"id": "d73d605d-c67e-4657-9771-76c2544cbe76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-764769447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5303af-3f", "ovs_interfaceid": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-568f531e-37f1-431b-ba4d-1a09583fbe32 req-c6459618-68da-4043-ae3a-989f607a3554 service nova] Acquired lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.network.neutron [req-568f531e-37f1-431b-ba4d-1a09583fbe32 req-c6459618-68da-4043-ae3a-989f607a3554 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Refreshing network info cache for port 3a5303af-3fe8-41ec-a01c-5a0223d20dfa {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Start _get_guest_xml network_info=[{"id": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "address": "fa:16:3e:6d:2e:95", "network": {"id": "d73d605d-c67e-4657-9771-76c2544cbe76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-764769447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5303af-3f", "ovs_interfaceid": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:24:25 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:24:25 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784183103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784183103',id=22,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODORGFU372BNdOaIwC88Uz6tubqWS+C4jqGAbM5re2MuHMJFjzHyXf/75k8RdxtFKwcVsHrr4vNfLeqVS5Zfg09lw8vrsW0zlhTritsP1Yjsx1ETqQHCdS8D+8n7979wg==',key_name='tempest-keypair-1258010050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56c8770bee784ba5af885002d30db7dc',ramdisk_id='',reservation_id='r-numhxl95',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-671856852',owner_user_name='tempest-TaggedAttachmentsTest-671856852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48e4d34e494fabbe1af3fd7eef2f76',uuid=e92e565e-c5d9-433e-8c6a-0cb049c000a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "address": "fa:16:3e:6d:2e:95", "network": {"id": "d73d605d-c67e-4657-9771-76c2544cbe76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-764769447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5303af-3f", "ovs_interfaceid": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Converting VIF {"id": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "address": "fa:16:3e:6d:2e:95", "network": {"id": "d73d605d-c67e-4657-9771-76c2544cbe76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-764769447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5303af-3f", "ovs_interfaceid": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:2e:95,bridge_name='br-int',has_traffic_filtering=True,id=3a5303af-3fe8-41ec-a01c-5a0223d20dfa,network=Network(d73d605d-c67e-4657-9771-76c2544cbe76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5303af-3f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.objects.instance [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lazy-loading 'pci_devices' on Instance uuid e92e565e-c5d9-433e-8c6a-0cb049c000a7 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:24:25 user nova-compute[72874]:   <uuid>e92e565e-c5d9-433e-8c6a-0cb049c000a7</uuid>
Aug 17 18:24:25 user nova-compute[72874]:   <name>instance-00000016</name>
Aug 17 18:24:25 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:24:25 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:24:25 user nova-compute[72874]:   <metadata>
Aug 17 18:24:25 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:24:25 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:24:25 user nova-compute[72874]:       <nova:name>tempest-device-tagging-server-1784183103</nova:name>
Aug 17 18:24:25 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:24:25</nova:creationTime>
Aug 17 18:24:25 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:24:25 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:24:25 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:24:25 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:24:25 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:24:25 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:24:25 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:24:25 user nova-compute[72874]:       <nova:owner>
Aug 17 18:24:25 user nova-compute[72874]:         <nova:user uuid="eb48e4d34e494fabbe1af3fd7eef2f76">tempest-TaggedAttachmentsTest-671856852-project-member</nova:user>
Aug 17 18:24:25 user nova-compute[72874]:         <nova:project uuid="56c8770bee784ba5af885002d30db7dc">tempest-TaggedAttachmentsTest-671856852</nova:project>
Aug 17 18:24:25 user nova-compute[72874]:       </nova:owner>
Aug 17 18:24:25 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:24:25 user nova-compute[72874]:       <nova:ports>
Aug 17 18:24:25 user nova-compute[72874]:         <nova:port uuid="3a5303af-3fe8-41ec-a01c-5a0223d20dfa">
Aug 17 18:24:25 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 18:24:25 user nova-compute[72874]:         </nova:port>
Aug 17 18:24:25 user nova-compute[72874]:       </nova:ports>
Aug 17 18:24:25 user nova-compute[72874]:     </nova:instance>
Aug 17 18:24:25 user nova-compute[72874]:   </metadata>
Aug 17 18:24:25 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:24:25 user nova-compute[72874]:     <system>
Aug 17 18:24:25 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:24:25 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:24:25 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:24:25 user nova-compute[72874]:       <entry name="serial">e92e565e-c5d9-433e-8c6a-0cb049c000a7</entry>
Aug 17 18:24:25 user nova-compute[72874]:       <entry name="uuid">e92e565e-c5d9-433e-8c6a-0cb049c000a7</entry>
Aug 17 18:24:25 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:24:25 user nova-compute[72874]:     </system>
Aug 17 18:24:25 user nova-compute[72874]:   </sysinfo>
Aug 17 18:24:25 user nova-compute[72874]:   <os>
Aug 17 18:24:25 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:24:25 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:24:25 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:24:25 user nova-compute[72874]:   </os>
Aug 17 18:24:25 user nova-compute[72874]:   <features>
Aug 17 18:24:25 user nova-compute[72874]:     <acpi/>
Aug 17 18:24:25 user nova-compute[72874]:     <apic/>
Aug 17 18:24:25 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:24:25 user nova-compute[72874]:   </features>
Aug 17 18:24:25 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:24:25 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:24:25 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:24:25 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:24:25 user nova-compute[72874]:   </clock>
Aug 17 18:24:25 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:24:25 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:24:25 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:24:25 user nova-compute[72874]:   </cpu>
Aug 17 18:24:25 user nova-compute[72874]:   <devices>
Aug 17 18:24:25 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:24:25 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:24:25 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk"/>
Aug 17 18:24:25 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:24:25 user nova-compute[72874]:     </disk>
Aug 17 18:24:25 user nova-compute[72874]:     <disk type="file" device="cdrom">
Aug 17 18:24:25 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 18:24:25 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk.config"/>
Aug 17 18:24:25 user nova-compute[72874]:       <target dev="hda" bus="ide"/>
Aug 17 18:24:25 user nova-compute[72874]:     </disk>
Aug 17 18:24:25 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:24:25 user nova-compute[72874]:       <mac address="fa:16:3e:6d:2e:95"/>
Aug 17 18:24:25 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:24:25 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:24:25 user nova-compute[72874]:       <target dev="tap3a5303af-3f"/>
Aug 17 18:24:25 user nova-compute[72874]:     </interface>
Aug 17 18:24:25 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:24:25 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/console.log" append="off"/>
Aug 17 18:24:25 user nova-compute[72874]:     </serial>
Aug 17 18:24:25 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:24:25 user nova-compute[72874]:     <video>
Aug 17 18:24:25 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:24:25 user nova-compute[72874]:     </video>
Aug 17 18:24:25 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:24:25 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:24:25 user nova-compute[72874]:     </rng>
Aug 17 18:24:25 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:24:25 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:24:25 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:24:25 user nova-compute[72874]:     </memballoon>
Aug 17 18:24:25 user nova-compute[72874]:   </devices>
Aug 17 18:24:25 user nova-compute[72874]: </domain>
Aug 17 18:24:25 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784183103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784183103',id=22,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODORGFU372BNdOaIwC88Uz6tubqWS+C4jqGAbM5re2MuHMJFjzHyXf/75k8RdxtFKwcVsHrr4vNfLeqVS5Zfg09lw8vrsW0zlhTritsP1Yjsx1ETqQHCdS8D+8n7979wg==',key_name='tempest-keypair-1258010050',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56c8770bee784ba5af885002d30db7dc',ramdisk_id='',reservation_id='r-numhxl95',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-671856852',owner_user_name='tempest-TaggedAttachmentsTest-671856852-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:24:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48e4d34e494fabbe1af3fd7eef2f76',uuid=e92e565e-c5d9-433e-8c6a-0cb049c000a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "address": "fa:16:3e:6d:2e:95", "network": {"id": "d73d605d-c67e-4657-9771-76c2544cbe76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-764769447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5303af-3f", "ovs_interfaceid": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Converting VIF {"id": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "address": "fa:16:3e:6d:2e:95", "network": {"id": "d73d605d-c67e-4657-9771-76c2544cbe76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-764769447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5303af-3f", "ovs_interfaceid": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:2e:95,bridge_name='br-int',has_traffic_filtering=True,id=3a5303af-3fe8-41ec-a01c-5a0223d20dfa,network=Network(d73d605d-c67e-4657-9771-76c2544cbe76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5303af-3f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG os_vif [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:2e:95,bridge_name='br-int',has_traffic_filtering=True,id=3a5303af-3fe8-41ec-a01c-5a0223d20dfa,network=Network(d73d605d-c67e-4657-9771-76c2544cbe76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5303af-3f') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a5303af-3f, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a5303af-3f, col_values=(('external_ids', {'iface-id': '3a5303af-3fe8-41ec-a01c-5a0223d20dfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:2e:95', 'vm-uuid': 'e92e565e-c5d9-433e-8c6a-0cb049c000a7'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:25 user nova-compute[72874]: INFO os_vif [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:2e:95,bridge_name='br-int',has_traffic_filtering=True,id=3a5303af-3fe8-41ec-a01c-5a0223d20dfa,network=Network(d73d605d-c67e-4657-9771-76c2544cbe76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5303af-3f')
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] No BDM found with device name hda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] No VIF found with MAC fa:16:3e:6d:2e:95, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:24:25 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Using config drive
Aug 17 18:24:25 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Creating config drive at /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk.config
Aug 17 18:24:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9fayakt9 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9fayakt9" returned: 0 in 0.056s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.network.neutron [req-568f531e-37f1-431b-ba4d-1a09583fbe32 req-c6459618-68da-4043-ae3a-989f607a3554 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Updated VIF entry in instance network info cache for port 3a5303af-3fe8-41ec-a01c-5a0223d20dfa. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG nova.network.neutron [req-568f531e-37f1-431b-ba4d-1a09583fbe32 req-c6459618-68da-4043-ae3a-989f607a3554 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Updating instance_info_cache with network_info: [{"id": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "address": "fa:16:3e:6d:2e:95", "network": {"id": "d73d605d-c67e-4657-9771-76c2544cbe76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-764769447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5303af-3f", "ovs_interfaceid": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:24:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-568f531e-37f1-431b-ba4d-1a09583fbe32 req-c6459618-68da-4043-ae3a-989f607a3554 service nova] Releasing lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:24:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-f2f05256-865f-4d0d-8777-98ebbb880c74 req-c8c89896-e70f-4c86-8c0a-a0d73d3ab5ce service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received event network-vif-plugged-3a5303af-3fe8-41ec-a01c-5a0223d20dfa {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:24:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f2f05256-865f-4d0d-8777-98ebbb880c74 req-c8c89896-e70f-4c86-8c0a-a0d73d3ab5ce service nova] Acquiring lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f2f05256-865f-4d0d-8777-98ebbb880c74 req-c8c89896-e70f-4c86-8c0a-a0d73d3ab5ce service nova] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f2f05256-865f-4d0d-8777-98ebbb880c74 req-c8c89896-e70f-4c86-8c0a-a0d73d3ab5ce service nova] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-f2f05256-865f-4d0d-8777-98ebbb880c74 req-c8c89896-e70f-4c86-8c0a-a0d73d3ab5ce service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] No waiting events found dispatching network-vif-plugged-3a5303af-3fe8-41ec-a01c-5a0223d20dfa {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:24:27 user nova-compute[72874]: WARNING nova.compute.manager [req-f2f05256-865f-4d0d-8777-98ebbb880c74 req-c8c89896-e70f-4c86-8c0a-a0d73d3ab5ce service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received unexpected event network-vif-plugged-3a5303af-3fe8-41ec-a01c-5a0223d20dfa for instance with vm_state building and task_state spawning.
Aug 17 18:24:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-308d7c46-fc28-4fbd-b5e2-8c198fffcec1 req-1d059756-31d8-49aa-a604-a25c1d6132db service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received event network-vif-plugged-3a5303af-3fe8-41ec-a01c-5a0223d20dfa {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:24:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-308d7c46-fc28-4fbd-b5e2-8c198fffcec1 req-1d059756-31d8-49aa-a604-a25c1d6132db service nova] Acquiring lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-308d7c46-fc28-4fbd-b5e2-8c198fffcec1 req-1d059756-31d8-49aa-a604-a25c1d6132db service nova] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-308d7c46-fc28-4fbd-b5e2-8c198fffcec1 req-1d059756-31d8-49aa-a604-a25c1d6132db service nova] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-308d7c46-fc28-4fbd-b5e2-8c198fffcec1 req-1d059756-31d8-49aa-a604-a25c1d6132db service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] No waiting events found dispatching network-vif-plugged-3a5303af-3fe8-41ec-a01c-5a0223d20dfa {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:24:29 user nova-compute[72874]: WARNING nova.compute.manager [req-308d7c46-fc28-4fbd-b5e2-8c198fffcec1 req-1d059756-31d8-49aa-a604-a25c1d6132db service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received unexpected event network-vif-plugged-3a5303af-3fe8-41ec-a01c-5a0223d20dfa for instance with vm_state building and task_state spawning.
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296669.2535157, e92e565e-c5d9-433e-8c6a-0cb049c000a7 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:24:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] VM Resumed (Lifecycle Event)
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:24:29 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Instance spawned successfully.
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:24:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296669.2547748, e92e565e-c5d9-433e-8c6a-0cb049c000a7 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:24:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] VM Started (Lifecycle Event)
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:24:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:24:29 user nova-compute[72874]: INFO nova.compute.manager [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 17 18:24:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:24:29 user nova-compute[72874]: INFO nova.compute.manager [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Took 7.11 seconds to build instance.
Aug 17 18:24:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6688ef8d-af93-427f-9667-5827df8f0a3f tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.245s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-9465678b-0865-4e2c-8b3f-e2566352e4d8 req-95cde0c5-7cf9-4491-b510-7ac67c23bf18 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Received event network-changed-733196aa-d083-4db2-a729-9e43b83eecdd {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:24:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-9465678b-0865-4e2c-8b3f-e2566352e4d8 req-95cde0c5-7cf9-4491-b510-7ac67c23bf18 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Refreshing instance network info cache due to event network-changed-733196aa-d083-4db2-a729-9e43b83eecdd. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:24:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9465678b-0865-4e2c-8b3f-e2566352e4d8 req-95cde0c5-7cf9-4491-b510-7ac67c23bf18 service nova] Acquiring lock "refresh_cache-544132d3-3dc4-445c-9a63-5f39e50eb34a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:24:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9465678b-0865-4e2c-8b3f-e2566352e4d8 req-95cde0c5-7cf9-4491-b510-7ac67c23bf18 service nova] Acquired lock "refresh_cache-544132d3-3dc4-445c-9a63-5f39e50eb34a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:24:35 user nova-compute[72874]: DEBUG nova.network.neutron [req-9465678b-0865-4e2c-8b3f-e2566352e4d8 req-95cde0c5-7cf9-4491-b510-7ac67c23bf18 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Refreshing network info cache for port 733196aa-d083-4db2-a729-9e43b83eecdd {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "544132d3-3dc4-445c-9a63-5f39e50eb34a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG nova.objects.instance [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lazy-loading 'flavor' on Instance uuid 544132d3-3dc4-445c-9a63-5f39e50eb34a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:24:36 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Ignoring supplied device name: /dev/vdb
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "544132d3-3dc4-445c-9a63-5f39e50eb34a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:24:36 user nova-compute[72874]: INFO nova.compute.manager [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Attaching volume 4e9d4577-e32c-48c6-8c40-4eb8956842fc to /dev/vdb
Aug 17 18:24:36 user nova-compute[72874]: DEBUG os_brick.utils [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f312f1e3-0453-4fea-ac29-4524ca475f7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45e4aa7-5d2b-41f0-b0bc-3ad297d3e367]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b0e053-5aa2-4edf-af90-f68f554d70ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dbac86-b6c9-406a-a910-2dd341cabae4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:24:36 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6daac2d-aec9-4118-bc28-cd5d2c39904b]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG os_brick.utils [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Updating existing volume attachment record: 24d20d93-3a25-4001-93cd-ec10d88de522 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG nova.network.neutron [req-9465678b-0865-4e2c-8b3f-e2566352e4d8 req-95cde0c5-7cf9-4491-b510-7ac67c23bf18 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Updated VIF entry in instance network info cache for port 733196aa-d083-4db2-a729-9e43b83eecdd. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG nova.network.neutron [req-9465678b-0865-4e2c-8b3f-e2566352e4d8 req-95cde0c5-7cf9-4491-b510-7ac67c23bf18 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Updating instance_info_cache with network_info: [{"id": "733196aa-d083-4db2-a729-9e43b83eecdd", "address": "fa:16:3e:05:14:91", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733196aa-d0", "ovs_interfaceid": "733196aa-d083-4db2-a729-9e43b83eecdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:24:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9465678b-0865-4e2c-8b3f-e2566352e4d8 req-95cde0c5-7cf9-4491-b510-7ac67c23bf18 service nova] Releasing lock "refresh_cache-544132d3-3dc4-445c-9a63-5f39e50eb34a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:24:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaSRlfLQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:24:48 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:24:48 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:24:48 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd411906-5ecc-4ae8-b6da-c3de6abd0edc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:24:48 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1b5a18-83c1-40de-890b-4b944cb5f5c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc] added
Aug 17 18:24:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1719b1-dc24-4f4d-98f9-952a883c0850]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[da01237c-1e64-4f5d-a30d-60f5f0f3ef46]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WaSRlfLQ {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WaSRlfLQ" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b8d8e8-db18-415c-afd1-b26730f89e8b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WaSRlfLQ'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.062s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c581c6e-bb9a-41b6-a01e-903f17b332f5]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[79761250-3273-4628-abf8-3c0439f50544]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:24:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:24:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[308864cd-3eeb-40b2-a01d-463769f7adf3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc, portal: 172.16.0.220,3260]
Aug 17 18:24:48 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc, portal: 172.16.0.220,3260] successful.
Aug 17 18:24:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6701ecbc-0a75-4a4d-a70b-ea04fc11ea44]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[40359624-6c44-4a0f-9d05-7c4d532cdf3e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc (non-flash)
Aug 17 18:24:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:24:48 user nova-compute[72874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc (non-flash)
Aug 17 18:24:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] HCTL ('39', '-', '-', 0) found on session 28 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8187b4f-fa6d-4898-9d3e-57485bbeb5b2]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Searching for a device in session 28 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:24:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaSRlfLQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:24:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:24:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '26437343463653666', 'path': '/dev/sdh'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:24:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437343463653666', 'path': '/dev/sdh'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:24:49 user nova-compute[72874]: DEBUG nova.objects.instance [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lazy-loading 'flavor' on Instance uuid 544132d3-3dc4-445c-9a63-5f39e50eb34a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:24:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:24:50 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:24:50 user nova-compute[72874]:   <source dev="/dev/sdh"/>
Aug 17 18:24:50 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:24:50 user nova-compute[72874]:   <serial>4e9d4577-e32c-48c6-8c40-4eb8956842fc</serial>
Aug 17 18:24:50 user nova-compute[72874]: </disk>
Aug 17 18:24:50 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:24:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:24:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:24:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] No VIF found with MAC fa:16:3e:05:14:91, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:24:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a163bbcb-9c1a-4459-8f00-7cdc32296d9e tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.242s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:24:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:24:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:25:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:03 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:25:03 user nova-compute[72874]: INFO nova.compute.claims [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Claim successful on node user
Aug 17 18:25:04 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:25:04 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:25:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:25:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:25:04 user nova-compute[72874]: DEBUG nova.network.neutron [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:25:04 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:25:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:25:04 user nova-compute[72874]: INFO nova.virt.block_device [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Booting with blank volume at /dev/vda
Aug 17 18:25:04 user nova-compute[72874]: DEBUG nova.policy [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd13289795c8b4991a9cf6bb2880ad6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a550f3591d1347bf8b9fb4d3e90b8aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:25:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:25:05 user nova-compute[72874]: DEBUG nova.network.neutron [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Successfully created port: 2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:25:06 user nova-compute[72874]: DEBUG nova.network.neutron [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Successfully updated port: 2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:25:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:25:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquired lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:25:06 user nova-compute[72874]: DEBUG nova.network.neutron [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:25:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-90135ccd-34f3-4b16-8ee0-7afaa92d55c8 req-6eb81140-e90a-412e-8c1d-a6837a742517 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received event network-changed-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-90135ccd-34f3-4b16-8ee0-7afaa92d55c8 req-6eb81140-e90a-412e-8c1d-a6837a742517 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Refreshing instance network info cache due to event network-changed-2d5c5445-861c-412b-8929-030ec72e68fb. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:25:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-90135ccd-34f3-4b16-8ee0-7afaa92d55c8 req-6eb81140-e90a-412e-8c1d-a6837a742517 service nova] Acquiring lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:25:06 user nova-compute[72874]: DEBUG nova.network.neutron [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:25:06 user nova-compute[72874]: DEBUG nova.network.neutron [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Updating instance_info_cache with network_info: [{"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:25:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Releasing lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:25:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Instance network_info: |[{"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:25:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-90135ccd-34f3-4b16-8ee0-7afaa92d55c8 req-6eb81140-e90a-412e-8c1d-a6837a742517 service nova] Acquired lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:25:06 user nova-compute[72874]: DEBUG nova.network.neutron [req-90135ccd-34f3-4b16-8ee0-7afaa92d55c8 req-6eb81140-e90a-412e-8c1d-a6837a742517 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Refreshing network info cache for port 2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:25:07 user nova-compute[72874]: DEBUG nova.network.neutron [req-90135ccd-34f3-4b16-8ee0-7afaa92d55c8 req-6eb81140-e90a-412e-8c1d-a6837a742517 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Updated VIF entry in instance network info cache for port 2d5c5445-861c-412b-8929-030ec72e68fb. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:25:07 user nova-compute[72874]: DEBUG nova.network.neutron [req-90135ccd-34f3-4b16-8ee0-7afaa92d55c8 req-6eb81140-e90a-412e-8c1d-a6837a742517 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Updating instance_info_cache with network_info: [{"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:25:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-90135ccd-34f3-4b16-8ee0-7afaa92d55c8 req-6eb81140-e90a-412e-8c1d-a6837a742517 service nova] Releasing lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG os_brick.utils [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb35d7cf-a323-485b-a6e4-0b886491abbf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8e2e89-657b-499a-9e23-d4b5e3dcd118]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e841c57-9931-4a4a-bcd8-cb963b5d24e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31e0d00-ad37-43a0-a21f-81f2bf4749b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:25:10 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:25:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b087c83-653f-4e6e-a625-ff0550797edb]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG os_brick.utils [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Updating existing volume attachment record: 7c73e30d-2092-4c0f-8c65-07039ddae22c {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:25:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:13 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:25:13 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:25:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:13 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:25:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:25:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:25:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:25:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:16 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:25:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:25:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:25:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:25:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:25:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:18 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:25:18 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7014MB free_disk=25.267330169677734GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Applying migration context for instance 2ace97e1-c2ee-462e-a929-22c7cb2584d2 as it has an incoming, in-progress migration d05bb49b-d48d-421b-8d68-afb2f6058907. Migration status is finished {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 18:25:18 user nova-compute[72874]: INFO nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updating resource usage from migration d05bb49b-d48d-421b-8d68-afb2f6058907
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 3a2a5fdd-3a21-413b-981a-ecc33051c87b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 857d43f7-6f53-4c82-9e68-fca3078e97ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 544132d3-3dc4-445c-9a63-5f39e50eb34a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c998fa1-9430-4f03-bae7-ce510509a9be actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 7044ab36-115d-454b-a787-b3199a815d4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2ee31c9c-6630-4a20-b986-e041951a8522 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance cf9f3116-5e42-4858-a391-ab75d2046f1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Migration d05bb49b-d48d-421b-8d68-afb2f6058907 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2ace97e1-c2ee-462e-a929-22c7cb2584d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance e92e565e-c5d9-433e-8c6a-0cb049c000a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:25:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.558s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "7044ab36-115d-454b-a787-b3199a815d4e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "7044ab36-115d-454b-a787-b3199a815d4e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG nova.objects.instance [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lazy-loading 'flavor' on Instance uuid 7044ab36-115d-454b-a787-b3199a815d4e {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "7044ab36-115d-454b-a787-b3199a815d4e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "7044ab36-115d-454b-a787-b3199a815d4e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "7044ab36-115d-454b-a787-b3199a815d4e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:19 user nova-compute[72874]: INFO nova.compute.manager [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Attaching volume 1fe692cf-c1a3-436b-b8cc-ba7ef85f1c40 to /dev/vdb
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:19 user nova-compute[72874]: INFO nova.compute.manager [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Detaching volume 4a51f77d-20d8-47d0-b4b9-92bed472f30a
Aug 17 18:25:19 user nova-compute[72874]: DEBUG os_brick.utils [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b2f40c-e1d2-4cca-b5fb-5bead18c3f24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[641a4a2b-52f4-4174-be7c-af9033ab41c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0309d084-5f4a-4ac4-8748-2c25f98ae940]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca55bdc-1a2f-4ea2-a26e-8e47ff23da04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:25:19 user nova-compute[72874]: INFO nova.virt.block_device [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Attempting to driver detach volume 4a51f77d-20d8-47d0-b4b9-92bed472f30a from mountpoint /dev/vdb
Aug 17 18:25:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Attempting to detach device vdb from instance 3a2a5fdd-3a21-413b-981a-ecc33051c87b from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:25:19 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:25:19 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 18:25:19 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:25:19 user nova-compute[72874]:   <serial>4a51f77d-20d8-47d0-b4b9-92bed472f30a</serial>
Aug 17 18:25:19 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 18:25:19 user nova-compute[72874]: </disk>
Aug 17 18:25:19 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:25:19 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:25:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6744e4f-c498-445e-ad4c-e9d09f5a15c9]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG os_brick.utils [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Updating existing volume attachment record: e806d042-2b36-43d0-9f9e-47a027860a53 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:25:19 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Successfully detached device vdb from instance 3a2a5fdd-3a21-413b-981a-ecc33051c87b from the persistent domain config.
Aug 17 18:25:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a2a5fdd-3a21-413b-981a-ecc33051c87b from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:25:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:25:19 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:25:19 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 18:25:19 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:25:19 user nova-compute[72874]:   <serial>4a51f77d-20d8-47d0-b4b9-92bed472f30a</serial>
Aug 17 18:25:19 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 18:25:19 user nova-compute[72874]: </disk>
Aug 17 18:25:19 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692296720.3178105, 3a2a5fdd-3a21-413b-981a-ecc33051c87b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a2a5fdd-3a21-413b-981a-ecc33051c87b {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:25:20 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Successfully detached device vdb from instance 3a2a5fdd-3a21-413b-981a-ecc33051c87b from the live domain config.
Aug 17 18:25:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdqhSUaC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:25:20 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2a5d7f-ffa3-45fb-a31d-ef5528171bc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a3ea1c-c62b-40b1-b4d1-11d2301babcf]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:25:20 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:20 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:20 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:25:20 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:25:20 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:25:20 user nova-compute[72874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc (non-flash)
Aug 17 18:25:20 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a (non-flash)
Aug 17 18:25:20 user nova-compute[72874]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:20 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:20 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:25:20 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:25:20 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:25:20 user nova-compute[72874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc (non-flash)
Aug 17 18:25:20 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c05d1900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc09f396-8934-4425-8022-9f0ce675b9fa]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9556ad41-93b6-40c2-9972-90ce293d9002]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c5a53c-870f-41e3-9e70-d0e90b8b83ef]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a495c272-173d-40cc-aafb-1934406419bb]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d7308f-d9ad-4572-a24c-d45bd6e580d4]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65a05d6-9afd-4c95-81ea-883269df9f91]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a, portal: 172.16.0.220,3260]
Aug 17 18:25:20 user nova-compute[72874]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a, portal: 172.16.0.220,3260] successful.
Aug 17 18:25:20 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0563d7a1-d7d1-47d6-8072-517001e5f069]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] <== disconnect_volume: return (357ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:25:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:25:21 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:25:21 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:25:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:25:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:25:21 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:25:22 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updating instance_info_cache with network_info: [{"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:25:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:25:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:25:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:25:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:25:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:25:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:25:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:25:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:25:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:25:23 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Creating image(s)
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Ensure instance console log exists: /opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Start _get_guest_xml network_info=[{"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxjuHieG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2961b0b8-98d0-4ba5-a0fa-b719753589ea', 'attached_at': '', 'detached_at': '', 'volume_id': '8c51cc2b-ba5d-4ed0-818d-17bad96f23b3', 'serial': '8c51cc2b-ba5d-4ed0-818d-17bad96f23b3'}, 'delete_on_termination': False, 'attachment_id': '7c73e30d-2092-4c0f-8c65-07039ddae22c', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:25:23 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:25:23 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxjuHieG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:25:23 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:25:23 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:25:23 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df7241-6305-479a-a90f-0cee7af103b5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:25:23 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2602201f-c999-4876-8d9a-99fcceed0f42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3] added
Aug 17 18:25:23 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[29272962-165a-4927-83f3-f6b0dbcf4012]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[57575777-3bab-461c-af74-ae2e38bea957]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxjuHieG {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxjuHieG" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0589ed5-eb18-4e82-a022-abe7eb600ba9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wxjuHieG'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7374dd7-b670-4c45-9db1-5b3ef510d52b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b080d35-ad22-41de-9408-39658bbdbecd]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc (non-flash)
Aug 17 18:25:23 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc (non-flash)
Aug 17 18:25:23 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba612ac-f41b-4673-bbb2-9179c0caf25e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3, portal: 172.16.0.220,3260]
Aug 17 18:25:23 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3, portal: 172.16.0.220,3260] successful.
Aug 17 18:25:23 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c325d07-5a86-4429-88fe-52fdb68386b6]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1ac1c8-c476-40cb-9c13-4af5b2d7005c]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc (non-flash)
Aug 17 18:25:23 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:25:23 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.031s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7117cab2-f58f-4c80-a3ec-93956209557d]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:23 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxjuHieG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23436623063613861', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436623063613861', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-584565083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-584565083',id=23,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a550f3591d1347bf8b9fb4d3e90b8aad',ramdisk_id='',reservation_id='r-7lqgm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-68498997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:25:04Z,user_data=None,user_id='d13289795c8b4991a9cf6bb2880ad6ef',uuid=2961b0b8-98d0-4ba5-a0fa-b719753589ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converting VIF {"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:02:9b,bridge_name='br-int',has_traffic_filtering=True,id=2d5c5445-861c-412b-8929-030ec72e68fb,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5c5445-86') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'pci_devices' on Instance uuid 2961b0b8-98d0-4ba5-a0fa-b719753589ea {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:25:24 user nova-compute[72874]:   <uuid>2961b0b8-98d0-4ba5-a0fa-b719753589ea</uuid>
Aug 17 18:25:24 user nova-compute[72874]:   <name>instance-00000017</name>
Aug 17 18:25:24 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:25:24 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:25:24 user nova-compute[72874]:   <metadata>
Aug 17 18:25:24 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:25:24 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:25:24 user nova-compute[72874]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-584565083</nova:name>
Aug 17 18:25:24 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:25:23</nova:creationTime>
Aug 17 18:25:24 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:25:24 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:25:24 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:25:24 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:25:24 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:25:24 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:25:24 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:25:24 user nova-compute[72874]:       <nova:owner>
Aug 17 18:25:24 user nova-compute[72874]:         <nova:user uuid="d13289795c8b4991a9cf6bb2880ad6ef">tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member</nova:user>
Aug 17 18:25:24 user nova-compute[72874]:         <nova:project uuid="a550f3591d1347bf8b9fb4d3e90b8aad">tempest-ServerBootFromVolumeStableRescueTest-68498997</nova:project>
Aug 17 18:25:24 user nova-compute[72874]:       </nova:owner>
Aug 17 18:25:24 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:25:24 user nova-compute[72874]:       <nova:ports>
Aug 17 18:25:24 user nova-compute[72874]:         <nova:port uuid="2d5c5445-861c-412b-8929-030ec72e68fb">
Aug 17 18:25:24 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 18:25:24 user nova-compute[72874]:         </nova:port>
Aug 17 18:25:24 user nova-compute[72874]:       </nova:ports>
Aug 17 18:25:24 user nova-compute[72874]:     </nova:instance>
Aug 17 18:25:24 user nova-compute[72874]:   </metadata>
Aug 17 18:25:24 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:25:24 user nova-compute[72874]:     <system>
Aug 17 18:25:24 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:25:24 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:25:24 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:25:24 user nova-compute[72874]:       <entry name="serial">2961b0b8-98d0-4ba5-a0fa-b719753589ea</entry>
Aug 17 18:25:24 user nova-compute[72874]:       <entry name="uuid">2961b0b8-98d0-4ba5-a0fa-b719753589ea</entry>
Aug 17 18:25:24 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:25:24 user nova-compute[72874]:     </system>
Aug 17 18:25:24 user nova-compute[72874]:   </sysinfo>
Aug 17 18:25:24 user nova-compute[72874]:   <os>
Aug 17 18:25:24 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:25:24 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:25:24 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:25:24 user nova-compute[72874]:   </os>
Aug 17 18:25:24 user nova-compute[72874]:   <features>
Aug 17 18:25:24 user nova-compute[72874]:     <acpi/>
Aug 17 18:25:24 user nova-compute[72874]:     <apic/>
Aug 17 18:25:24 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:25:24 user nova-compute[72874]:   </features>
Aug 17 18:25:24 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:25:24 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:25:24 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:25:24 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:25:24 user nova-compute[72874]:   </clock>
Aug 17 18:25:24 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:25:24 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:25:24 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:25:24 user nova-compute[72874]:   </cpu>
Aug 17 18:25:24 user nova-compute[72874]:   <devices>
Aug 17 18:25:24 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:25:24 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:25:24 user nova-compute[72874]:       <source dev="/dev/sdb"/>
Aug 17 18:25:24 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:25:24 user nova-compute[72874]:       <serial>8c51cc2b-ba5d-4ed0-818d-17bad96f23b3</serial>
Aug 17 18:25:24 user nova-compute[72874]:     </disk>
Aug 17 18:25:24 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:25:24 user nova-compute[72874]:       <mac address="fa:16:3e:3d:02:9b"/>
Aug 17 18:25:24 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:25:24 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:25:24 user nova-compute[72874]:       <target dev="tap2d5c5445-86"/>
Aug 17 18:25:24 user nova-compute[72874]:     </interface>
Aug 17 18:25:24 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:25:24 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/console.log" append="off"/>
Aug 17 18:25:24 user nova-compute[72874]:     </serial>
Aug 17 18:25:24 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:25:24 user nova-compute[72874]:     <video>
Aug 17 18:25:24 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:25:24 user nova-compute[72874]:     </video>
Aug 17 18:25:24 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:25:24 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:25:24 user nova-compute[72874]:     </rng>
Aug 17 18:25:24 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:25:24 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:25:24 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:25:24 user nova-compute[72874]:     </memballoon>
Aug 17 18:25:24 user nova-compute[72874]:   </devices>
Aug 17 18:25:24 user nova-compute[72874]: </domain>
Aug 17 18:25:24 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-584565083',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-584565083',id=23,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a550f3591d1347bf8b9fb4d3e90b8aad',ramdisk_id='',reservation_id='r-7lqgm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-68498997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:25:04Z,user_data=None,user_id='d13289795c8b4991a9cf6bb2880ad6ef',uuid=2961b0b8-98d0-4ba5-a0fa-b719753589ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converting VIF {"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:02:9b,bridge_name='br-int',has_traffic_filtering=True,id=2d5c5445-861c-412b-8929-030ec72e68fb,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5c5445-86') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG os_vif [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:02:9b,bridge_name='br-int',has_traffic_filtering=True,id=2d5c5445-861c-412b-8929-030ec72e68fb,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5c5445-86') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d5c5445-86, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2d5c5445-86, col_values=(('external_ids', {'iface-id': '2d5c5445-861c-412b-8929-030ec72e68fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:02:9b', 'vm-uuid': '2961b0b8-98d0-4ba5-a0fa-b719753589ea'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:24 user nova-compute[72874]: INFO os_vif [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:02:9b,bridge_name='br-int',has_traffic_filtering=True,id=2d5c5445-861c-412b-8929-030ec72e68fb,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5c5445-86')
Aug 17 18:25:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:25:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] No VIF found with MAC fa:16:3e:3d:02:9b, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:25:25 user nova-compute[72874]: DEBUG nova.objects.instance [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'flavor' on Instance uuid 3a2a5fdd-3a21-413b-981a-ecc33051c87b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:25:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-51094941-da75-484d-aed1-ca8efde8e363 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.681s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.volume.cinder [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Update attachment failed for attachment e806d042-2b36-43d0-9f9e-47a027860a53. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1fe692cf-c1a3-436b-b8cc-ba7ef85f1c40 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:1fe692cf-c1a3-436b-b8cc-ba7ef85f1c40/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a was not found.).). (HTTP 500) (Request-ID: req-e580ea41-b29b-40ee-8b4e-17803e75ce00) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1fe692cf-c1a3-436b-b8cc-ba7ef85f1c40 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:1fe692cf-c1a3-436b-b8cc-ba7ef85f1c40/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a was not found.).). (HTTP 500) (Request-ID: req-e580ea41-b29b-40ee-8b4e-17803e75ce00)
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Failed to attach 1fe692cf-c1a3-436b-b8cc-ba7ef85f1c40 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1fe692cf-c1a3-436b-b8cc-ba7ef85f1c40 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:1fe692cf-c1a3-436b-b8cc-ba7ef85f1c40/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a was not found.).). (HTTP 500) (Request-ID: req-e580ea41-b29b-40ee-8b4e-17803e75ce00)
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Traceback (most recent call last):
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     ret_val = method(obj, context, *args, **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     self._do_attach(context, instance, volume, volume_api,
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     self._volume_attach(context, volume, connector, instance,
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     connection_info = volume_api.attachment_update(
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     res = method(self, ctx, *args, **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     with excutils.save_and_reraise_exception():
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     self.force_reraise()
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     raise self.value
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     context, '3.44', skip_version_check=True).attachments.update(
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     return method.func(obj, *args, **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     resp = self._update('/attachments/%s' % id, body)
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     return self._cs_request(url, 'PUT', **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     return self.request(url, method, **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e]     raise exceptions.from_response(resp, body)
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1fe692cf-c1a3-436b-b8cc-ba7ef85f1c40 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:1fe692cf-c1a3-436b-b8cc-ba7ef85f1c40/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a was not found.).). (HTTP 500) (Request-ID: req-e580ea41-b29b-40ee-8b4e-17803e75ce00)
Aug 17 18:25:25 user nova-compute[72874]: ERROR nova.compute.manager [instance: 7044ab36-115d-454b-a787-b3199a815d4e] 
Aug 17 18:25:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "7044ab36-115d-454b-a787-b3199a815d4e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.118s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server [None req-8acfa39b-ef83-4d1b-bc93-44760410fe86 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1fe692cf-c1a3-436b-b8cc-ba7ef85f1c40 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:1fe692cf-c1a3-436b-b8cc-ba7ef85f1c40/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a was not found.).). (HTTP 500) (Request-ID: req-e580ea41-b29b-40ee-8b4e-17803e75ce00)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:1fe692cf-c1a3-436b-b8cc-ba7ef85f1c40 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:1fe692cf-c1a3-436b-b8cc-ba7ef85f1c40/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:4a51f77d-20d8-47d0-b4b9-92bed472f30a was not found.).). (HTTP 500) (Request-ID: req-e580ea41-b29b-40ee-8b4e-17803e75ce00)
Aug 17 18:25:25 user nova-compute[72874]: ERROR oslo_messaging.rpc.server 
Aug 17 18:25:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-6ba4e61a-f89b-4d69-aba8-49c9ca6e550b req-4772f7b7-ff94-40ac-bcb7-438fa7476fb7 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6ba4e61a-f89b-4d69-aba8-49c9ca6e550b req-4772f7b7-ff94-40ac-bcb7-438fa7476fb7 service nova] Acquiring lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6ba4e61a-f89b-4d69-aba8-49c9ca6e550b req-4772f7b7-ff94-40ac-bcb7-438fa7476fb7 service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6ba4e61a-f89b-4d69-aba8-49c9ca6e550b req-4772f7b7-ff94-40ac-bcb7-438fa7476fb7 service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-6ba4e61a-f89b-4d69-aba8-49c9ca6e550b req-4772f7b7-ff94-40ac-bcb7-438fa7476fb7 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] No waiting events found dispatching network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:26 user nova-compute[72874]: WARNING nova.compute.manager [req-6ba4e61a-f89b-4d69-aba8-49c9ca6e550b req-4772f7b7-ff94-40ac-bcb7-438fa7476fb7 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received unexpected event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb for instance with vm_state building and task_state spawning.
Aug 17 18:25:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-1e6e7d9f-a21e-439a-90e5-ebeb039a4f5b req-204508e9-430d-4550-ac74-1fdf26d11401 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Received event network-changed-beda2544-577f-4426-9393-9dccda2812fc {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-1e6e7d9f-a21e-439a-90e5-ebeb039a4f5b req-204508e9-430d-4550-ac74-1fdf26d11401 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Refreshing instance network info cache due to event network-changed-beda2544-577f-4426-9393-9dccda2812fc. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:25:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1e6e7d9f-a21e-439a-90e5-ebeb039a4f5b req-204508e9-430d-4550-ac74-1fdf26d11401 service nova] Acquiring lock "refresh_cache-2ee31c9c-6630-4a20-b986-e041951a8522" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:25:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1e6e7d9f-a21e-439a-90e5-ebeb039a4f5b req-204508e9-430d-4550-ac74-1fdf26d11401 service nova] Acquired lock "refresh_cache-2ee31c9c-6630-4a20-b986-e041951a8522" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:25:27 user nova-compute[72874]: DEBUG nova.network.neutron [req-1e6e7d9f-a21e-439a-90e5-ebeb039a4f5b req-204508e9-430d-4550-ac74-1fdf26d11401 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Refreshing network info cache for port beda2544-577f-4426-9393-9dccda2812fc {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "2ee31c9c-6630-4a20-b986-e041951a8522" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "2ee31c9c-6630-4a20-b986-e041951a8522" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "2ee31c9c-6630-4a20-b986-e041951a8522-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "2ee31c9c-6630-4a20-b986-e041951a8522-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "2ee31c9c-6630-4a20-b986-e041951a8522-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:28 user nova-compute[72874]: INFO nova.compute.manager [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Terminating instance
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296728.3396378, 2961b0b8-98d0-4ba5-a0fa-b719753589ea => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:25:28 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] VM Resumed (Lifecycle Event)
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.network.neutron [req-1e6e7d9f-a21e-439a-90e5-ebeb039a4f5b req-204508e9-430d-4550-ac74-1fdf26d11401 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Updated VIF entry in instance network info cache for port beda2544-577f-4426-9393-9dccda2812fc. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.network.neutron [req-1e6e7d9f-a21e-439a-90e5-ebeb039a4f5b req-204508e9-430d-4550-ac74-1fdf26d11401 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Updating instance_info_cache with network_info: [{"id": "beda2544-577f-4426-9393-9dccda2812fc", "address": "fa:16:3e:fa:38:d3", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeda2544-57", "ovs_interfaceid": "beda2544-577f-4426-9393-9dccda2812fc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:25:28 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Instance spawned successfully.
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1e6e7d9f-a21e-439a-90e5-ebeb039a4f5b req-204508e9-430d-4550-ac74-1fdf26d11401 service nova] Releasing lock "refresh_cache-2ee31c9c-6630-4a20-b986-e041951a8522" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:25:28 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296728.3476605, 2961b0b8-98d0-4ba5-a0fa-b719753589ea => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:25:28 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] VM Started (Lifecycle Event)
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.compute.manager [req-4e00f99d-64c5-484c-b0bb-8a2fea0746d7 req-193d164c-ec92-4fa8-a9b8-67ffdcded41e service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4e00f99d-64c5-484c-b0bb-8a2fea0746d7 req-193d164c-ec92-4fa8-a9b8-67ffdcded41e service nova] Acquiring lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4e00f99d-64c5-484c-b0bb-8a2fea0746d7 req-193d164c-ec92-4fa8-a9b8-67ffdcded41e service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4e00f99d-64c5-484c-b0bb-8a2fea0746d7 req-193d164c-ec92-4fa8-a9b8-67ffdcded41e service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.compute.manager [req-4e00f99d-64c5-484c-b0bb-8a2fea0746d7 req-193d164c-ec92-4fa8-a9b8-67ffdcded41e service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] No waiting events found dispatching network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:28 user nova-compute[72874]: WARNING nova.compute.manager [req-4e00f99d-64c5-484c-b0bb-8a2fea0746d7 req-193d164c-ec92-4fa8-a9b8-67ffdcded41e service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received unexpected event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb for instance with vm_state building and task_state spawning.
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:28 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:25:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:28 user nova-compute[72874]: INFO nova.compute.manager [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Took 5.24 seconds to spawn the instance on the hypervisor.
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:25:28 user nova-compute[72874]: INFO nova.compute.manager [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Took 24.83 seconds to build instance.
Aug 17 18:25:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e297495a-57e6-487d-9837-f4b3e9a555bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.944s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:28 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Instance destroyed successfully.
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.objects.instance [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'resources' on Instance uuid 2ee31c9c-6630-4a20-b986-e041951a8522 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:23:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1707464321',display_name='tempest-AttachVolumeNegativeTest-server-1707464321',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1707464321',id=20,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIJ/B7PBGROD8GDVWnTOKYFa2ugUYgKiBxlcmmbyOjQ1z5mkIkLZlE64mFT44HITrfGAnsJxScuDyqbu8a3arGzNcs71mLEZHQoqWyUM7Kqan9Xc9LmWoVUbl1ZGf7rWIQ==',key_name='tempest-keypair-1462900200',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:23:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d44ed4bf46e4f6bb8d9f9255bfceded',ramdisk_id='',reservation_id='r-oiyhb50y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1092460488',owner_user_name='tempest-AttachVolumeNegativeTest-1092460488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:23:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eba99d36a842ca93af2d82be67dea1',uuid=2ee31c9c-6630-4a20-b986-e041951a8522,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "beda2544-577f-4426-9393-9dccda2812fc", "address": "fa:16:3e:fa:38:d3", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeda2544-57", "ovs_interfaceid": "beda2544-577f-4426-9393-9dccda2812fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converting VIF {"id": "beda2544-577f-4426-9393-9dccda2812fc", "address": "fa:16:3e:fa:38:d3", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbeda2544-57", "ovs_interfaceid": "beda2544-577f-4426-9393-9dccda2812fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:38:d3,bridge_name='br-int',has_traffic_filtering=True,id=beda2544-577f-4426-9393-9dccda2812fc,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeda2544-57') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG os_vif [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:38:d3,bridge_name='br-int',has_traffic_filtering=True,id=beda2544-577f-4426-9393-9dccda2812fc,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeda2544-57') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbeda2544-57, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:25:28 user nova-compute[72874]: INFO os_vif [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:38:d3,bridge_name='br-int',has_traffic_filtering=True,id=beda2544-577f-4426-9393-9dccda2812fc,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbeda2544-57')
Aug 17 18:25:28 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Deleting instance files /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522_del
Aug 17 18:25:28 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Deletion of /opt/stack/data/nova/instances/2ee31c9c-6630-4a20-b986-e041951a8522_del complete
Aug 17 18:25:28 user nova-compute[72874]: INFO nova.compute.manager [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 17 18:25:28 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:25:28 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:25:29 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:25:29 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Took 0.93 seconds to deallocate network for instance.
Aug 17 18:25:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:30 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:25:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:30 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:25:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:30 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Deleted allocations for instance 2ee31c9c-6630-4a20-b986-e041951a8522
Aug 17 18:25:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-fcbeeb1b-0bbc-4bbf-b67d-5a524cdbfab2 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "2ee31c9c-6630-4a20-b986-e041951a8522" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.234s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:30 user nova-compute[72874]: DEBUG nova.compute.manager [req-100890ca-5dd4-42bd-9cb5-b9a55f48b37d req-7d27ce24-6d97-4998-b8a0-1412346941b0 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Received event network-vif-unplugged-beda2544-577f-4426-9393-9dccda2812fc {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-100890ca-5dd4-42bd-9cb5-b9a55f48b37d req-7d27ce24-6d97-4998-b8a0-1412346941b0 service nova] Acquiring lock "2ee31c9c-6630-4a20-b986-e041951a8522-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-100890ca-5dd4-42bd-9cb5-b9a55f48b37d req-7d27ce24-6d97-4998-b8a0-1412346941b0 service nova] Lock "2ee31c9c-6630-4a20-b986-e041951a8522-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-100890ca-5dd4-42bd-9cb5-b9a55f48b37d req-7d27ce24-6d97-4998-b8a0-1412346941b0 service nova] Lock "2ee31c9c-6630-4a20-b986-e041951a8522-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:30 user nova-compute[72874]: DEBUG nova.compute.manager [req-100890ca-5dd4-42bd-9cb5-b9a55f48b37d req-7d27ce24-6d97-4998-b8a0-1412346941b0 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] No waiting events found dispatching network-vif-unplugged-beda2544-577f-4426-9393-9dccda2812fc {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:30 user nova-compute[72874]: WARNING nova.compute.manager [req-100890ca-5dd4-42bd-9cb5-b9a55f48b37d req-7d27ce24-6d97-4998-b8a0-1412346941b0 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Received unexpected event network-vif-unplugged-beda2544-577f-4426-9393-9dccda2812fc for instance with vm_state deleted and task_state None.
Aug 17 18:25:30 user nova-compute[72874]: DEBUG nova.compute.manager [req-100890ca-5dd4-42bd-9cb5-b9a55f48b37d req-7d27ce24-6d97-4998-b8a0-1412346941b0 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Received event network-vif-plugged-beda2544-577f-4426-9393-9dccda2812fc {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-100890ca-5dd4-42bd-9cb5-b9a55f48b37d req-7d27ce24-6d97-4998-b8a0-1412346941b0 service nova] Acquiring lock "2ee31c9c-6630-4a20-b986-e041951a8522-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-100890ca-5dd4-42bd-9cb5-b9a55f48b37d req-7d27ce24-6d97-4998-b8a0-1412346941b0 service nova] Lock "2ee31c9c-6630-4a20-b986-e041951a8522-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-100890ca-5dd4-42bd-9cb5-b9a55f48b37d req-7d27ce24-6d97-4998-b8a0-1412346941b0 service nova] Lock "2ee31c9c-6630-4a20-b986-e041951a8522-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:30 user nova-compute[72874]: DEBUG nova.compute.manager [req-100890ca-5dd4-42bd-9cb5-b9a55f48b37d req-7d27ce24-6d97-4998-b8a0-1412346941b0 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] No waiting events found dispatching network-vif-plugged-beda2544-577f-4426-9393-9dccda2812fc {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:30 user nova-compute[72874]: WARNING nova.compute.manager [req-100890ca-5dd4-42bd-9cb5-b9a55f48b37d req-7d27ce24-6d97-4998-b8a0-1412346941b0 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Received unexpected event network-vif-plugged-beda2544-577f-4426-9393-9dccda2812fc for instance with vm_state deleted and task_state None.
Aug 17 18:25:30 user nova-compute[72874]: DEBUG nova.compute.manager [req-100890ca-5dd4-42bd-9cb5-b9a55f48b37d req-7d27ce24-6d97-4998-b8a0-1412346941b0 service nova] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Received event network-vif-deleted-beda2544-577f-4426-9393-9dccda2812fc {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-02faf5c9-e668-4bc9-98fb-8b66cd3018bf req-7fd7bfa1-e28b-4e8a-a2c0-990ef44f5e77 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received event network-changed-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-02faf5c9-e668-4bc9-98fb-8b66cd3018bf req-7fd7bfa1-e28b-4e8a-a2c0-990ef44f5e77 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Refreshing instance network info cache due to event network-changed-dbb991ed-781f-4666-a0b6-c360ab742952. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:25:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-02faf5c9-e668-4bc9-98fb-8b66cd3018bf req-7fd7bfa1-e28b-4e8a-a2c0-990ef44f5e77 service nova] Acquiring lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:25:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-02faf5c9-e668-4bc9-98fb-8b66cd3018bf req-7fd7bfa1-e28b-4e8a-a2c0-990ef44f5e77 service nova] Acquired lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:25:36 user nova-compute[72874]: DEBUG nova.network.neutron [req-02faf5c9-e668-4bc9-98fb-8b66cd3018bf req-7fd7bfa1-e28b-4e8a-a2c0-990ef44f5e77 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Refreshing network info cache for port dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:25:37 user nova-compute[72874]: DEBUG nova.network.neutron [req-02faf5c9-e668-4bc9-98fb-8b66cd3018bf req-7fd7bfa1-e28b-4e8a-a2c0-990ef44f5e77 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Updated VIF entry in instance network info cache for port dbb991ed-781f-4666-a0b6-c360ab742952. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:25:37 user nova-compute[72874]: DEBUG nova.network.neutron [req-02faf5c9-e668-4bc9-98fb-8b66cd3018bf req-7fd7bfa1-e28b-4e8a-a2c0-990ef44f5e77 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Updating instance_info_cache with network_info: [{"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:25:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-02faf5c9-e668-4bc9-98fb-8b66cd3018bf req-7fd7bfa1-e28b-4e8a-a2c0-990ef44f5e77 service nova] Releasing lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "544132d3-3dc4-445c-9a63-5f39e50eb34a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:38 user nova-compute[72874]: INFO nova.compute.manager [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Detaching volume 4e9d4577-e32c-48c6-8c40-4eb8956842fc
Aug 17 18:25:38 user nova-compute[72874]: INFO nova.virt.block_device [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Attempting to driver detach volume 4e9d4577-e32c-48c6-8c40-4eb8956842fc from mountpoint /dev/vdb
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "544132d3-3dc4-445c-9a63-5f39e50eb34a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Attempting to detach device vdb from instance 544132d3-3dc4-445c-9a63-5f39e50eb34a from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:25:38 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:25:38 user nova-compute[72874]:   <source dev="/dev/sdh"/>
Aug 17 18:25:38 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:25:38 user nova-compute[72874]:   <serial>4e9d4577-e32c-48c6-8c40-4eb8956842fc</serial>
Aug 17 18:25:38 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:25:38 user nova-compute[72874]: </disk>
Aug 17 18:25:38 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:25:38 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Successfully detached device vdb from instance 544132d3-3dc4-445c-9a63-5f39e50eb34a from the persistent domain config.
Aug 17 18:25:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 544132d3-3dc4-445c-9a63-5f39e50eb34a from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:25:38 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:25:38 user nova-compute[72874]:   <source dev="/dev/sdh"/>
Aug 17 18:25:38 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:25:38 user nova-compute[72874]:   <serial>4e9d4577-e32c-48c6-8c40-4eb8956842fc</serial>
Aug 17 18:25:38 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:25:38 user nova-compute[72874]: </disk>
Aug 17 18:25:38 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692296738.7082376, 544132d3-3dc4-445c-9a63-5f39e50eb34a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 544132d3-3dc4-445c-9a63-5f39e50eb34a {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:25:38 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Successfully detached device vdb from instance 544132d3-3dc4-445c-9a63-5f39e50eb34a from the live domain config.
Aug 17 18:25:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaSRlfLQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:25:38 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:25:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e71ab8a-2bcf-49cf-a1b8-90c95f926711]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a7a0ae-bb62-4d02-9b73-55f495ae8c02]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:38 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:38 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:25:38 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:25:38 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:25:38 user nova-compute[72874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc (non-flash)
Aug 17 18:25:38 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:25:38 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:38 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:38 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:25:38 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:25:38 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:25:38 user nova-compute[72874]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc (non-flash)
Aug 17 18:25:38 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:25:38 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a06bfd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc'): ({'sdh'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Removing single pathed devices sdh {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02de98c-df3c-4aaa-8c17-eb2ffe91d9d4]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d722de-6343-4002-8c1f-65122b1c91c4]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Flushing IO for device /dev/sdh {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c32378c-2bdb-4083-a4a5-f433f20eea6a]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.043s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[42972b20-143b-4ff4-9d55-955182f14d32]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] SCSI volumes sdh have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[463d3918-8c3f-4ca9-82f8-9a96204fbecf]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d13faa-199d-4908-b716-c2085350d10b]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc, portal: 172.16.0.220,3260]
Aug 17 18:25:38 user nova-compute[72874]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc, portal: 172.16.0.220,3260] successful.
Aug 17 18:25:38 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6aa24a-dd13-4b9b-b3e0-d91d998cf2c7]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:25:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] <== disconnect_volume: return (305ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:25:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:25:39 user nova-compute[72874]: DEBUG nova.objects.instance [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lazy-loading 'flavor' on Instance uuid 544132d3-3dc4-445c-9a63-5f39e50eb34a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:25:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f3d44d1a-3cfc-4e8c-abfe-5c26e35e3ee0 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.771s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.644s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "544132d3-3dc4-445c-9a63-5f39e50eb34a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:39 user nova-compute[72874]: INFO nova.compute.manager [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Terminating instance
Aug 17 18:25:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG nova.compute.manager [req-05eb1981-7014-452b-b279-b1d30db35ec0 req-fa8f5550-b864-4c14-88bd-c4c6b71395a0 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Received event network-vif-unplugged-733196aa-d083-4db2-a729-9e43b83eecdd {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-05eb1981-7014-452b-b279-b1d30db35ec0 req-fa8f5550-b864-4c14-88bd-c4c6b71395a0 service nova] Acquiring lock "544132d3-3dc4-445c-9a63-5f39e50eb34a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-05eb1981-7014-452b-b279-b1d30db35ec0 req-fa8f5550-b864-4c14-88bd-c4c6b71395a0 service nova] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-05eb1981-7014-452b-b279-b1d30db35ec0 req-fa8f5550-b864-4c14-88bd-c4c6b71395a0 service nova] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG nova.compute.manager [req-05eb1981-7014-452b-b279-b1d30db35ec0 req-fa8f5550-b864-4c14-88bd-c4c6b71395a0 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] No waiting events found dispatching network-vif-unplugged-733196aa-d083-4db2-a729-9e43b83eecdd {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG nova.compute.manager [req-05eb1981-7014-452b-b279-b1d30db35ec0 req-fa8f5550-b864-4c14-88bd-c4c6b71395a0 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Received event network-vif-unplugged-733196aa-d083-4db2-a729-9e43b83eecdd for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:25:40 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Instance destroyed successfully.
Aug 17 18:25:40 user nova-compute[72874]: DEBUG nova.objects.instance [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lazy-loading 'resources' on Instance uuid 544132d3-3dc4-445c-9a63-5f39e50eb34a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:22:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1014061497',display_name='tempest-VolumesSnapshotTestJSON-instance-1014061497',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1014061497',id=17,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN5LXFuTiw8gMDOeBACF5hR8jfTiOjPaRWj3uunQWqtwyjlVUGfNTL9R4K/FJMrf7KSKSPuk/eW8E+ffp0TaJrS8EDPeg2LOfaN+7/zXUPwA3VIVIWXPk484l8hPFUdu/w==',key_name='tempest-keypair-182360089',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:22:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f96ef08868f45aea64ddf76a0bb68f5',ramdisk_id='',reservation_id='r-wizc70gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1222672370',owner_user_name='tempest-VolumesSnapshotTestJSON-1222672370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:22:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55c7ca8d3b6d4d42b656d9a4a9bc11a5',uuid=544132d3-3dc4-445c-9a63-5f39e50eb34a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "733196aa-d083-4db2-a729-9e43b83eecdd", "address": "fa:16:3e:05:14:91", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733196aa-d0", "ovs_interfaceid": "733196aa-d083-4db2-a729-9e43b83eecdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Converting VIF {"id": "733196aa-d083-4db2-a729-9e43b83eecdd", "address": "fa:16:3e:05:14:91", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap733196aa-d0", "ovs_interfaceid": "733196aa-d083-4db2-a729-9e43b83eecdd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:14:91,bridge_name='br-int',has_traffic_filtering=True,id=733196aa-d083-4db2-a729-9e43b83eecdd,network=Network(b0620144-0532-4223-82f2-0fe7d1bd449e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733196aa-d0') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG os_vif [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:14:91,bridge_name='br-int',has_traffic_filtering=True,id=733196aa-d083-4db2-a729-9e43b83eecdd,network=Network(b0620144-0532-4223-82f2-0fe7d1bd449e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733196aa-d0') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap733196aa-d0, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:25:40 user nova-compute[72874]: INFO os_vif [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:14:91,bridge_name='br-int',has_traffic_filtering=True,id=733196aa-d083-4db2-a729-9e43b83eecdd,network=Network(b0620144-0532-4223-82f2-0fe7d1bd449e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap733196aa-d0')
Aug 17 18:25:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WaSRlfLQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:25:40 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:25:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e9d4577-e32c-48c6-8c40-4eb8956842fc', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f5acd9-9a33-49d9-8678-e8223fef39a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c81a87-dcbe-4be9-b41d-ec0cf656ad5f]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:40 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:40 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:25:40 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:25:40 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:25:40 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:25:40 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:40 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:40 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:25:40 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:25:40 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:25:40 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:25:40 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a05fd750>, {}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Disconnecting from: [] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.056s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] <== disconnect_volume: return (57ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:25:40 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Deleting instance files /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a_del
Aug 17 18:25:40 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Deletion of /opt/stack/data/nova/instances/544132d3-3dc4-445c-9a63-5f39e50eb34a_del complete
Aug 17 18:25:40 user nova-compute[72874]: INFO nova.compute.manager [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 17 18:25:40 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:25:40 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:25:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "cf9f3116-5e42-4858-a391-ab75d2046f1a" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:41 user nova-compute[72874]: INFO nova.compute.manager [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Shelving
Aug 17 18:25:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:41 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Instance destroyed successfully.
Aug 17 18:25:41 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Beginning cold snapshot process
Aug 17 18:25:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk /opt/stack/data/nova/instances/snapshots/tmpv1fee64z/fd8977392acf4a7ab71fe94e27943f31 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Received event network-vif-plugged-733196aa-d083-4db2-a729-9e43b83eecdd {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] Acquiring lock "544132d3-3dc4-445c-9a63-5f39e50eb34a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] No waiting events found dispatching network-vif-plugged-733196aa-d083-4db2-a729-9e43b83eecdd {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:42 user nova-compute[72874]: WARNING nova.compute.manager [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Received unexpected event network-vif-plugged-733196aa-d083-4db2-a729-9e43b83eecdd for instance with vm_state active and task_state deleting.
Aug 17 18:25:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received event network-vif-unplugged-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] Acquiring lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] No waiting events found dispatching network-vif-unplugged-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:42 user nova-compute[72874]: WARNING nova.compute.manager [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received unexpected event network-vif-unplugged-dbb991ed-781f-4666-a0b6-c360ab742952 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 17 18:25:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received event network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] Acquiring lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] No waiting events found dispatching network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:42 user nova-compute[72874]: WARNING nova.compute.manager [req-d782f6fc-55ad-4f02-b613-d64d8a4c64a2 req-387b4c42-065c-4b24-abeb-90e268d2a11c service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received unexpected event network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 for instance with vm_state active and task_state shelving_image_pending_upload.
Aug 17 18:25:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk /opt/stack/data/nova/instances/snapshots/tmpv1fee64z/fd8977392acf4a7ab71fe94e27943f31" returned: 0 in 0.428s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:42 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Snapshot extracted, beginning image upload
Aug 17 18:25:42 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:25:42 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Took 1.84 seconds to deallocate network for instance.
Aug 17 18:25:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-60c2edf1-6e19-4b93-a50d-008a02e6ef97 req-cfc022bf-0fa5-466f-89bc-b32ac03ba3e4 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Received event network-vif-deleted-733196aa-d083-4db2-a729-9e43b83eecdd {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:42 user nova-compute[72874]: INFO nova.compute.manager [req-60c2edf1-6e19-4b93-a50d-008a02e6ef97 req-cfc022bf-0fa5-466f-89bc-b32ac03ba3e4 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Neutron deleted interface 733196aa-d083-4db2-a729-9e43b83eecdd; detaching it from the instance and deleting it from the info cache
Aug 17 18:25:42 user nova-compute[72874]: DEBUG nova.network.neutron [req-60c2edf1-6e19-4b93-a50d-008a02e6ef97 req-cfc022bf-0fa5-466f-89bc-b32ac03ba3e4 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:25:42 user nova-compute[72874]: WARNING nova.volume.cinder [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Attachment 24d20d93-3a25-4001-93cd-ec10d88de522 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 24d20d93-3a25-4001-93cd-ec10d88de522. (HTTP 404) (Request-ID: req-448e38ad-5222-417b-a1db-5f3e897bff5d)
Aug 17 18:25:42 user nova-compute[72874]: INFO nova.compute.manager [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Took 0.04 seconds to detach 1 volumes for instance.
Aug 17 18:25:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-60c2edf1-6e19-4b93-a50d-008a02e6ef97 req-cfc022bf-0fa5-466f-89bc-b32ac03ba3e4 service nova] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Detach interface failed, port_id=733196aa-d083-4db2-a729-9e43b83eecdd, reason: Instance 544132d3-3dc4-445c-9a63-5f39e50eb34a could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:43 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:25:43 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:25:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:43 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Deleted allocations for instance 544132d3-3dc4-445c-9a63-5f39e50eb34a
Aug 17 18:25:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92329590-55a8-4358-b663-f2ac8983c2b9 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "544132d3-3dc4-445c-9a63-5f39e50eb34a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.495s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:43 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296728.725507, 2ee31c9c-6630-4a20-b986-e041951a8522 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:25:43 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] VM Stopped (Lifecycle Event)
Aug 17 18:25:43 user nova-compute[72874]: DEBUG nova.compute.manager [None req-282f3e31-3abe-452c-b1d3-82a809f32e6a None None] [instance: 2ee31c9c-6630-4a20-b986-e041951a8522] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:25:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:45 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Snapshot image upload complete
Aug 17 18:25:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:25:45 user nova-compute[72874]: INFO nova.compute.manager [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Shelve offloading
Aug 17 18:25:45 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Instance destroyed successfully.
Aug 17 18:25:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:25:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:25:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquired lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:25:45 user nova-compute[72874]: DEBUG nova.network.neutron [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:25:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:45 user nova-compute[72874]: DEBUG nova.network.neutron [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Updating instance_info_cache with network_info: [{"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:25:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Releasing lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:25:46 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Instance destroyed successfully.
Aug 17 18:25:46 user nova-compute[72874]: DEBUG nova.objects.instance [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'resources' on Instance uuid cf9f3116-5e42-4858-a391-ab75d2046f1a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:25:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:23:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-256691474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-256691474',id=21,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRZJI30JvBIOo78Nc4E/vQZ4222PUz6M4VnJyBsVc8RG8pkgZHWCI+wS7Li89ZXnfRpzACIFODv16pw4feyE8jOEDhaILAHNfE95Q4vLeIyPLALwu/lIVovS9PV5DR+JQ==',key_name='tempest-keypair-1928119168',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5c20349a873f4ec7a0f72a7d64c636e4',ramdisk_id='',reservation_id='r-ju6xb3sz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1376162523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1376162523-project-member',shelved_at='2023-08-17T18:25:45.316943',shelved_host='user',shelved_image_id='8dbc732f-4402-45b4-aab2-577524eb50bb'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:25:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b47defaba840e1ba8f91603d99caac',uuid=cf9f3116-5e42-4858-a391-ab75d2046f1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:25:46 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converting VIF {"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:25:46 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cd:60,bridge_name='br-int',has_traffic_filtering=True,id=dbb991ed-781f-4666-a0b6-c360ab742952,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb991ed-78') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:25:46 user nova-compute[72874]: DEBUG os_vif [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cd:60,bridge_name='br-int',has_traffic_filtering=True,id=dbb991ed-781f-4666-a0b6-c360ab742952,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb991ed-78') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:25:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbb991ed-78, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:25:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:25:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:46 user nova-compute[72874]: DEBUG nova.compute.manager [req-2e4d66c9-3498-495a-880f-3b9162636181 req-a0cc843e-ed0a-4e45-ac67-08eb505989d9 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received event network-changed-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:46 user nova-compute[72874]: DEBUG nova.compute.manager [req-2e4d66c9-3498-495a-880f-3b9162636181 req-a0cc843e-ed0a-4e45-ac67-08eb505989d9 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Refreshing instance network info cache due to event network-changed-dbb991ed-781f-4666-a0b6-c360ab742952. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:25:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2e4d66c9-3498-495a-880f-3b9162636181 req-a0cc843e-ed0a-4e45-ac67-08eb505989d9 service nova] Acquiring lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:25:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2e4d66c9-3498-495a-880f-3b9162636181 req-a0cc843e-ed0a-4e45-ac67-08eb505989d9 service nova] Acquired lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:25:46 user nova-compute[72874]: DEBUG nova.network.neutron [req-2e4d66c9-3498-495a-880f-3b9162636181 req-a0cc843e-ed0a-4e45-ac67-08eb505989d9 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Refreshing network info cache for port dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:25:46 user nova-compute[72874]: INFO os_vif [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cd:60,bridge_name='br-int',has_traffic_filtering=True,id=dbb991ed-781f-4666-a0b6-c360ab742952,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb991ed-78')
Aug 17 18:25:46 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Deleting instance files /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a_del
Aug 17 18:25:46 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Deletion of /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a_del complete
Aug 17 18:25:46 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Deleted allocations for instance cf9f3116-5e42-4858-a391-ab75d2046f1a
Aug 17 18:25:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:46 user nova-compute[72874]: DEBUG nova.objects.instance [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'numa_topology' on Instance uuid cf9f3116-5e42-4858-a391-ab75d2046f1a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:25:47 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:25:47 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:25:47 user nova-compute[72874]: DEBUG nova.network.neutron [req-2e4d66c9-3498-495a-880f-3b9162636181 req-a0cc843e-ed0a-4e45-ac67-08eb505989d9 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Updated VIF entry in instance network info cache for port dbb991ed-781f-4666-a0b6-c360ab742952. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:25:47 user nova-compute[72874]: DEBUG nova.network.neutron [req-2e4d66c9-3498-495a-880f-3b9162636181 req-a0cc843e-ed0a-4e45-ac67-08eb505989d9 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Updating instance_info_cache with network_info: [{"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapdbb991ed-78", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:25:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.394s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2e4d66c9-3498-495a-880f-3b9162636181 req-a0cc843e-ed0a-4e45-ac67-08eb505989d9 service nova] Releasing lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:25:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6951c99a-7db0-4fcc-9367-a71086f36e35 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.084s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:49 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Port d6319754-2bba-45a4-9db3-9fcf99c0c33c binding to destination host user is already ACTIVE {{(pid=72874) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 18:25:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:25:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquired lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:25:49 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:25:50 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updating instance_info_cache with network_info: [{"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:25:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Releasing lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:25:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Creating tmpfile /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/tmplm8vwn9q to verify with other compute node that the instance is on the same shared storage. {{(pid=72874) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 17 18:25:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-c80587df-f87c-45d2-a5e6-568b1a5f5d72 req-cc789ba6-f214-4bf5-bd08-9ae1d40085a2 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received event network-vif-unplugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c80587df-f87c-45d2-a5e6-568b1a5f5d72 req-cc789ba6-f214-4bf5-bd08-9ae1d40085a2 service nova] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c80587df-f87c-45d2-a5e6-568b1a5f5d72 req-cc789ba6-f214-4bf5-bd08-9ae1d40085a2 service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c80587df-f87c-45d2-a5e6-568b1a5f5d72 req-cc789ba6-f214-4bf5-bd08-9ae1d40085a2 service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-c80587df-f87c-45d2-a5e6-568b1a5f5d72 req-cc789ba6-f214-4bf5-bd08-9ae1d40085a2 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] No waiting events found dispatching network-vif-unplugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:50 user nova-compute[72874]: WARNING nova.compute.manager [req-c80587df-f87c-45d2-a5e6-568b1a5f5d72 req-cc789ba6-f214-4bf5-bd08-9ae1d40085a2 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received unexpected event network-vif-unplugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c for instance with vm_state resized and task_state resize_reverting.
Aug 17 18:25:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-b685a5fe-084a-4507-8492-1b31beb380c3 req-1b1f76a6-7e7c-41ea-8769-984283e4c508 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-changed-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-b685a5fe-084a-4507-8492-1b31beb380c3 req-1b1f76a6-7e7c-41ea-8769-984283e4c508 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Refreshing instance network info cache due to event network-changed-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:25:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b685a5fe-084a-4507-8492-1b31beb380c3 req-1b1f76a6-7e7c-41ea-8769-984283e4c508 service nova] Acquiring lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:25:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b685a5fe-084a-4507-8492-1b31beb380c3 req-1b1f76a6-7e7c-41ea-8769-984283e4c508 service nova] Acquired lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:25:50 user nova-compute[72874]: DEBUG nova.network.neutron [req-b685a5fe-084a-4507-8492-1b31beb380c3 req-1b1f76a6-7e7c-41ea-8769-984283e4c508 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Refreshing network info cache for port fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:25:51 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Instance destroyed successfully.
Aug 17 18:25:51 user nova-compute[72874]: DEBUG nova.objects.instance [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lazy-loading 'resources' on Instance uuid 2ace97e1-c2ee-462e-a929-22c7cb2584d2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1594135899',display_name='tempest-ServerActionsTestOtherB-server-1594135899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1594135899',id=13,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJL0wGDO9yYxM59zaPj86jL9bZvPsFDy3YJOsbSwVi+3h9+DinmjEtIZue1FvAOYIc54lSepvgAxdfqkbFKLJ90/SAHzFU18VdJmA0Lh/YqOsAztJ9gMRfqGTMWDprprBA==',key_name='tempest-keypair-1720427808',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:24:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad9005fd344e470482b0b90baeb97515',ramdisk_id='',reservation_id='r-5cqpdw10',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1909498304',owner_user_name='tempest-ServerActionsTestOtherB-1909498304-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:24:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31f7828a072847dc9cb4d4fd51908366',uuid=2ace97e1-c2ee-462e-a929-22c7cb2584d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converting VIF {"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_vif [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6319754-2b, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:25:51 user nova-compute[72874]: INFO os_vif [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b')
Aug 17 18:25:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJCicowN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:25:51 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG nova.network.neutron [req-b685a5fe-084a-4507-8492-1b31beb380c3 req-1b1f76a6-7e7c-41ea-8769-984283e4c508 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Updated VIF entry in instance network info cache for port fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG nova.network.neutron [req-b685a5fe-084a-4507-8492-1b31beb380c3 req-1b1f76a6-7e7c-41ea-8769-984283e4c508 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Updating instance_info_cache with network_info: [{"id": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "address": "fa:16:3e:c8:a8:2b", "network": {"id": "51ce5fe7-85ba-4c8a-9ba3-4b8823afea51", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-341654396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb19bfac-de", "ovs_interfaceid": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a06f651-218f-42e4-aee0-40e733d5a891", "address": "fa:16:3e:46:26:f0", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a06f651-21", "ovs_interfaceid": "2a06f651-218f-42e4-aee0-40e733d5a891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "025bb037-5e0c-45f3-96c2-09a83b224502", "address": "fa:16:3e:06:ed:ab", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025bb037-5e", "ovs_interfaceid": "025bb037-5e0c-45f3-96c2-09a83b224502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "address": "fa:16:3e:1c:de:6d", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdfe9b78-37", "ovs_interfaceid": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "address": "fa:16:3e:67:28:cb", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa59cbf-ed", "ovs_interfaceid": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "address": "fa:16:3e:0d:77:c0", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8d3da0-55", "ovs_interfaceid": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "address": "fa:16:3e:f7:68:17", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86b5e91-07", "ovs_interfaceid": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a43e213-dc27-4e00-aa33-d2183fcca903]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b685a5fe-084a-4507-8492-1b31beb380c3 req-1b1f76a6-7e7c-41ea-8769-984283e4c508 service nova] Releasing lock "refresh_cache-8c998fa1-9430-4f03-bae7-ce510509a9be" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cba9837-e7b2-4830-aa24-eb9b4624416b]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:51 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:51 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:25:51 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:25:51 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:25:51 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:25:51 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:51 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:51 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:25:51 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:25:51 user nova-compute[72874]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:25:51 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:25:51 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c076dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913'): ({'sdg'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Removing single pathed devices sdg {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb10429b-be08-4fea-bfb5-9fa6684d5da1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[042e3be1-9b0c-4822-8efd-e7861a112147]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Flushing IO for device /dev/sdg {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1f1ca3-4a60-4426-9094-e14e19e50283]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84aaa17-f939-48c6-8edf-ca8c5ee022cf]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] SCSI volumes sdg have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[387ae083-7e5d-49a2-931a-e98fad74a476]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d9c38e-47c9-4e94-9405-a4b0dcea9a30]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260]
Aug 17 18:25:51 user nova-compute[72874]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260] successful.
Aug 17 18:25:51 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3fc2305-b5c7-4412-847b-08a1d64dc774]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] <== disconnect_volume: return (310ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:25:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:25:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:52 user nova-compute[72874]: DEBUG nova.objects.instance [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lazy-loading 'migration_context' on Instance uuid 2ace97e1-c2ee-462e-a929-22c7cb2584d2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:25:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-559e926e-bce3-46d9-aa7e-df9db221238f req-c0bac2c9-27eb-4b45-9783-69b94c7eb645 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-559e926e-bce3-46d9-aa7e-df9db221238f req-c0bac2c9-27eb-4b45-9783-69b94c7eb645 service nova] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-559e926e-bce3-46d9-aa7e-df9db221238f req-c0bac2c9-27eb-4b45-9783-69b94c7eb645 service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-559e926e-bce3-46d9-aa7e-df9db221238f req-c0bac2c9-27eb-4b45-9783-69b94c7eb645 service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-559e926e-bce3-46d9-aa7e-df9db221238f req-c0bac2c9-27eb-4b45-9783-69b94c7eb645 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] No waiting events found dispatching network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:52 user nova-compute[72874]: WARNING nova.compute.manager [req-559e926e-bce3-46d9-aa7e-df9db221238f req-c0bac2c9-27eb-4b45-9783-69b94c7eb645 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received unexpected event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c for instance with vm_state resized and task_state resize_reverting.
Aug 17 18:25:52 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:25:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:52 user nova-compute[72874]: INFO nova.compute.manager [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Terminating instance
Aug 17 18:25:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:25:52 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.477s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: INFO nova.compute.manager [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Swapping old allocation on dict_keys(['b677d836-b01b-4674-8972-53d526f1b5f7']) held by migration d05bb49b-d48d-421b-8d68-afb2f6058907 for instance
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-ea84836b-fb84-4454-b491-614a3be0bffb req-5402c0b1-5a63-4870-b2c3-5d0b79825b98 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-unplugged-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ea84836b-fb84-4454-b491-614a3be0bffb req-5402c0b1-5a63-4870-b2c3-5d0b79825b98 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ea84836b-fb84-4454-b491-614a3be0bffb req-5402c0b1-5a63-4870-b2c3-5d0b79825b98 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ea84836b-fb84-4454-b491-614a3be0bffb req-5402c0b1-5a63-4870-b2c3-5d0b79825b98 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-ea84836b-fb84-4454-b491-614a3be0bffb req-5402c0b1-5a63-4870-b2c3-5d0b79825b98 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-unplugged-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-ea84836b-fb84-4454-b491-614a3be0bffb req-5402c0b1-5a63-4870-b2c3-5d0b79825b98 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-unplugged-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Overwriting current allocation {'allocations': {'b677d836-b01b-4674-8972-53d526f1b5f7': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 28}}, 'project_id': 'ad9005fd344e470482b0b90baeb97515', 'user_id': '31f7828a072847dc9cb4d4fd51908366', 'consumer_generation': 1} on consumer 2ace97e1-c2ee-462e-a929-22c7cb2584d2 {{(pid=72874) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquired lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-387fafad-f62c-4b6a-96df-b2e63e6d7ef8 req-2a740113-7252-4a2b-9f15-463b135645ab service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-unplugged-fdfe9b78-3799-41b0-87e0-88219cdaad87 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-387fafad-f62c-4b6a-96df-b2e63e6d7ef8 req-2a740113-7252-4a2b-9f15-463b135645ab service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-387fafad-f62c-4b6a-96df-b2e63e6d7ef8 req-2a740113-7252-4a2b-9f15-463b135645ab service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-387fafad-f62c-4b6a-96df-b2e63e6d7ef8 req-2a740113-7252-4a2b-9f15-463b135645ab service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-387fafad-f62c-4b6a-96df-b2e63e6d7ef8 req-2a740113-7252-4a2b-9f15-463b135645ab service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-unplugged-fdfe9b78-3799-41b0-87e0-88219cdaad87 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-387fafad-f62c-4b6a-96df-b2e63e6d7ef8 req-2a740113-7252-4a2b-9f15-463b135645ab service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-unplugged-fdfe9b78-3799-41b0-87e0-88219cdaad87 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updating instance_info_cache with network_info: [{"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Releasing lock "refresh_cache-2ace97e1-c2ee-462e-a929-22c7cb2584d2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG os_brick.utils [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb010582-7253-4903-9667-1bdf1b0c0cd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.050s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ab882c-56f3-4c84-a593-4d76a00a13a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5087d6b-e7ea-4a82-982a-3837b5b7c76d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c431d8d7-9e4e-4c9c-9615-7e7419c630ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-unplugged-2a06f651-218f-42e4-aee0-40e733d5a891 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-unplugged-2a06f651-218f-42e4-aee0-40e733d5a891 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-unplugged-2a06f651-218f-42e4-aee0-40e733d5a891 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-2a06f651-218f-42e4-aee0-40e733d5a891 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-2a06f651-218f-42e4-aee0-40e733d5a891 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:54 user nova-compute[72874]: WARNING nova.compute.manager [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-2a06f651-218f-42e4-aee0-40e733d5a891 for instance with vm_state active and task_state deleting.
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-unplugged-025bb037-5e0c-45f3-96c2-09a83b224502 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-unplugged-025bb037-5e0c-45f3-96c2-09a83b224502 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-unplugged-025bb037-5e0c-45f3-96c2-09a83b224502 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-025bb037-5e0c-45f3-96c2-09a83b224502 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-025bb037-5e0c-45f3-96c2-09a83b224502 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:54 user nova-compute[72874]: WARNING nova.compute.manager [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-025bb037-5e0c-45f3-96c2-09a83b224502 for instance with vm_state active and task_state deleting.
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-unplugged-4aa59cbf-eda8-40ba-a155-1826ecc9d850 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-unplugged-4aa59cbf-eda8-40ba-a155-1826ecc9d850 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-3601ad27-0890-4a29-b27f-72d646df6536 req-9a598cce-46f4-4b94-bf07-1aa9f98d9ba1 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-unplugged-4aa59cbf-eda8-40ba-a155-1826ecc9d850 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:25:54 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:25:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0403cb54-c00a-40fa-bd02-6d571c52b8fa]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG os_brick.utils [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] <== get_connector_properties: return (229ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:25:54 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Instance destroyed successfully.
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.objects.instance [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lazy-loading 'resources' on Instance uuid 8c998fa1-9430-4f03-bae7-ce510509a9be {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:24:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "address": "fa:16:3e:c8:a8:2b", "network": {"id": "51ce5fe7-85ba-4c8a-9ba3-4b8823afea51", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-341654396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb19bfac-de", "ovs_interfaceid": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "address": "fa:16:3e:c8:a8:2b", "network": {"id": "51ce5fe7-85ba-4c8a-9ba3-4b8823afea51", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-341654396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb19bfac-de", "ovs_interfaceid": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c8:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3,network=Network(51ce5fe7-85ba-4c8a-9ba3-4b8823afea51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb19bfac-de') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG os_vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3,network=Network(51ce5fe7-85ba-4c8a-9ba3-4b8823afea51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb19bfac-de') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb19bfac-de, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:54 user nova-compute[72874]: INFO os_vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c8:a8:2b,bridge_name='br-int',has_traffic_filtering=True,id=fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3,network=Network(51ce5fe7-85ba-4c8a-9ba3-4b8823afea51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb19bfac-de')
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:24:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a06f651-218f-42e4-aee0-40e733d5a891", "address": "fa:16:3e:46:26:f0", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a06f651-21", "ovs_interfaceid": "2a06f651-218f-42e4-aee0-40e733d5a891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "2a06f651-218f-42e4-aee0-40e733d5a891", "address": "fa:16:3e:46:26:f0", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a06f651-21", "ovs_interfaceid": "2a06f651-218f-42e4-aee0-40e733d5a891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:26:f0,bridge_name='br-int',has_traffic_filtering=True,id=2a06f651-218f-42e4-aee0-40e733d5a891,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2a06f651-21') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG os_vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:26:f0,bridge_name='br-int',has_traffic_filtering=True,id=2a06f651-218f-42e4-aee0-40e733d5a891,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2a06f651-21') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a06f651-21, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:54 user nova-compute[72874]: INFO os_vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:26:f0,bridge_name='br-int',has_traffic_filtering=True,id=2a06f651-218f-42e4-aee0-40e733d5a891,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2a06f651-21')
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:24:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "025bb037-5e0c-45f3-96c2-09a83b224502", "address": "fa:16:3e:06:ed:ab", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025bb037-5e", "ovs_interfaceid": "025bb037-5e0c-45f3-96c2-09a83b224502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "025bb037-5e0c-45f3-96c2-09a83b224502", "address": "fa:16:3e:06:ed:ab", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025bb037-5e", "ovs_interfaceid": "025bb037-5e0c-45f3-96c2-09a83b224502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:ed:ab,bridge_name='br-int',has_traffic_filtering=True,id=025bb037-5e0c-45f3-96c2-09a83b224502,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap025bb037-5e') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG os_vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:ed:ab,bridge_name='br-int',has_traffic_filtering=True,id=025bb037-5e0c-45f3-96c2-09a83b224502,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap025bb037-5e') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap025bb037-5e, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:25:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:55 user nova-compute[72874]: INFO os_vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:ed:ab,bridge_name='br-int',has_traffic_filtering=True,id=025bb037-5e0c-45f3-96c2-09a83b224502,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap025bb037-5e')
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:24:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "address": "fa:16:3e:1c:de:6d", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdfe9b78-37", "ovs_interfaceid": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "address": "fa:16:3e:1c:de:6d", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.173", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdfe9b78-37", "ovs_interfaceid": "fdfe9b78-3799-41b0-87e0-88219cdaad87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:de:6d,bridge_name='br-int',has_traffic_filtering=True,id=fdfe9b78-3799-41b0-87e0-88219cdaad87,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdfe9b78-37') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:de:6d,bridge_name='br-int',has_traffic_filtering=True,id=fdfe9b78-3799-41b0-87e0-88219cdaad87,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdfe9b78-37') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdfe9b78-37, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:55 user nova-compute[72874]: INFO os_vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:de:6d,bridge_name='br-int',has_traffic_filtering=True,id=fdfe9b78-3799-41b0-87e0-88219cdaad87,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdfe9b78-37')
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:24:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "address": "fa:16:3e:67:28:cb", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa59cbf-ed", "ovs_interfaceid": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "address": "fa:16:3e:67:28:cb", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa59cbf-ed", "ovs_interfaceid": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:28:cb,bridge_name='br-int',has_traffic_filtering=True,id=4aa59cbf-eda8-40ba-a155-1826ecc9d850,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa59cbf-ed') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:28:cb,bridge_name='br-int',has_traffic_filtering=True,id=4aa59cbf-eda8-40ba-a155-1826ecc9d850,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa59cbf-ed') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4aa59cbf-ed, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:55 user nova-compute[72874]: INFO os_vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:28:cb,bridge_name='br-int',has_traffic_filtering=True,id=4aa59cbf-eda8-40ba-a155-1826ecc9d850,network=Network(c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4aa59cbf-ed')
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:24:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "address": "fa:16:3e:0d:77:c0", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8d3da0-55", "ovs_interfaceid": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "address": "fa:16:3e:0d:77:c0", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8d3da0-55", "ovs_interfaceid": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:77:c0,bridge_name='br-int',has_traffic_filtering=True,id=5e8d3da0-5572-4024-9d00-cc5b185bff71,network=Network(eff8425f-fbb1-4a34-a63a-a58df1b61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e8d3da0-55') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:77:c0,bridge_name='br-int',has_traffic_filtering=True,id=5e8d3da0-5572-4024-9d00-cc5b185bff71,network=Network(eff8425f-fbb1-4a34-a63a-a58df1b61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e8d3da0-55') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e8d3da0-55, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:55 user nova-compute[72874]: INFO os_vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:77:c0,bridge_name='br-int',has_traffic_filtering=True,id=5e8d3da0-5572-4024-9d00-cc5b185bff71,network=Network(eff8425f-fbb1-4a34-a63a-a58df1b61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e8d3da0-55')
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:23:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1448698696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1448698696',id=18,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP09czfaHq8NZmnwHJdbRLIiOFfnqRUTfTmOc0RI5qnfl4YNnFlBtqOdwDDKaOZKyhbUfRPI645Unvhidk5dAGlIZ/dnf8eEcGDbq47LOXEmSmIdq6pZaZQ6GgkNdTZmeg==',key_name='tempest-keypair-2076500423',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:24:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='31af41fdde924ec880875f5b31ba1a87',ramdisk_id='',reservation_id='r-apb4tgyd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-15839607',owner_user_name='tempest-TaggedBootDevicesTest_v242-15839607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:24:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='909454bbec8446d4beeba819352180e1',uuid=8c998fa1-9430-4f03-bae7-ce510509a9be,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "address": "fa:16:3e:f7:68:17", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86b5e91-07", "ovs_interfaceid": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converting VIF {"id": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "address": "fa:16:3e:f7:68:17", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86b5e91-07", "ovs_interfaceid": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:68:17,bridge_name='br-int',has_traffic_filtering=True,id=e86b5e91-071c-4b9e-80f0-7ce24ada55f5,network=Network(eff8425f-fbb1-4a34-a63a-a58df1b61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86b5e91-07') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:68:17,bridge_name='br-int',has_traffic_filtering=True,id=e86b5e91-071c-4b9e-80f0-7ce24ada55f5,network=Network(eff8425f-fbb1-4a34-a63a-a58df1b61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86b5e91-07') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape86b5e91-07, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:25:55 user nova-compute[72874]: INFO os_vif [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:68:17,bridge_name='br-int',has_traffic_filtering=True,id=e86b5e91-071c-4b9e-80f0-7ce24ada55f5,network=Network(eff8425f-fbb1-4a34-a63a-a58df1b61e9d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape86b5e91-07')
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OFoTiUVm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:25:55 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4996862e-4c67-4394-b4ba-a29c4c8ea146]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[342fccb1-3ddd-4d28-b32a-429569b130ad]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c06715a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb'): ({'sdf'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Removing single pathed devices sdf {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8977e36a-b5e0-4dfa-be11-cdab0364e6da]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bc5d83-42cc-4fd3-bc91-2a8b6326e8a5]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Flushing IO for device /dev/sdf {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8552028-7f28-4de3-9c52-2ee32aafb292]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe4b00f-7845-4df8-850b-f5bbf91ad69c]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] SCSI volumes sdf have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9251be-46d1-40dd-9f52-5dc398f3993c]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:55 user nova-compute[72874]: WARNING nova.compute.manager [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 for instance with vm_state active and task_state deleting.
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-unplugged-e86b5e91-071c-4b9e-80f0-7ce24ada55f5 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-unplugged-e86b5e91-071c-4b9e-80f0-7ce24ada55f5 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-unplugged-e86b5e91-071c-4b9e-80f0-7ce24ada55f5 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-e86b5e91-071c-4b9e-80f0-7ce24ada55f5 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-e86b5e91-071c-4b9e-80f0-7ce24ada55f5 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:55 user nova-compute[72874]: WARNING nova.compute.manager [req-efe5da3e-4c9e-4338-979c-15330e102cf9 req-59e65512-12fa-48b0-bcf0-5be5aef73036 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-e86b5e91-071c-4b9e-80f0-7ce24ada55f5 for instance with vm_state active and task_state deleting.
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[13324115-cc76-402e-8028-1f6a049fcab6]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb, portal: 172.16.0.220,3260]
Aug 17 18:25:55 user nova-compute[72874]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb, portal: 172.16.0.220,3260] successful.
Aug 17 18:25:55 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:121f656c-b13e-49e9-923f-4929ec5b7bfb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bfd9507-8232-4aa1-a444-3552b0cbbf93]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] <== disconnect_volume: return (312ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oqEYtgHK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:25:55 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[64015359-14e9-466b-83f7-4a4d1606f318]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a6448a-eb89-4006-ab02-feca120d4356]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a07505e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53'): ({'sde'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Removing single pathed devices sde {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[192ea01c-df3f-42ff-bf41-0e08562c4499]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1ad469-6b80-4e83-8904-4f870ab35537]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Flushing IO for device /dev/sde {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d5354f-112c-4ace-bc27-7870ae79612d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4543d7fd-8dc6-4d73-b130-23d013e74bd3]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] SCSI volumes sde have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5751718-c4ea-4683-8048-b1ae36bb228c]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296740.6549954, 544132d3-3dc4-445c-9a63-5f39e50eb34a => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:25:55 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] VM Stopped (Lifecycle Event)
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-58b6cc3f-7c5d-4f0c-94d9-0f178874e9f8 None None] [instance: 544132d3-3dc4-445c-9a63-5f39e50eb34a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb365426-ba2b-4fc9-99e1-0087415491ab]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53, portal: 172.16.0.220,3260]
Aug 17 18:25:55 user nova-compute[72874]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53, portal: 172.16.0.220,3260] successful.
Aug 17 18:25:55 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e77b595-57f6-40df-85ef-c933cf5a1b53 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[18794439-38d0-473b-aee8-bd0d15bab94e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] <== disconnect_volume: return (314ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DqKPEulp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:25:55 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-fdfe9b78-3799-41b0-87e0-88219cdaad87 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-fdfe9b78-3799-41b0-87e0-88219cdaad87 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:55 user nova-compute[72874]: WARNING nova.compute.manager [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-fdfe9b78-3799-41b0-87e0-88219cdaad87 for instance with vm_state active and task_state deleting.
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-unplugged-5e8d3da0-5572-4024-9d00-cc5b185bff71 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-unplugged-5e8d3da0-5572-4024-9d00-cc5b185bff71 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-unplugged-5e8d3da0-5572-4024-9d00-cc5b185bff71 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-5e8d3da0-5572-4024-9d00-cc5b185bff71 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-5e8d3da0-5572-4024-9d00-cc5b185bff71 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:55 user nova-compute[72874]: WARNING nova.compute.manager [req-8725c693-68a7-40a4-8073-5e16799efa40 req-369b2ec9-c080-4541-a33d-49ce825a868f service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-5e8d3da0-5572-4024-9d00-cc5b185bff71 for instance with vm_state active and task_state deleting.
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee4fcdc-1b29-4696-b709-65238d3e2b05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c95f02a-81f1-4d98-a05d-b9f53026aefc]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:25:55 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a0751870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61'): ({'sdd'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Removing single pathed devices sdd {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ebb26e-f89a-412c-81ee-40306930f06d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b578a17f-f753-490b-8461-f90e42401608]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Flushing IO for device /dev/sdd {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[98bfcd33-b39b-44f5-826b-670a58d6db60]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbba3031-4212-4857-a425-13512468bcf4]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c37591d-0c0f-41ec-9a4d-a9cb8810a209]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[486dcdff-326e-49cd-a443-cbd5a904f192]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61, portal: 172.16.0.220,3260]
Aug 17 18:25:56 user nova-compute[72874]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61, portal: 172.16.0.220,3260] successful.
Aug 17 18:25:56 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8aa08fb-a17c-45fc-88f3-f1ec606dcc61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b804f3d-6232-4bf8-86d9-32737ebc5c77]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] <== disconnect_volume: return (277ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:25:56 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Deleting instance files /opt/stack/data/nova/instances/8c998fa1-9430-4f03-bae7-ce510509a9be_del
Aug 17 18:25:56 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Deletion of /opt/stack/data/nova/instances/8c998fa1-9430-4f03-bae7-ce510509a9be_del complete
Aug 17 18:25:56 user nova-compute[72874]: INFO nova.compute.manager [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Took 3.15 seconds to destroy the instance on the hypervisor.
Aug 17 18:25:56 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-aebb5fbf-f82a-4bdc-9533-3a26c558f967 req-360531f3-405a-4442-885f-f2708bd2fce2 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-plugged-4aa59cbf-eda8-40ba-a155-1826ecc9d850 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-aebb5fbf-f82a-4bdc-9533-3a26c558f967 req-360531f3-405a-4442-885f-f2708bd2fce2 service nova] Acquiring lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-aebb5fbf-f82a-4bdc-9533-3a26c558f967 req-360531f3-405a-4442-885f-f2708bd2fce2 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-aebb5fbf-f82a-4bdc-9533-3a26c558f967 req-360531f3-405a-4442-885f-f2708bd2fce2 service nova] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:25:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-aebb5fbf-f82a-4bdc-9533-3a26c558f967 req-360531f3-405a-4442-885f-f2708bd2fce2 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] No waiting events found dispatching network-vif-plugged-4aa59cbf-eda8-40ba-a155-1826ecc9d850 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:25:56 user nova-compute[72874]: WARNING nova.compute.manager [req-aebb5fbf-f82a-4bdc-9533-3a26c558f967 req-360531f3-405a-4442-885f-f2708bd2fce2 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received unexpected event network-vif-plugged-4aa59cbf-eda8-40ba-a155-1826ecc9d850 for instance with vm_state active and task_state deleting.
Aug 17 18:25:56 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296741.9240408, cf9f3116-5e42-4858-a391-ab75d2046f1a => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:25:56 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] VM Stopped (Lifecycle Event)
Aug 17 18:25:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-69d9305f-40db-4c9a-a86d-ba10efe6d46b None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:25:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-8c4fc0ff-c450-4630-9184-4751ed17e87a req-effec959-fe6a-44ab-ae9d-abdc2421d8b4 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-deleted-fdfe9b78-3799-41b0-87e0-88219cdaad87 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:25:58 user nova-compute[72874]: INFO nova.compute.manager [req-8c4fc0ff-c450-4630-9184-4751ed17e87a req-effec959-fe6a-44ab-ae9d-abdc2421d8b4 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Neutron deleted interface fdfe9b78-3799-41b0-87e0-88219cdaad87; detaching it from the instance and deleting it from the info cache
Aug 17 18:25:58 user nova-compute[72874]: DEBUG nova.network.neutron [req-8c4fc0ff-c450-4630-9184-4751ed17e87a req-effec959-fe6a-44ab-ae9d-abdc2421d8b4 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Updating instance_info_cache with network_info: [{"id": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "address": "fa:16:3e:c8:a8:2b", "network": {"id": "51ce5fe7-85ba-4c8a-9ba3-4b8823afea51", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-341654396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.147", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb19bfac-de", "ovs_interfaceid": "fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2a06f651-218f-42e4-aee0-40e733d5a891", "address": "fa:16:3e:46:26:f0", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a06f651-21", "ovs_interfaceid": "2a06f651-218f-42e4-aee0-40e733d5a891", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "025bb037-5e0c-45f3-96c2-09a83b224502", "address": "fa:16:3e:06:ed:ab", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.175", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025bb037-5e", "ovs_interfaceid": "025bb037-5e0c-45f3-96c2-09a83b224502", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "address": "fa:16:3e:67:28:cb", "network": {"id": "c12e2beb-609c-4c2d-b5eb-310f7d8e6a3d", "bridge": "br-int", "label": "tempest-device-tagging-net1-1466244777", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4aa59cbf-ed", "ovs_interfaceid": "4aa59cbf-eda8-40ba-a155-1826ecc9d850", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "address": "fa:16:3e:0d:77:c0", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e8d3da0-55", "ovs_interfaceid": "5e8d3da0-5572-4024-9d00-cc5b185bff71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "address": "fa:16:3e:f7:68:17", "network": {"id": "eff8425f-fbb1-4a34-a63a-a58df1b61e9d", "bridge": "br-int", "label": "tempest-device-tagging-net2-837580383", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "31af41fdde924ec880875f5b31ba1a87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape86b5e91-07", "ovs_interfaceid": "e86b5e91-071c-4b9e-80f0-7ce24ada55f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:25:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-8c4fc0ff-c450-4630-9184-4751ed17e87a req-effec959-fe6a-44ab-ae9d-abdc2421d8b4 service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Detach interface failed, port_id=fdfe9b78-3799-41b0-87e0-88219cdaad87, reason: Instance 8c998fa1-9430-4f03-bae7-ce510509a9be could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:26:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:00 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:26:00 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Took 4.25 seconds to deallocate network for instance.
Aug 17 18:26:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-26b582b0-f8f4-46b6-a02d-b3176a0e51ea req-993f8e8f-7717-42ad-b3f0-693780ad81fc service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-deleted-5e8d3da0-5572-4024-9d00-cc5b185bff71 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-26b582b0-f8f4-46b6-a02d-b3176a0e51ea req-993f8e8f-7717-42ad-b3f0-693780ad81fc service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-deleted-fb19bfac-de6c-40bd-ae3f-f6d8b23bf4c3 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-26b582b0-f8f4-46b6-a02d-b3176a0e51ea req-993f8e8f-7717-42ad-b3f0-693780ad81fc service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-deleted-e86b5e91-071c-4b9e-80f0-7ce24ada55f5 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-26b582b0-f8f4-46b6-a02d-b3176a0e51ea req-993f8e8f-7717-42ad-b3f0-693780ad81fc service nova] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Received event network-vif-deleted-4aa59cbf-eda8-40ba-a155-1826ecc9d850 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:02 user nova-compute[72874]: INFO nova.compute.manager [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Took 2.44 seconds to detach 3 volumes for instance.
Aug 17 18:26:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:03 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:26:03 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:26:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:03 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Deleted allocations for instance 8c998fa1-9430-4f03-bae7-ce510509a9be
Aug 17 18:26:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b508fa8-5ec0-4716-9d5a-053f1c3ec597 tempest-TaggedBootDevicesTest_v242-15839607 tempest-TaggedBootDevicesTest_v242-15839607-project-member] Lock "8c998fa1-9430-4f03-bae7-ce510509a9be" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.379s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296751.1245954, 2ace97e1-c2ee-462e-a929-22c7cb2584d2 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:26:06 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] VM Stopped (Lifecycle Event)
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-792af246-94ef-4cf0-a764-6cfcbce18bfd None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Starting finish_revert_migration {{(pid=72874) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Start _get_guest_xml network_info=[{"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJCicowN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2ace97e1-c2ee-462e-a929-22c7cb2584d2', 'attached_at': '2023-08-17T18:26:06.000000', 'detached_at': '', 'volume_id': '19c92b6f-990a-4e2a-97df-5bb870e61913', 'serial': '19c92b6f-990a-4e2a-97df-5bb870e61913'}, 'delete_on_termination': False, 'attachment_id': '12258b3c-ef17-4941-bff5-814a7803c5e3', 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:26:06 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:26:06 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.objects.instance [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2ace97e1-c2ee-462e-a929-22c7cb2584d2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJCicowN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:26:06 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:26:06 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:26:06 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bce035-9080-487e-a582-13b5e9d1b413]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:26:06 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d79331b-b686-49fc-9529-ce7c4cdc2019]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913] added
Aug 17 18:26:06 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c848631-625d-4a80-830a-d5e4aab5bc1f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22fcca8-70f0-491a-b017-3c3805eb9196]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJCicowN {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DJCicowN" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdd2ad1-7f13-43da-984f-ea75ee86e8e9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DJCicowN'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa233ac-e6a7-4d13-85ba-73f3a529561b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[901d7f00-0be2-40ef-9143-ef696ec64ab7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:26:06 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:26:06 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:26:06 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:26:06 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f51daf-c57a-4532-95cf-6cdb9237227b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260]
Aug 17 18:26:06 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260] successful.
Aug 17 18:26:06 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6a1fee-2d16-4369-add6-f9f58eff8216]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c125c4-e444-4a47-ae30-2205e47a9d65]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:26:06 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:26:06 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:26:06 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:26:06 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:26:06 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:26:06 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a505f308-144d-4e7c-98de-982871ea90ca]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:26:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJCicowN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26566643839373337', 'path': '/dev/sdd'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566643839373337', 'path': '/dev/sdd'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1594135899',display_name='tempest-ServerActionsTestOtherB-server-1594135899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1594135899',id=13,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJL0wGDO9yYxM59zaPj86jL9bZvPsFDy3YJOsbSwVi+3h9+DinmjEtIZue1FvAOYIc54lSepvgAxdfqkbFKLJ90/SAHzFU18VdJmA0Lh/YqOsAztJ9gMRfqGTMWDprprBA==',key_name='tempest-keypair-1720427808',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:24:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ad9005fd344e470482b0b90baeb97515',ramdisk_id='',reservation_id='r-5cqpdw10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1909498304',owner_user_name='tempest-ServerActionsTestOtherB-1909498304-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:25:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31f7828a072847dc9cb4d4fd51908366',uuid=2ace97e1-c2ee-462e-a929-22c7cb2584d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converting VIF {"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:26:07 user nova-compute[72874]:   <uuid>2ace97e1-c2ee-462e-a929-22c7cb2584d2</uuid>
Aug 17 18:26:07 user nova-compute[72874]:   <name>instance-0000000d</name>
Aug 17 18:26:07 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:26:07 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:26:07 user nova-compute[72874]:   <metadata>
Aug 17 18:26:07 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:26:07 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:26:07 user nova-compute[72874]:       <nova:name>tempest-ServerActionsTestOtherB-server-1594135899</nova:name>
Aug 17 18:26:07 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:26:06</nova:creationTime>
Aug 17 18:26:07 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:26:07 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:26:07 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:26:07 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:26:07 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:26:07 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:26:07 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:26:07 user nova-compute[72874]:       <nova:owner>
Aug 17 18:26:07 user nova-compute[72874]:         <nova:user uuid="31f7828a072847dc9cb4d4fd51908366">tempest-ServerActionsTestOtherB-1909498304-project-member</nova:user>
Aug 17 18:26:07 user nova-compute[72874]:         <nova:project uuid="ad9005fd344e470482b0b90baeb97515">tempest-ServerActionsTestOtherB-1909498304</nova:project>
Aug 17 18:26:07 user nova-compute[72874]:       </nova:owner>
Aug 17 18:26:07 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:26:07 user nova-compute[72874]:       <nova:ports>
Aug 17 18:26:07 user nova-compute[72874]:         <nova:port uuid="d6319754-2bba-45a4-9db3-9fcf99c0c33c">
Aug 17 18:26:07 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 18:26:07 user nova-compute[72874]:         </nova:port>
Aug 17 18:26:07 user nova-compute[72874]:       </nova:ports>
Aug 17 18:26:07 user nova-compute[72874]:     </nova:instance>
Aug 17 18:26:07 user nova-compute[72874]:   </metadata>
Aug 17 18:26:07 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:26:07 user nova-compute[72874]:     <system>
Aug 17 18:26:07 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:26:07 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:26:07 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:26:07 user nova-compute[72874]:       <entry name="serial">2ace97e1-c2ee-462e-a929-22c7cb2584d2</entry>
Aug 17 18:26:07 user nova-compute[72874]:       <entry name="uuid">2ace97e1-c2ee-462e-a929-22c7cb2584d2</entry>
Aug 17 18:26:07 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:26:07 user nova-compute[72874]:     </system>
Aug 17 18:26:07 user nova-compute[72874]:   </sysinfo>
Aug 17 18:26:07 user nova-compute[72874]:   <os>
Aug 17 18:26:07 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:26:07 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:26:07 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:26:07 user nova-compute[72874]:   </os>
Aug 17 18:26:07 user nova-compute[72874]:   <features>
Aug 17 18:26:07 user nova-compute[72874]:     <acpi/>
Aug 17 18:26:07 user nova-compute[72874]:     <apic/>
Aug 17 18:26:07 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:26:07 user nova-compute[72874]:   </features>
Aug 17 18:26:07 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:26:07 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:26:07 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:26:07 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:26:07 user nova-compute[72874]:   </clock>
Aug 17 18:26:07 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:26:07 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:26:07 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:26:07 user nova-compute[72874]:   </cpu>
Aug 17 18:26:07 user nova-compute[72874]:   <devices>
Aug 17 18:26:07 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:26:07 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:26:07 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk"/>
Aug 17 18:26:07 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:26:07 user nova-compute[72874]:     </disk>
Aug 17 18:26:07 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:26:07 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:26:07 user nova-compute[72874]:       <source dev="/dev/sdd"/>
Aug 17 18:26:07 user nova-compute[72874]:       <target dev="vdb" bus="virtio"/>
Aug 17 18:26:07 user nova-compute[72874]:       <serial>19c92b6f-990a-4e2a-97df-5bb870e61913</serial>
Aug 17 18:26:07 user nova-compute[72874]:     </disk>
Aug 17 18:26:07 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:26:07 user nova-compute[72874]:       <mac address="fa:16:3e:80:58:cc"/>
Aug 17 18:26:07 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:26:07 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:26:07 user nova-compute[72874]:       <target dev="tapd6319754-2b"/>
Aug 17 18:26:07 user nova-compute[72874]:     </interface>
Aug 17 18:26:07 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:26:07 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/console.log" append="off"/>
Aug 17 18:26:07 user nova-compute[72874]:     </serial>
Aug 17 18:26:07 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:26:07 user nova-compute[72874]:     <video>
Aug 17 18:26:07 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:26:07 user nova-compute[72874]:     </video>
Aug 17 18:26:07 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:26:07 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:26:07 user nova-compute[72874]:     </rng>
Aug 17 18:26:07 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:26:07 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:26:07 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:26:07 user nova-compute[72874]:     </memballoon>
Aug 17 18:26:07 user nova-compute[72874]:   </devices>
Aug 17 18:26:07 user nova-compute[72874]: </domain>
Aug 17 18:26:07 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1594135899',display_name='tempest-ServerActionsTestOtherB-server-1594135899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1594135899',id=13,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJL0wGDO9yYxM59zaPj86jL9bZvPsFDy3YJOsbSwVi+3h9+DinmjEtIZue1FvAOYIc54lSepvgAxdfqkbFKLJ90/SAHzFU18VdJmA0Lh/YqOsAztJ9gMRfqGTMWDprprBA==',key_name='tempest-keypair-1720427808',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:24:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='ad9005fd344e470482b0b90baeb97515',ramdisk_id='',reservation_id='r-5cqpdw10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1909498304',owner_user_name='tempest-ServerActionsTestOtherB-1909498304-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:25:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31f7828a072847dc9cb4d4fd51908366',uuid=2ace97e1-c2ee-462e-a929-22c7cb2584d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converting VIF {"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG os_vif [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6319754-2b, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6319754-2b, col_values=(('external_ids', {'iface-id': 'd6319754-2bba-45a4-9db3-9fcf99c0c33c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:58:cc', 'vm-uuid': '2ace97e1-c2ee-462e-a929-22c7cb2584d2'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:26:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:07 user nova-compute[72874]: INFO os_vif [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b')
Aug 17 18:26:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:09 user nova-compute[72874]: DEBUG nova.compute.manager [req-bf9fa9fc-d336-470e-bac3-d36ff5642844 req-fa01422f-a37f-4502-9eea-20ab270eb7c1 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bf9fa9fc-d336-470e-bac3-d36ff5642844 req-fa01422f-a37f-4502-9eea-20ab270eb7c1 service nova] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bf9fa9fc-d336-470e-bac3-d36ff5642844 req-fa01422f-a37f-4502-9eea-20ab270eb7c1 service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bf9fa9fc-d336-470e-bac3-d36ff5642844 req-fa01422f-a37f-4502-9eea-20ab270eb7c1 service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:09 user nova-compute[72874]: DEBUG nova.compute.manager [req-bf9fa9fc-d336-470e-bac3-d36ff5642844 req-fa01422f-a37f-4502-9eea-20ab270eb7c1 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] No waiting events found dispatching network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:26:09 user nova-compute[72874]: WARNING nova.compute.manager [req-bf9fa9fc-d336-470e-bac3-d36ff5642844 req-fa01422f-a37f-4502-9eea-20ab270eb7c1 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received unexpected event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c for instance with vm_state resized and task_state resize_reverting.
Aug 17 18:26:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:09 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296754.7478786, 8c998fa1-9430-4f03-bae7-ce510509a9be => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:26:09 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] VM Stopped (Lifecycle Event)
Aug 17 18:26:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-7f39c3ef-06a4-4509-8276-7f247dbb9df0 None None] [instance: 8c998fa1-9430-4f03-bae7-ce510509a9be] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:26:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:09 user nova-compute[72874]: INFO nova.compute.manager [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Terminating instance
Aug 17 18:26:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-301132d3-ad24-4590-a326-8193cbe688ae req-958c0b9f-337f-4d8c-b016-b958c638bbde service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received event network-vif-unplugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-301132d3-ad24-4590-a326-8193cbe688ae req-958c0b9f-337f-4d8c-b016-b958c638bbde service nova] Acquiring lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-301132d3-ad24-4590-a326-8193cbe688ae req-958c0b9f-337f-4d8c-b016-b958c638bbde service nova] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-301132d3-ad24-4590-a326-8193cbe688ae req-958c0b9f-337f-4d8c-b016-b958c638bbde service nova] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-301132d3-ad24-4590-a326-8193cbe688ae req-958c0b9f-337f-4d8c-b016-b958c638bbde service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] No waiting events found dispatching network-vif-unplugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-301132d3-ad24-4590-a326-8193cbe688ae req-958c0b9f-337f-4d8c-b016-b958c638bbde service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received event network-vif-unplugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:10 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Instance destroyed successfully.
Aug 17 18:26:10 user nova-compute[72874]: DEBUG nova.objects.instance [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'resources' on Instance uuid 3a2a5fdd-3a21-413b-981a-ecc33051c87b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T18:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1964684843',display_name='tempest-ServerActionsTestOtherA-server-1764804288',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1964684843',id=14,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMpdpfwA+5BzocXAcrapnfCncndWRFtxZCCWpFGlZmI4prUOsZ4cc20CF7Cba6pgb2rHGqRdFOT249RYmqz/f4penXjArDXnxaMRBbAPn+IOmceDrtZRM7Mttzd+GNOXw==',key_name='tempest-keypair-1182001619',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:22:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4aa04d3ed68a4542b32e2efeca25222a',ramdisk_id='',reservation_id='r-f8meq89l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1332351935',owner_user_name='tempest-ServerActionsTestOtherA-1332351935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:22:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaaa47a37543427eaa1712d29c419dd9',uuid=3a2a5fdd-3a21-413b-981a-ecc33051c87b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converting VIF {"id": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "address": "fa:16:3e:15:fc:2c", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd5a0e28-4b", "ovs_interfaceid": "fd5a0e28-4b48-4668-b9d6-2108a63c618f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=fd5a0e28-4b48-4668-b9d6-2108a63c618f,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5a0e28-4b') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG os_vif [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=fd5a0e28-4b48-4668-b9d6-2108a63c618f,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5a0e28-4b') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd5a0e28-4b, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:10 user nova-compute[72874]: INFO os_vif [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=fd5a0e28-4b48-4668-b9d6-2108a63c618f,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd5a0e28-4b')
Aug 17 18:26:10 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Deleting instance files /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b_del
Aug 17 18:26:10 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Deletion of /opt/stack/data/nova/instances/3a2a5fdd-3a21-413b-981a-ecc33051c87b_del complete
Aug 17 18:26:10 user nova-compute[72874]: INFO nova.compute.manager [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Took 0.96 seconds to destroy the instance on the hypervisor.
Aug 17 18:26:10 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:26:10 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:26:11 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296771.3537226, 2ace97e1-c2ee-462e-a929-22c7cb2584d2 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:26:11 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] VM Resumed (Lifecycle Event)
Aug 17 18:26:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:26:11 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Instance running successfully.
Aug 17 18:26:11 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] finish_revert_migration finished successfully. {{(pid=72874) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 17 18:26:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:26:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:26:11 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 18:26:11 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296771.3548527, 2ace97e1-c2ee-462e-a929-22c7cb2584d2 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:26:11 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] VM Started (Lifecycle Event)
Aug 17 18:26:11 user nova-compute[72874]: DEBUG nova.compute.manager [req-81df25fe-bffd-4965-9c22-beb667d27a78 req-f63d8a8f-35fb-426c-9f9d-7c6e779f9497 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-81df25fe-bffd-4965-9c22-beb667d27a78 req-f63d8a8f-35fb-426c-9f9d-7c6e779f9497 service nova] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-81df25fe-bffd-4965-9c22-beb667d27a78 req-f63d8a8f-35fb-426c-9f9d-7c6e779f9497 service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-81df25fe-bffd-4965-9c22-beb667d27a78 req-f63d8a8f-35fb-426c-9f9d-7c6e779f9497 service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:11 user nova-compute[72874]: DEBUG nova.compute.manager [req-81df25fe-bffd-4965-9c22-beb667d27a78 req-f63d8a8f-35fb-426c-9f9d-7c6e779f9497 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] No waiting events found dispatching network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:26:11 user nova-compute[72874]: WARNING nova.compute.manager [req-81df25fe-bffd-4965-9c22-beb667d27a78 req-f63d8a8f-35fb-426c-9f9d-7c6e779f9497 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received unexpected event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c for instance with vm_state resized and task_state resize_reverting.
Aug 17 18:26:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:26:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:26:11 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 18:26:11 user nova-compute[72874]: INFO nova.compute.manager [None req-ce3ebccb-8ed6-46bc-9e27-a49dded4ba4f tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updating instance to original state: 'active'
Aug 17 18:26:11 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:26:11 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Took 0.99 seconds to deallocate network for instance.
Aug 17 18:26:11 user nova-compute[72874]: DEBUG nova.compute.manager [req-a35c2795-82c4-405e-8618-1ccaed85ac54 req-f697556c-e258-4d9e-8a4c-daabb895e3c0 service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received event network-vif-deleted-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:12 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:26:12 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:26:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:12 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Deleted allocations for instance 3a2a5fdd-3a21-413b-981a-ecc33051c87b
Aug 17 18:26:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-54af74b7-985b-420e-bcf2-82122a15eb4a req-e357533d-93b4-428c-ab52-af89cafa2f4c service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received event network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-54af74b7-985b-420e-bcf2-82122a15eb4a req-e357533d-93b4-428c-ab52-af89cafa2f4c service nova] Acquiring lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-54af74b7-985b-420e-bcf2-82122a15eb4a req-e357533d-93b4-428c-ab52-af89cafa2f4c service nova] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-54af74b7-985b-420e-bcf2-82122a15eb4a req-e357533d-93b4-428c-ab52-af89cafa2f4c service nova] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-54af74b7-985b-420e-bcf2-82122a15eb4a req-e357533d-93b4-428c-ab52-af89cafa2f4c service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] No waiting events found dispatching network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:26:12 user nova-compute[72874]: WARNING nova.compute.manager [req-54af74b7-985b-420e-bcf2-82122a15eb4a req-e357533d-93b4-428c-ab52-af89cafa2f4c service nova] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Received unexpected event network-vif-plugged-fd5a0e28-4b48-4668-b9d6-2108a63c618f for instance with vm_state deleted and task_state None.
Aug 17 18:26:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ea660f91-525c-4e45-8791-31a911bdbf56 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "3a2a5fdd-3a21-413b-981a-ecc33051c87b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.449s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:13 user nova-compute[72874]: DEBUG nova.compute.manager [req-a94c8799-b330-4aed-a884-6f07bdb79fc5 req-6928f452-19bc-47cc-9c06-3d0c27cd0889 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received event network-changed-3a5303af-3fe8-41ec-a01c-5a0223d20dfa {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:13 user nova-compute[72874]: DEBUG nova.compute.manager [req-a94c8799-b330-4aed-a884-6f07bdb79fc5 req-6928f452-19bc-47cc-9c06-3d0c27cd0889 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Refreshing instance network info cache due to event network-changed-3a5303af-3fe8-41ec-a01c-5a0223d20dfa. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:26:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a94c8799-b330-4aed-a884-6f07bdb79fc5 req-6928f452-19bc-47cc-9c06-3d0c27cd0889 service nova] Acquiring lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:26:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a94c8799-b330-4aed-a884-6f07bdb79fc5 req-6928f452-19bc-47cc-9c06-3d0c27cd0889 service nova] Acquired lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:26:13 user nova-compute[72874]: DEBUG nova.network.neutron [req-a94c8799-b330-4aed-a884-6f07bdb79fc5 req-6928f452-19bc-47cc-9c06-3d0c27cd0889 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Refreshing network info cache for port 3a5303af-3fe8-41ec-a01c-5a0223d20dfa {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "interface-e92e565e-c5d9-433e-8c6a-0cb049c000a7-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "interface-e92e565e-c5d9-433e-8c6a-0cb049c000a7-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lazy-loading 'flavor' on Instance uuid e92e565e-c5d9-433e-8c6a-0cb049c000a7 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG nova.network.neutron [req-a94c8799-b330-4aed-a884-6f07bdb79fc5 req-6928f452-19bc-47cc-9c06-3d0c27cd0889 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Updated VIF entry in instance network info cache for port 3a5303af-3fe8-41ec-a01c-5a0223d20dfa. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG nova.network.neutron [req-a94c8799-b330-4aed-a884-6f07bdb79fc5 req-6928f452-19bc-47cc-9c06-3d0c27cd0889 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Updating instance_info_cache with network_info: [{"id": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "address": "fa:16:3e:6d:2e:95", "network": {"id": "d73d605d-c67e-4657-9771-76c2544cbe76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-764769447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5303af-3f", "ovs_interfaceid": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a94c8799-b330-4aed-a884-6f07bdb79fc5 req-6928f452-19bc-47cc-9c06-3d0c27cd0889 service nova] Releasing lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lazy-loading 'pci_requests' on Instance uuid e92e565e-c5d9-433e-8c6a-0cb049c000a7 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG nova.policy [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb48e4d34e494fabbe1af3fd7eef2f76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56c8770bee784ba5af885002d30db7dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:26:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:26:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:15 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Successfully created port: d95cf4a2-706e-43fb-9929-37ad8e0a86b9 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:26:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Successfully updated port: d95cf4a2-706e-43fb-9929-37ad8e0a86b9 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquired lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG nova.compute.manager [req-9ac993ed-6b6e-4a41-8fac-0d80b9d79517 req-1176823b-3f83-49bb-90ca-78c5a1f78d61 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received event network-changed-d95cf4a2-706e-43fb-9929-37ad8e0a86b9 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG nova.compute.manager [req-9ac993ed-6b6e-4a41-8fac-0d80b9d79517 req-1176823b-3f83-49bb-90ca-78c5a1f78d61 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Refreshing instance network info cache due to event network-changed-d95cf4a2-706e-43fb-9929-37ad8e0a86b9. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9ac993ed-6b6e-4a41-8fac-0d80b9d79517 req-1176823b-3f83-49bb-90ca-78c5a1f78d61 service nova] Acquiring lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Updating instance_info_cache with network_info: [{"id": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "address": "fa:16:3e:6d:2e:95", "network": {"id": "d73d605d-c67e-4657-9771-76c2544cbe76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-764769447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5303af-3f", "ovs_interfaceid": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "address": "fa:16:3e:f5:a4:2b", "network": {"id": "2fe8990f-0979-4edb-92ee-74781b50ee58", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-967890750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95cf4a2-70", "ovs_interfaceid": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:26:17 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:26:17 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7889MB free_disk=25.34518051147461GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Releasing lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9ac993ed-6b6e-4a41-8fac-0d80b9d79517 req-1176823b-3f83-49bb-90ca-78c5a1f78d61 service nova] Acquired lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.network.neutron [req-9ac993ed-6b6e-4a41-8fac-0d80b9d79517 req-1176823b-3f83-49bb-90ca-78c5a1f78d61 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Refreshing network info cache for port d95cf4a2-706e-43fb-9929-37ad8e0a86b9 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784183103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784183103',id=22,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODORGFU372BNdOaIwC88Uz6tubqWS+C4jqGAbM5re2MuHMJFjzHyXf/75k8RdxtFKwcVsHrr4vNfLeqVS5Zfg09lw8vrsW0zlhTritsP1Yjsx1ETqQHCdS8D+8n7979wg==',key_name='tempest-keypair-1258010050',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:24:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56c8770bee784ba5af885002d30db7dc',ramdisk_id='',reservation_id='r-numhxl95',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-671856852',owner_user_name='tempest-TaggedAttachmentsTest-671856852-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:24:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48e4d34e494fabbe1af3fd7eef2f76',uuid=e92e565e-c5d9-433e-8c6a-0cb049c000a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "address": "fa:16:3e:f5:a4:2b", "network": {"id": "2fe8990f-0979-4edb-92ee-74781b50ee58", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-967890750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95cf4a2-70", "ovs_interfaceid": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Converting VIF {"id": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "address": "fa:16:3e:f5:a4:2b", "network": {"id": "2fe8990f-0979-4edb-92ee-74781b50ee58", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-967890750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95cf4a2-70", "ovs_interfaceid": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a4:2b,bridge_name='br-int',has_traffic_filtering=True,id=d95cf4a2-706e-43fb-9929-37ad8e0a86b9,network=Network(2fe8990f-0979-4edb-92ee-74781b50ee58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95cf4a2-70') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG os_vif [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a4:2b,bridge_name='br-int',has_traffic_filtering=True,id=d95cf4a2-706e-43fb-9929-37ad8e0a86b9,network=Network(2fe8990f-0979-4edb-92ee-74781b50ee58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95cf4a2-70') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd95cf4a2-70, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd95cf4a2-70, col_values=(('external_ids', {'iface-id': 'd95cf4a2-706e-43fb-9929-37ad8e0a86b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:a4:2b', 'vm-uuid': 'e92e565e-c5d9-433e-8c6a-0cb049c000a7'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:17 user nova-compute[72874]: INFO os_vif [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a4:2b,bridge_name='br-int',has_traffic_filtering=True,id=d95cf4a2-706e-43fb-9929-37ad8e0a86b9,network=Network(2fe8990f-0979-4edb-92ee-74781b50ee58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95cf4a2-70')
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784183103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784183103',id=22,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODORGFU372BNdOaIwC88Uz6tubqWS+C4jqGAbM5re2MuHMJFjzHyXf/75k8RdxtFKwcVsHrr4vNfLeqVS5Zfg09lw8vrsW0zlhTritsP1Yjsx1ETqQHCdS8D+8n7979wg==',key_name='tempest-keypair-1258010050',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:24:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='56c8770bee784ba5af885002d30db7dc',ramdisk_id='',reservation_id='r-numhxl95',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-671856852',owner_user_name='tempest-TaggedAttachmentsTest-671856852-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:24:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48e4d34e494fabbe1af3fd7eef2f76',uuid=e92e565e-c5d9-433e-8c6a-0cb049c000a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "address": "fa:16:3e:f5:a4:2b", "network": {"id": "2fe8990f-0979-4edb-92ee-74781b50ee58", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-967890750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95cf4a2-70", "ovs_interfaceid": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Converting VIF {"id": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "address": "fa:16:3e:f5:a4:2b", "network": {"id": "2fe8990f-0979-4edb-92ee-74781b50ee58", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-967890750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95cf4a2-70", "ovs_interfaceid": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a4:2b,bridge_name='br-int',has_traffic_filtering=True,id=d95cf4a2-706e-43fb-9929-37ad8e0a86b9,network=Network(2fe8990f-0979-4edb-92ee-74781b50ee58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95cf4a2-70') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] attach device xml: <interface type="ethernet">
Aug 17 18:26:17 user nova-compute[72874]:   <mac address="fa:16:3e:f5:a4:2b"/>
Aug 17 18:26:17 user nova-compute[72874]:   <model type="virtio"/>
Aug 17 18:26:17 user nova-compute[72874]:   <mtu size="1442"/>
Aug 17 18:26:17 user nova-compute[72874]:   <target dev="tapd95cf4a2-70"/>
Aug 17 18:26:17 user nova-compute[72874]: </interface>
Aug 17 18:26:17 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 857d43f7-6f53-4c82-9e68-fca3078e97ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 7044ab36-115d-454b-a787-b3199a815d4e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2ace97e1-c2ee-462e-a929-22c7cb2584d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance e92e565e-c5d9-433e-8c6a-0cb049c000a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] No BDM found with device name hda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] No VIF found with MAC fa:16:3e:6d:2e:95, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:26:17 user nova-compute[72874]:   <nova:package version="0.0.0"/>
Aug 17 18:26:17 user nova-compute[72874]:   <nova:name>tempest-device-tagging-server-1784183103</nova:name>
Aug 17 18:26:17 user nova-compute[72874]:   <nova:creationTime>2023-08-17 18:26:17</nova:creationTime>
Aug 17 18:26:17 user nova-compute[72874]:   <nova:flavor name="m1.tiny">
Aug 17 18:26:17 user nova-compute[72874]:     <nova:memory>512</nova:memory>
Aug 17 18:26:17 user nova-compute[72874]:     <nova:disk>1</nova:disk>
Aug 17 18:26:17 user nova-compute[72874]:     <nova:swap>0</nova:swap>
Aug 17 18:26:17 user nova-compute[72874]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:26:17 user nova-compute[72874]:     <nova:vcpus>1</nova:vcpus>
Aug 17 18:26:17 user nova-compute[72874]:   </nova:flavor>
Aug 17 18:26:17 user nova-compute[72874]:   <nova:owner>
Aug 17 18:26:17 user nova-compute[72874]:     <nova:user uuid="eb48e4d34e494fabbe1af3fd7eef2f76">tempest-TaggedAttachmentsTest-671856852-project-member</nova:user>
Aug 17 18:26:17 user nova-compute[72874]:     <nova:project uuid="56c8770bee784ba5af885002d30db7dc">tempest-TaggedAttachmentsTest-671856852</nova:project>
Aug 17 18:26:17 user nova-compute[72874]:   </nova:owner>
Aug 17 18:26:17 user nova-compute[72874]:   <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:26:17 user nova-compute[72874]:   <nova:ports>
Aug 17 18:26:17 user nova-compute[72874]:     <nova:port uuid="3a5303af-3fe8-41ec-a01c-5a0223d20dfa">
Aug 17 18:26:17 user nova-compute[72874]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 18:26:17 user nova-compute[72874]:     </nova:port>
Aug 17 18:26:17 user nova-compute[72874]:     <nova:port uuid="d95cf4a2-706e-43fb-9929-37ad8e0a86b9">
Aug 17 18:26:17 user nova-compute[72874]:       <nova:ip type="fixed" address="10.10.10.131" ipVersion="4"/>
Aug 17 18:26:17 user nova-compute[72874]:     </nova:port>
Aug 17 18:26:17 user nova-compute[72874]:   </nova:ports>
Aug 17 18:26:17 user nova-compute[72874]: </nova:instance>
Aug 17 18:26:17 user nova-compute[72874]:  {{(pid=72874) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 18:26:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b00a99c2-d126-4a87-ad85-1c197c94cc8e tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "interface-e92e565e-c5d9-433e-8c6a-0cb049c000a7-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.558s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG nova.objects.instance [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lazy-loading 'flavor' on Instance uuid e92e565e-c5d9-433e-8c6a-0cb049c000a7 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG nova.compute.manager [req-c8c6feee-71e7-4af9-b5b5-39088fd428af req-a1aeaa09-8fa3-4b01-8441-d10fda4a2c2c service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received event network-vif-plugged-d95cf4a2-706e-43fb-9929-37ad8e0a86b9 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c8c6feee-71e7-4af9-b5b5-39088fd428af req-a1aeaa09-8fa3-4b01-8441-d10fda4a2c2c service nova] Acquiring lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c8c6feee-71e7-4af9-b5b5-39088fd428af req-a1aeaa09-8fa3-4b01-8441-d10fda4a2c2c service nova] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c8c6feee-71e7-4af9-b5b5-39088fd428af req-a1aeaa09-8fa3-4b01-8441-d10fda4a2c2c service nova] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG nova.compute.manager [req-c8c6feee-71e7-4af9-b5b5-39088fd428af req-a1aeaa09-8fa3-4b01-8441-d10fda4a2c2c service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] No waiting events found dispatching network-vif-plugged-d95cf4a2-706e-43fb-9929-37ad8e0a86b9 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:26:18 user nova-compute[72874]: WARNING nova.compute.manager [req-c8c6feee-71e7-4af9-b5b5-39088fd428af req-a1aeaa09-8fa3-4b01-8441-d10fda4a2c2c service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received unexpected event network-vif-plugged-d95cf4a2-706e-43fb-9929-37ad8e0a86b9 for instance with vm_state active and task_state None.
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG nova.network.neutron [req-9ac993ed-6b6e-4a41-8fac-0d80b9d79517 req-1176823b-3f83-49bb-90ca-78c5a1f78d61 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Updated VIF entry in instance network info cache for port d95cf4a2-706e-43fb-9929-37ad8e0a86b9. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG nova.network.neutron [req-9ac993ed-6b6e-4a41-8fac-0d80b9d79517 req-1176823b-3f83-49bb-90ca-78c5a1f78d61 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Updating instance_info_cache with network_info: [{"id": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "address": "fa:16:3e:6d:2e:95", "network": {"id": "d73d605d-c67e-4657-9771-76c2544cbe76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-764769447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5303af-3f", "ovs_interfaceid": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "address": "fa:16:3e:f5:a4:2b", "network": {"id": "2fe8990f-0979-4edb-92ee-74781b50ee58", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-967890750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95cf4a2-70", "ovs_interfaceid": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9ac993ed-6b6e-4a41-8fac-0d80b9d79517 req-1176823b-3f83-49bb-90ca-78c5a1f78d61 service nova] Releasing lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:18 user nova-compute[72874]: INFO nova.compute.manager [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Attaching volume 211a3b07-a88b-473b-9e39-f5f5560dc5f2 to /dev/vdb
Aug 17 18:26:18 user nova-compute[72874]: DEBUG os_brick.utils [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[03af7995-736f-43d0-85aa-83b2d2c69e51]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[076ab31f-abf9-41dd-9597-7453eedd9fd3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c016cd-8efd-41bb-8242-7829d7c0fdf6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f55015e-09f7-470f-9792-7f203b5e3dc7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:26:18 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[36abbb04-aa3d-4047-9277-f5923fa0900e]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG os_brick.utils [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Updating existing volume attachment record: 9704a2a6-b1fd-4d9f-964c-9fb0d241aa6b {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:26:18 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:26:19 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:26:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG nova.compute.manager [req-92b7b071-73d1-4e19-9513-d2d16d6c25ee req-e87324af-7791-496f-8b7b-474a84911b3f service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received event network-vif-plugged-d95cf4a2-706e-43fb-9929-37ad8e0a86b9 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-92b7b071-73d1-4e19-9513-d2d16d6c25ee req-e87324af-7791-496f-8b7b-474a84911b3f service nova] Acquiring lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-92b7b071-73d1-4e19-9513-d2d16d6c25ee req-e87324af-7791-496f-8b7b-474a84911b3f service nova] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-92b7b071-73d1-4e19-9513-d2d16d6c25ee req-e87324af-7791-496f-8b7b-474a84911b3f service nova] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG nova.compute.manager [req-92b7b071-73d1-4e19-9513-d2d16d6c25ee req-e87324af-7791-496f-8b7b-474a84911b3f service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] No waiting events found dispatching network-vif-plugged-d95cf4a2-706e-43fb-9929-37ad8e0a86b9 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:26:20 user nova-compute[72874]: WARNING nova.compute.manager [req-92b7b071-73d1-4e19-9513-d2d16d6c25ee req-e87324af-7791-496f-8b7b-474a84911b3f service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received unexpected event network-vif-plugged-d95cf4a2-706e-43fb-9929-37ad8e0a86b9 for instance with vm_state active and task_state None.
Aug 17 18:26:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-857d43f7-6f53-4c82-9e68-fca3078e97ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-857d43f7-6f53-4c82-9e68-fca3078e97ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:20 user nova-compute[72874]: INFO nova.compute.manager [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Detaching volume 55359bd1-db03-480e-b33c-29e2c6decfb5
Aug 17 18:26:20 user nova-compute[72874]: INFO nova.virt.block_device [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Attempting to driver detach volume 55359bd1-db03-480e-b33c-29e2c6decfb5 from mountpoint /dev/vdb
Aug 17 18:26:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Attempting to detach device vdb from instance 857d43f7-6f53-4c82-9e68-fca3078e97ea from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:26:20 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:26:20 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:26:20 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:26:20 user nova-compute[72874]:   <serial>55359bd1-db03-480e-b33c-29e2c6decfb5</serial>
Aug 17 18:26:20 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:26:20 user nova-compute[72874]: </disk>
Aug 17 18:26:20 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:26:20 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Successfully detached device vdb from instance 857d43f7-6f53-4c82-9e68-fca3078e97ea from the persistent domain config.
Aug 17 18:26:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 857d43f7-6f53-4c82-9e68-fca3078e97ea from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:26:20 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:26:20 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:26:20 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:26:20 user nova-compute[72874]:   <serial>55359bd1-db03-480e-b33c-29e2c6decfb5</serial>
Aug 17 18:26:20 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:26:20 user nova-compute[72874]: </disk>
Aug 17 18:26:20 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Updating instance_info_cache with network_info: [{"id": "903af9b8-b067-4ada-adc9-3183fe6654ed", "address": "fa:16:3e:85:9f:87", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903af9b8-b0", "ovs_interfaceid": "903af9b8-b067-4ada-adc9-3183fe6654ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-857d43f7-6f53-4c82-9e68-fca3078e97ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:26:20 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692296781.0967734, 857d43f7-6f53-4c82-9e68-fca3078e97ea => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 857d43f7-6f53-4c82-9e68-fca3078e97ea {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:26:21 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Successfully detached device vdb from instance 857d43f7-6f53-4c82-9e68-fca3078e97ea from the live domain config.
Aug 17 18:26:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUptiyMr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:26:21 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[20942dd2-f133-4eb2-8d2c-b98aef9b115a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12c336f-5a7f-4755-b126-dc63526f487a]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:26:21 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:26:21 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:26:21 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 (non-flash)
Aug 17 18:26:21 user nova-compute[72874]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:26:21 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:26:21 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a059d990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5'): ({'sdc'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Removing single pathed devices sdc {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eb7107-2bc0-444d-9367-987d3067a99b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffee8eb5-f7f8-4928-b2a3-e9da8f505a9a]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Flushing IO for device /dev/sdc {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[579f76b7-95cc-44e0-a312-d5e13c6cc7fb]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba65fdf-18da-4f0c-9bdf-1ca2b59d1ffc]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3c1b39-4283-4975-9ecf-52285799d5ed]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[777cb0bf-9670-4f8f-b8b0-bc8d182123c2]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5, portal: 172.16.0.220,3260]
Aug 17 18:26:21 user nova-compute[72874]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5, portal: 172.16.0.220,3260] successful.
Aug 17 18:26:21 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55359bd1-db03-480e-b33c-29e2c6decfb5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef177ea4-ef8e-4620-9021-e728f6bd89a4]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] <== disconnect_volume: return (280ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:26:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:26:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:22 user nova-compute[72874]: DEBUG nova.objects.instance [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'flavor' on Instance uuid 857d43f7-6f53-4c82-9e68-fca3078e97ea {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:26:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1263f13d-eeb1-4dce-a825-2575e2759c19 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.896s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:24 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:26:24 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:26:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:26:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:25 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296770.6933563, 3a2a5fdd-3a21-413b-981a-ecc33051c87b => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:26:25 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] VM Stopped (Lifecycle Event)
Aug 17 18:26:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-7983fc47-50f4-4520-84ed-8bb045def809 None None] [instance: 3a2a5fdd-3a21-413b-981a-ecc33051c87b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:26:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuBaNpQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:26:30 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:26:30 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:26:30 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c884c77e-1439-4bdd-8c87-417d044d7190]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:26:30 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc875b8b-1023-48ef-8b94-5b6a6bbe86eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2] added
Aug 17 18:26:30 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf14ace-4c4e-439b-b822-b103c27b72ec]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[00af35bc-17f2-43dc-b57f-39dae4e74b2d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuBaNpQf {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DuBaNpQf" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4886c35-9c1f-44b3-8d6d-aa8863ae2da1]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DuBaNpQf'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cc26d5-7dbb-446f-be3f-4c9268cbfa02]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b635c0-c05b-4e5c-bad2-870dca2410e2]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:26:30 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:26:30 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:26:30 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:26:30 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac003f9-45f4-4841-9e55-0eb40128cb32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2, portal: 172.16.0.220,3260]
Aug 17 18:26:30 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2, portal: 172.16.0.220,3260] successful.
Aug 17 18:26:30 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e651f627-26d8-44a0-95c1-ec5cde1d51ab]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9e22fe-366d-425e-bcee-6a2bbb8fb1f0]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:26:30 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:26:30 user nova-compute[72874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 (non-flash)
Aug 17 18:26:30 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:26:30 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:26:30 user nova-compute[72874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 (non-flash)
Aug 17 18:26:30 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4f8c74-c2c4-4a9e-a754-644eb51f38af]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:30 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:26:31 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:26:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuBaNpQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:26:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:26:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23963393738303131', 'path': '/dev/sdc'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:26:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963393738303131', 'path': '/dev/sdc'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:26:31 user nova-compute[72874]: DEBUG nova.objects.instance [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lazy-loading 'flavor' on Instance uuid e92e565e-c5d9-433e-8c6a-0cb049c000a7 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:26:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:26:31 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:26:31 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:26:31 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:26:31 user nova-compute[72874]:   <serial>211a3b07-a88b-473b-9e39-f5f5560dc5f2</serial>
Aug 17 18:26:31 user nova-compute[72874]: </disk>
Aug 17 18:26:31 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:26:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:26:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] No BDM found with device name hda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:26:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] No VIF found with MAC fa:16:3e:6d:2e:95, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:26:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4df94cd8-e70e-4f57-a221-e7d4d7a2db3d tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.094s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:34 user nova-compute[72874]: INFO nova.compute.manager [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Detaching volume 211a3b07-a88b-473b-9e39-f5f5560dc5f2
Aug 17 18:26:34 user nova-compute[72874]: INFO nova.virt.block_device [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Attempting to driver detach volume 211a3b07-a88b-473b-9e39-f5f5560dc5f2 from mountpoint /dev/vdb
Aug 17 18:26:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Attempting to detach device vdb from instance e92e565e-c5d9-433e-8c6a-0cb049c000a7 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:26:34 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:26:34 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:26:34 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:26:34 user nova-compute[72874]:   <serial>211a3b07-a88b-473b-9e39-f5f5560dc5f2</serial>
Aug 17 18:26:34 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 18:26:34 user nova-compute[72874]: </disk>
Aug 17 18:26:34 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:26:34 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Successfully detached device vdb from instance e92e565e-c5d9-433e-8c6a-0cb049c000a7 from the persistent domain config.
Aug 17 18:26:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e92e565e-c5d9-433e-8c6a-0cb049c000a7 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:26:34 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:26:34 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:26:34 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:26:34 user nova-compute[72874]:   <serial>211a3b07-a88b-473b-9e39-f5f5560dc5f2</serial>
Aug 17 18:26:34 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 18:26:34 user nova-compute[72874]: </disk>
Aug 17 18:26:34 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692296794.6989725, e92e565e-c5d9-433e-8c6a-0cb049c000a7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e92e565e-c5d9-433e-8c6a-0cb049c000a7 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:26:34 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Successfully detached device vdb from instance e92e565e-c5d9-433e-8c6a-0cb049c000a7 from the live domain config.
Aug 17 18:26:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DuBaNpQf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:26:34 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:26:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ec0e63-a3c0-4394-98b7-4387f60090b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7492dc2-826d-4009-94df-a7eee94d9fe4]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:26:34 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:26:34 user nova-compute[72874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 (non-flash)
Aug 17 18:26:34 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:26:34 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:26:34 user nova-compute[72874]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 (non-flash)
Aug 17 18:26:34 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c0462170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2'): ({'sdc'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Removing single pathed devices sdc {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09784a5-2554-4c2b-852f-c6455f8256e4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7facb232-5a06-4f62-9bc8-f35bb3eea214]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Flushing IO for device /dev/sdc {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1016d0-b7c0-4242-9de2-cad6b8f47fe7]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c596c655-1bb5-4772-aabe-ed97b1e62379]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba45e769-db42-46f1-b914-22d027295d8e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0dc875-f27d-4487-935c-a101986901c3]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2, portal: 172.16.0.220,3260]
Aug 17 18:26:34 user nova-compute[72874]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2, portal: 172.16.0.220,3260] successful.
Aug 17 18:26:34 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:211a3b07-a88b-473b-9e39-f5f5560dc5f2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e5d1c5-1019-4aac-a623-66eb733b08b0]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:26:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] <== disconnect_volume: return (305ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:26:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:26:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:35 user nova-compute[72874]: DEBUG nova.objects.instance [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lazy-loading 'flavor' on Instance uuid e92e565e-c5d9-433e-8c6a-0cb049c000a7 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:26:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-33205cbd-e7ef-4c0c-8622-3410c59dfaf2 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.755s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "interface-e92e565e-c5d9-433e-8c6a-0cb049c000a7-d95cf4a2-706e-43fb-9929-37ad8e0a86b9" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "interface-e92e565e-c5d9-433e-8c6a-0cb049c000a7-d95cf4a2-706e-43fb-9929-37ad8e0a86b9" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.objects.instance [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lazy-loading 'flavor' on Instance uuid e92e565e-c5d9-433e-8c6a-0cb049c000a7 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784183103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784183103',id=22,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODORGFU372BNdOaIwC88Uz6tubqWS+C4jqGAbM5re2MuHMJFjzHyXf/75k8RdxtFKwcVsHrr4vNfLeqVS5Zfg09lw8vrsW0zlhTritsP1Yjsx1ETqQHCdS8D+8n7979wg==',key_name='tempest-keypair-1258010050',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:24:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56c8770bee784ba5af885002d30db7dc',ramdisk_id='',reservation_id='r-numhxl95',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-671856852',owner_user_name='tempest-TaggedAttachmentsTest-671856852-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:24:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48e4d34e494fabbe1af3fd7eef2f76',uuid=e92e565e-c5d9-433e-8c6a-0cb049c000a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "address": "fa:16:3e:f5:a4:2b", "network": {"id": "2fe8990f-0979-4edb-92ee-74781b50ee58", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-967890750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95cf4a2-70", "ovs_interfaceid": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Converting VIF {"id": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "address": "fa:16:3e:f5:a4:2b", "network": {"id": "2fe8990f-0979-4edb-92ee-74781b50ee58", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-967890750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95cf4a2-70", "ovs_interfaceid": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a4:2b,bridge_name='br-int',has_traffic_filtering=True,id=d95cf4a2-706e-43fb-9929-37ad8e0a86b9,network=Network(2fe8990f-0979-4edb-92ee-74781b50ee58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95cf4a2-70') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:a4:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tapd95cf4a2-70"/></interface> {{(pid=72874) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:a4:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tapd95cf4a2-70"/></interface> {{(pid=72874) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Attempting to detach device tapd95cf4a2-70 from instance e92e565e-c5d9-433e-8c6a-0cb049c000a7 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] detach device xml: <interface type="ethernet">
Aug 17 18:26:36 user nova-compute[72874]:   <mac address="fa:16:3e:f5:a4:2b"/>
Aug 17 18:26:36 user nova-compute[72874]:   <model type="virtio"/>
Aug 17 18:26:36 user nova-compute[72874]:   <mtu size="1442"/>
Aug 17 18:26:36 user nova-compute[72874]:   <target dev="tapd95cf4a2-70"/>
Aug 17 18:26:36 user nova-compute[72874]: </interface>
Aug 17 18:26:36 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:a4:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tapd95cf4a2-70"/></interface> {{(pid=72874) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:a4:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tapd95cf4a2-70"/></interface>not found in domain: <domain type='kvm' id='28'>
Aug 17 18:26:36 user nova-compute[72874]:   <name>instance-00000016</name>
Aug 17 18:26:36 user nova-compute[72874]:   <uuid>e92e565e-c5d9-433e-8c6a-0cb049c000a7</uuid>
Aug 17 18:26:36 user nova-compute[72874]:   <metadata>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:26:36 user nova-compute[72874]:   <nova:package version="0.0.0"/>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:name>tempest-device-tagging-server-1784183103</nova:name>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:creationTime>2023-08-17 18:26:17</nova:creationTime>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:flavor name="m1.tiny">
Aug 17 18:26:36 user nova-compute[72874]:     <nova:memory>512</nova:memory>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:disk>1</nova:disk>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:swap>0</nova:swap>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:vcpus>1</nova:vcpus>
Aug 17 18:26:36 user nova-compute[72874]:   </nova:flavor>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:owner>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:user uuid="eb48e4d34e494fabbe1af3fd7eef2f76">tempest-TaggedAttachmentsTest-671856852-project-member</nova:user>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:project uuid="56c8770bee784ba5af885002d30db7dc">tempest-TaggedAttachmentsTest-671856852</nova:project>
Aug 17 18:26:36 user nova-compute[72874]:   </nova:owner>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:ports>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:port uuid="3a5303af-3fe8-41ec-a01c-5a0223d20dfa">
Aug 17 18:26:36 user nova-compute[72874]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 18:26:36 user nova-compute[72874]:     </nova:port>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:port uuid="d95cf4a2-706e-43fb-9929-37ad8e0a86b9">
Aug 17 18:26:36 user nova-compute[72874]:       <nova:ip type="fixed" address="10.10.10.131" ipVersion="4"/>
Aug 17 18:26:36 user nova-compute[72874]:     </nova:port>
Aug 17 18:26:36 user nova-compute[72874]:   </nova:ports>
Aug 17 18:26:36 user nova-compute[72874]: </nova:instance>
Aug 17 18:26:36 user nova-compute[72874]:   </metadata>
Aug 17 18:26:36 user nova-compute[72874]:   <memory unit='KiB'>524288</memory>
Aug 17 18:26:36 user nova-compute[72874]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 18:26:36 user nova-compute[72874]:   <vcpu placement='static'>1</vcpu>
Aug 17 18:26:36 user nova-compute[72874]:   <resource>
Aug 17 18:26:36 user nova-compute[72874]:     <partition>/machine</partition>
Aug 17 18:26:36 user nova-compute[72874]:   </resource>
Aug 17 18:26:36 user nova-compute[72874]:   <sysinfo type='smbios'>
Aug 17 18:26:36 user nova-compute[72874]:     <system>
Aug 17 18:26:36 user nova-compute[72874]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 18:26:36 user nova-compute[72874]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 18:26:36 user nova-compute[72874]:       <entry name='version'>0.0.0</entry>
Aug 17 18:26:36 user nova-compute[72874]:       <entry name='serial'>e92e565e-c5d9-433e-8c6a-0cb049c000a7</entry>
Aug 17 18:26:36 user nova-compute[72874]:       <entry name='uuid'>e92e565e-c5d9-433e-8c6a-0cb049c000a7</entry>
Aug 17 18:26:36 user nova-compute[72874]:       <entry name='family'>Virtual Machine</entry>
Aug 17 18:26:36 user nova-compute[72874]:     </system>
Aug 17 18:26:36 user nova-compute[72874]:   </sysinfo>
Aug 17 18:26:36 user nova-compute[72874]:   <os>
Aug 17 18:26:36 user nova-compute[72874]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 18:26:36 user nova-compute[72874]:     <boot dev='hd'/>
Aug 17 18:26:36 user nova-compute[72874]:     <smbios mode='sysinfo'/>
Aug 17 18:26:36 user nova-compute[72874]:   </os>
Aug 17 18:26:36 user nova-compute[72874]:   <features>
Aug 17 18:26:36 user nova-compute[72874]:     <acpi/>
Aug 17 18:26:36 user nova-compute[72874]:     <apic/>
Aug 17 18:26:36 user nova-compute[72874]:     <vmcoreinfo state='on'/>
Aug 17 18:26:36 user nova-compute[72874]:   </features>
Aug 17 18:26:36 user nova-compute[72874]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 18:26:36 user nova-compute[72874]:     <model fallback='forbid'>Nehalem</model>
Aug 17 18:26:36 user nova-compute[72874]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 18:26:36 user nova-compute[72874]:     <feature policy='require' name='vme'/>
Aug 17 18:26:36 user nova-compute[72874]:     <feature policy='require' name='x2apic'/>
Aug 17 18:26:36 user nova-compute[72874]:     <feature policy='require' name='hypervisor'/>
Aug 17 18:26:36 user nova-compute[72874]:   </cpu>
Aug 17 18:26:36 user nova-compute[72874]:   <clock offset='utc'>
Aug 17 18:26:36 user nova-compute[72874]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 18:26:36 user nova-compute[72874]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 18:26:36 user nova-compute[72874]:     <timer name='hpet' present='no'/>
Aug 17 18:26:36 user nova-compute[72874]:   </clock>
Aug 17 18:26:36 user nova-compute[72874]:   <on_poweroff>destroy</on_poweroff>
Aug 17 18:26:36 user nova-compute[72874]:   <on_reboot>restart</on_reboot>
Aug 17 18:26:36 user nova-compute[72874]:   <on_crash>destroy</on_crash>
Aug 17 18:26:36 user nova-compute[72874]:   <devices>
Aug 17 18:26:36 user nova-compute[72874]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 18:26:36 user nova-compute[72874]:     <disk type='file' device='disk'>
Aug 17 18:26:36 user nova-compute[72874]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 18:26:36 user nova-compute[72874]:       <source file='/opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk' index='2'/>
Aug 17 18:26:36 user nova-compute[72874]:       <backingStore type='file' index='3'>
Aug 17 18:26:36 user nova-compute[72874]:         <format type='raw'/>
Aug 17 18:26:36 user nova-compute[72874]:         <source file='/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22'/>
Aug 17 18:26:36 user nova-compute[72874]:         <backingStore/>
Aug 17 18:26:36 user nova-compute[72874]:       </backingStore>
Aug 17 18:26:36 user nova-compute[72874]:       <target dev='vda' bus='virtio'/>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='virtio-disk0'/>
Aug 17 18:26:36 user nova-compute[72874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </disk>
Aug 17 18:26:36 user nova-compute[72874]:     <disk type='file' device='cdrom'>
Aug 17 18:26:36 user nova-compute[72874]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 18:26:36 user nova-compute[72874]:       <source file='/opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk.config' index='1'/>
Aug 17 18:26:36 user nova-compute[72874]:       <backingStore/>
Aug 17 18:26:36 user nova-compute[72874]:       <target dev='hda' bus='ide'/>
Aug 17 18:26:36 user nova-compute[72874]:       <readonly/>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='ide0-0-0'/>
Aug 17 18:26:36 user nova-compute[72874]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </disk>
Aug 17 18:26:36 user nova-compute[72874]:     <controller type='usb' index='0' model='none'>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='usb'/>
Aug 17 18:26:36 user nova-compute[72874]:     </controller>
Aug 17 18:26:36 user nova-compute[72874]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='pci.0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </controller>
Aug 17 18:26:36 user nova-compute[72874]:     <controller type='ide' index='0'>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='ide'/>
Aug 17 18:26:36 user nova-compute[72874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 18:26:36 user nova-compute[72874]:     </controller>
Aug 17 18:26:36 user nova-compute[72874]:     <interface type='ethernet'>
Aug 17 18:26:36 user nova-compute[72874]:       <mac address='fa:16:3e:6d:2e:95'/>
Aug 17 18:26:36 user nova-compute[72874]:       <target dev='tap3a5303af-3f'/>
Aug 17 18:26:36 user nova-compute[72874]:       <model type='virtio'/>
Aug 17 18:26:36 user nova-compute[72874]:       <mtu size='1442'/>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='net0'/>
Aug 17 18:26:36 user nova-compute[72874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </interface>
Aug 17 18:26:36 user nova-compute[72874]:     <interface type='ethernet'>
Aug 17 18:26:36 user nova-compute[72874]:       <mac address='fa:16:3e:f5:a4:2b'/>
Aug 17 18:26:36 user nova-compute[72874]:       <target dev='tapd95cf4a2-70'/>
Aug 17 18:26:36 user nova-compute[72874]:       <model type='virtio'/>
Aug 17 18:26:36 user nova-compute[72874]:       <mtu size='1442'/>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='net1'/>
Aug 17 18:26:36 user nova-compute[72874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </interface>
Aug 17 18:26:36 user nova-compute[72874]:     <serial type='pty'>
Aug 17 18:26:36 user nova-compute[72874]:       <source path='/dev/pts/10'/>
Aug 17 18:26:36 user nova-compute[72874]:       <log file='/opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/console.log' append='off'/>
Aug 17 18:26:36 user nova-compute[72874]:       <target type='isa-serial' port='0'>
Aug 17 18:26:36 user nova-compute[72874]:         <model name='isa-serial'/>
Aug 17 18:26:36 user nova-compute[72874]:       </target>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='serial0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </serial>
Aug 17 18:26:36 user nova-compute[72874]:     <console type='pty' tty='/dev/pts/10'>
Aug 17 18:26:36 user nova-compute[72874]:       <source path='/dev/pts/10'/>
Aug 17 18:26:36 user nova-compute[72874]:       <log file='/opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/console.log' append='off'/>
Aug 17 18:26:36 user nova-compute[72874]:       <target type='serial' port='0'/>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='serial0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </console>
Aug 17 18:26:36 user nova-compute[72874]:     <input type='mouse' bus='ps2'>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='input0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </input>
Aug 17 18:26:36 user nova-compute[72874]:     <input type='keyboard' bus='ps2'>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='input1'/>
Aug 17 18:26:36 user nova-compute[72874]:     </input>
Aug 17 18:26:36 user nova-compute[72874]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Aug 17 18:26:36 user nova-compute[72874]:       <listen type='address' address='0.0.0.0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </graphics>
Aug 17 18:26:36 user nova-compute[72874]:     <audio id='1' type='none'/>
Aug 17 18:26:36 user nova-compute[72874]:     <video>
Aug 17 18:26:36 user nova-compute[72874]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='video0'/>
Aug 17 18:26:36 user nova-compute[72874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </video>
Aug 17 18:26:36 user nova-compute[72874]:     <memballoon model='virtio'>
Aug 17 18:26:36 user nova-compute[72874]:       <stats period='10'/>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='balloon0'/>
Aug 17 18:26:36 user nova-compute[72874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </memballoon>
Aug 17 18:26:36 user nova-compute[72874]:     <rng model='virtio'>
Aug 17 18:26:36 user nova-compute[72874]:       <backend model='random'>/dev/urandom</backend>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='rng0'/>
Aug 17 18:26:36 user nova-compute[72874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </rng>
Aug 17 18:26:36 user nova-compute[72874]:   </devices>
Aug 17 18:26:36 user nova-compute[72874]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 18:26:36 user nova-compute[72874]:     <label>libvirt-e92e565e-c5d9-433e-8c6a-0cb049c000a7</label>
Aug 17 18:26:36 user nova-compute[72874]:     <imagelabel>libvirt-e92e565e-c5d9-433e-8c6a-0cb049c000a7</imagelabel>
Aug 17 18:26:36 user nova-compute[72874]:   </seclabel>
Aug 17 18:26:36 user nova-compute[72874]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 18:26:36 user nova-compute[72874]:     <label>+64055:+108</label>
Aug 17 18:26:36 user nova-compute[72874]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 18:26:36 user nova-compute[72874]:   </seclabel>
Aug 17 18:26:36 user nova-compute[72874]: </domain>
Aug 17 18:26:36 user nova-compute[72874]:  {{(pid=72874) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 18:26:36 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Successfully detached device tapd95cf4a2-70 from instance e92e565e-c5d9-433e-8c6a-0cb049c000a7 from the persistent domain config.
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] (1/8): Attempting to detach device tapd95cf4a2-70 with device alias net1 from instance e92e565e-c5d9-433e-8c6a-0cb049c000a7 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] detach device xml: <interface type="ethernet">
Aug 17 18:26:36 user nova-compute[72874]:   <mac address="fa:16:3e:f5:a4:2b"/>
Aug 17 18:26:36 user nova-compute[72874]:   <model type="virtio"/>
Aug 17 18:26:36 user nova-compute[72874]:   <mtu size="1442"/>
Aug 17 18:26:36 user nova-compute[72874]:   <target dev="tapd95cf4a2-70"/>
Aug 17 18:26:36 user nova-compute[72874]: </interface>
Aug 17 18:26:36 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692296796.7962198, e92e565e-c5d9-433e-8c6a-0cb049c000a7 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Start waiting for the detach event from libvirt for device tapd95cf4a2-70 with device alias net1 for instance e92e565e-c5d9-433e-8c6a-0cb049c000a7 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:a4:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tapd95cf4a2-70"/></interface> {{(pid=72874) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:a4:2b"/><model type="virtio"/><mtu size="1442"/><target dev="tapd95cf4a2-70"/></interface>not found in domain: <domain type='kvm' id='28'>
Aug 17 18:26:36 user nova-compute[72874]:   <name>instance-00000016</name>
Aug 17 18:26:36 user nova-compute[72874]:   <uuid>e92e565e-c5d9-433e-8c6a-0cb049c000a7</uuid>
Aug 17 18:26:36 user nova-compute[72874]:   <metadata>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:26:36 user nova-compute[72874]:   <nova:package version="0.0.0"/>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:name>tempest-device-tagging-server-1784183103</nova:name>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:creationTime>2023-08-17 18:26:17</nova:creationTime>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:flavor name="m1.tiny">
Aug 17 18:26:36 user nova-compute[72874]:     <nova:memory>512</nova:memory>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:disk>1</nova:disk>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:swap>0</nova:swap>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:vcpus>1</nova:vcpus>
Aug 17 18:26:36 user nova-compute[72874]:   </nova:flavor>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:owner>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:user uuid="eb48e4d34e494fabbe1af3fd7eef2f76">tempest-TaggedAttachmentsTest-671856852-project-member</nova:user>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:project uuid="56c8770bee784ba5af885002d30db7dc">tempest-TaggedAttachmentsTest-671856852</nova:project>
Aug 17 18:26:36 user nova-compute[72874]:   </nova:owner>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:ports>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:port uuid="3a5303af-3fe8-41ec-a01c-5a0223d20dfa">
Aug 17 18:26:36 user nova-compute[72874]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 18:26:36 user nova-compute[72874]:     </nova:port>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:port uuid="d95cf4a2-706e-43fb-9929-37ad8e0a86b9">
Aug 17 18:26:36 user nova-compute[72874]:       <nova:ip type="fixed" address="10.10.10.131" ipVersion="4"/>
Aug 17 18:26:36 user nova-compute[72874]:     </nova:port>
Aug 17 18:26:36 user nova-compute[72874]:   </nova:ports>
Aug 17 18:26:36 user nova-compute[72874]: </nova:instance>
Aug 17 18:26:36 user nova-compute[72874]:   </metadata>
Aug 17 18:26:36 user nova-compute[72874]:   <memory unit='KiB'>524288</memory>
Aug 17 18:26:36 user nova-compute[72874]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 18:26:36 user nova-compute[72874]:   <vcpu placement='static'>1</vcpu>
Aug 17 18:26:36 user nova-compute[72874]:   <resource>
Aug 17 18:26:36 user nova-compute[72874]:     <partition>/machine</partition>
Aug 17 18:26:36 user nova-compute[72874]:   </resource>
Aug 17 18:26:36 user nova-compute[72874]:   <sysinfo type='smbios'>
Aug 17 18:26:36 user nova-compute[72874]:     <system>
Aug 17 18:26:36 user nova-compute[72874]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 18:26:36 user nova-compute[72874]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 18:26:36 user nova-compute[72874]:       <entry name='version'>0.0.0</entry>
Aug 17 18:26:36 user nova-compute[72874]:       <entry name='serial'>e92e565e-c5d9-433e-8c6a-0cb049c000a7</entry>
Aug 17 18:26:36 user nova-compute[72874]:       <entry name='uuid'>e92e565e-c5d9-433e-8c6a-0cb049c000a7</entry>
Aug 17 18:26:36 user nova-compute[72874]:       <entry name='family'>Virtual Machine</entry>
Aug 17 18:26:36 user nova-compute[72874]:     </system>
Aug 17 18:26:36 user nova-compute[72874]:   </sysinfo>
Aug 17 18:26:36 user nova-compute[72874]:   <os>
Aug 17 18:26:36 user nova-compute[72874]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 18:26:36 user nova-compute[72874]:     <boot dev='hd'/>
Aug 17 18:26:36 user nova-compute[72874]:     <smbios mode='sysinfo'/>
Aug 17 18:26:36 user nova-compute[72874]:   </os>
Aug 17 18:26:36 user nova-compute[72874]:   <features>
Aug 17 18:26:36 user nova-compute[72874]:     <acpi/>
Aug 17 18:26:36 user nova-compute[72874]:     <apic/>
Aug 17 18:26:36 user nova-compute[72874]:     <vmcoreinfo state='on'/>
Aug 17 18:26:36 user nova-compute[72874]:   </features>
Aug 17 18:26:36 user nova-compute[72874]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 18:26:36 user nova-compute[72874]:     <model fallback='forbid'>Nehalem</model>
Aug 17 18:26:36 user nova-compute[72874]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 18:26:36 user nova-compute[72874]:     <feature policy='require' name='vme'/>
Aug 17 18:26:36 user nova-compute[72874]:     <feature policy='require' name='x2apic'/>
Aug 17 18:26:36 user nova-compute[72874]:     <feature policy='require' name='hypervisor'/>
Aug 17 18:26:36 user nova-compute[72874]:   </cpu>
Aug 17 18:26:36 user nova-compute[72874]:   <clock offset='utc'>
Aug 17 18:26:36 user nova-compute[72874]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 18:26:36 user nova-compute[72874]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 18:26:36 user nova-compute[72874]:     <timer name='hpet' present='no'/>
Aug 17 18:26:36 user nova-compute[72874]:   </clock>
Aug 17 18:26:36 user nova-compute[72874]:   <on_poweroff>destroy</on_poweroff>
Aug 17 18:26:36 user nova-compute[72874]:   <on_reboot>restart</on_reboot>
Aug 17 18:26:36 user nova-compute[72874]:   <on_crash>destroy</on_crash>
Aug 17 18:26:36 user nova-compute[72874]:   <devices>
Aug 17 18:26:36 user nova-compute[72874]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 18:26:36 user nova-compute[72874]:     <disk type='file' device='disk'>
Aug 17 18:26:36 user nova-compute[72874]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 18:26:36 user nova-compute[72874]:       <source file='/opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk' index='2'/>
Aug 17 18:26:36 user nova-compute[72874]:       <backingStore type='file' index='3'>
Aug 17 18:26:36 user nova-compute[72874]:         <format type='raw'/>
Aug 17 18:26:36 user nova-compute[72874]:         <source file='/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22'/>
Aug 17 18:26:36 user nova-compute[72874]:         <backingStore/>
Aug 17 18:26:36 user nova-compute[72874]:       </backingStore>
Aug 17 18:26:36 user nova-compute[72874]:       <target dev='vda' bus='virtio'/>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='virtio-disk0'/>
Aug 17 18:26:36 user nova-compute[72874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </disk>
Aug 17 18:26:36 user nova-compute[72874]:     <disk type='file' device='cdrom'>
Aug 17 18:26:36 user nova-compute[72874]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 18:26:36 user nova-compute[72874]:       <source file='/opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk.config' index='1'/>
Aug 17 18:26:36 user nova-compute[72874]:       <backingStore/>
Aug 17 18:26:36 user nova-compute[72874]:       <target dev='hda' bus='ide'/>
Aug 17 18:26:36 user nova-compute[72874]:       <readonly/>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='ide0-0-0'/>
Aug 17 18:26:36 user nova-compute[72874]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </disk>
Aug 17 18:26:36 user nova-compute[72874]:     <controller type='usb' index='0' model='none'>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='usb'/>
Aug 17 18:26:36 user nova-compute[72874]:     </controller>
Aug 17 18:26:36 user nova-compute[72874]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='pci.0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </controller>
Aug 17 18:26:36 user nova-compute[72874]:     <controller type='ide' index='0'>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='ide'/>
Aug 17 18:26:36 user nova-compute[72874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 18:26:36 user nova-compute[72874]:     </controller>
Aug 17 18:26:36 user nova-compute[72874]:     <interface type='ethernet'>
Aug 17 18:26:36 user nova-compute[72874]:       <mac address='fa:16:3e:6d:2e:95'/>
Aug 17 18:26:36 user nova-compute[72874]:       <target dev='tap3a5303af-3f'/>
Aug 17 18:26:36 user nova-compute[72874]:       <model type='virtio'/>
Aug 17 18:26:36 user nova-compute[72874]:       <mtu size='1442'/>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='net0'/>
Aug 17 18:26:36 user nova-compute[72874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </interface>
Aug 17 18:26:36 user nova-compute[72874]:     <serial type='pty'>
Aug 17 18:26:36 user nova-compute[72874]:       <source path='/dev/pts/10'/>
Aug 17 18:26:36 user nova-compute[72874]:       <log file='/opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/console.log' append='off'/>
Aug 17 18:26:36 user nova-compute[72874]:       <target type='isa-serial' port='0'>
Aug 17 18:26:36 user nova-compute[72874]:         <model name='isa-serial'/>
Aug 17 18:26:36 user nova-compute[72874]:       </target>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='serial0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </serial>
Aug 17 18:26:36 user nova-compute[72874]:     <console type='pty' tty='/dev/pts/10'>
Aug 17 18:26:36 user nova-compute[72874]:       <source path='/dev/pts/10'/>
Aug 17 18:26:36 user nova-compute[72874]:       <log file='/opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/console.log' append='off'/>
Aug 17 18:26:36 user nova-compute[72874]:       <target type='serial' port='0'/>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='serial0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </console>
Aug 17 18:26:36 user nova-compute[72874]:     <input type='mouse' bus='ps2'>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='input0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </input>
Aug 17 18:26:36 user nova-compute[72874]:     <input type='keyboard' bus='ps2'>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='input1'/>
Aug 17 18:26:36 user nova-compute[72874]:     </input>
Aug 17 18:26:36 user nova-compute[72874]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Aug 17 18:26:36 user nova-compute[72874]:       <listen type='address' address='0.0.0.0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </graphics>
Aug 17 18:26:36 user nova-compute[72874]:     <audio id='1' type='none'/>
Aug 17 18:26:36 user nova-compute[72874]:     <video>
Aug 17 18:26:36 user nova-compute[72874]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='video0'/>
Aug 17 18:26:36 user nova-compute[72874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </video>
Aug 17 18:26:36 user nova-compute[72874]:     <memballoon model='virtio'>
Aug 17 18:26:36 user nova-compute[72874]:       <stats period='10'/>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='balloon0'/>
Aug 17 18:26:36 user nova-compute[72874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </memballoon>
Aug 17 18:26:36 user nova-compute[72874]:     <rng model='virtio'>
Aug 17 18:26:36 user nova-compute[72874]:       <backend model='random'>/dev/urandom</backend>
Aug 17 18:26:36 user nova-compute[72874]:       <alias name='rng0'/>
Aug 17 18:26:36 user nova-compute[72874]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 18:26:36 user nova-compute[72874]:     </rng>
Aug 17 18:26:36 user nova-compute[72874]:   </devices>
Aug 17 18:26:36 user nova-compute[72874]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 18:26:36 user nova-compute[72874]:     <label>libvirt-e92e565e-c5d9-433e-8c6a-0cb049c000a7</label>
Aug 17 18:26:36 user nova-compute[72874]:     <imagelabel>libvirt-e92e565e-c5d9-433e-8c6a-0cb049c000a7</imagelabel>
Aug 17 18:26:36 user nova-compute[72874]:   </seclabel>
Aug 17 18:26:36 user nova-compute[72874]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 18:26:36 user nova-compute[72874]:     <label>+64055:+108</label>
Aug 17 18:26:36 user nova-compute[72874]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 18:26:36 user nova-compute[72874]:   </seclabel>
Aug 17 18:26:36 user nova-compute[72874]: </domain>
Aug 17 18:26:36 user nova-compute[72874]:  {{(pid=72874) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 18:26:36 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Successfully detached device tapd95cf4a2-70 from instance e92e565e-c5d9-433e-8c6a-0cb049c000a7 from the live domain config.
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784183103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784183103',id=22,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODORGFU372BNdOaIwC88Uz6tubqWS+C4jqGAbM5re2MuHMJFjzHyXf/75k8RdxtFKwcVsHrr4vNfLeqVS5Zfg09lw8vrsW0zlhTritsP1Yjsx1ETqQHCdS8D+8n7979wg==',key_name='tempest-keypair-1258010050',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:24:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56c8770bee784ba5af885002d30db7dc',ramdisk_id='',reservation_id='r-numhxl95',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-671856852',owner_user_name='tempest-TaggedAttachmentsTest-671856852-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:24:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48e4d34e494fabbe1af3fd7eef2f76',uuid=e92e565e-c5d9-433e-8c6a-0cb049c000a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "address": "fa:16:3e:f5:a4:2b", "network": {"id": "2fe8990f-0979-4edb-92ee-74781b50ee58", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-967890750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95cf4a2-70", "ovs_interfaceid": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Converting VIF {"id": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "address": "fa:16:3e:f5:a4:2b", "network": {"id": "2fe8990f-0979-4edb-92ee-74781b50ee58", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-967890750", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.131", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd95cf4a2-70", "ovs_interfaceid": "d95cf4a2-706e-43fb-9929-37ad8e0a86b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a4:2b,bridge_name='br-int',has_traffic_filtering=True,id=d95cf4a2-706e-43fb-9929-37ad8e0a86b9,network=Network(2fe8990f-0979-4edb-92ee-74781b50ee58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95cf4a2-70') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG os_vif [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a4:2b,bridge_name='br-int',has_traffic_filtering=True,id=d95cf4a2-706e-43fb-9929-37ad8e0a86b9,network=Network(2fe8990f-0979-4edb-92ee-74781b50ee58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95cf4a2-70') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd95cf4a2-70, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:36 user nova-compute[72874]: INFO os_vif [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:a4:2b,bridge_name='br-int',has_traffic_filtering=True,id=d95cf4a2-706e-43fb-9929-37ad8e0a86b9,network=Network(2fe8990f-0979-4edb-92ee-74781b50ee58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd95cf4a2-70')
Aug 17 18:26:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:26:36 user nova-compute[72874]:   <nova:package version="0.0.0"/>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:name>tempest-device-tagging-server-1784183103</nova:name>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:creationTime>2023-08-17 18:26:36</nova:creationTime>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:flavor name="m1.tiny">
Aug 17 18:26:36 user nova-compute[72874]:     <nova:memory>512</nova:memory>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:disk>1</nova:disk>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:swap>0</nova:swap>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:vcpus>1</nova:vcpus>
Aug 17 18:26:36 user nova-compute[72874]:   </nova:flavor>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:owner>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:user uuid="eb48e4d34e494fabbe1af3fd7eef2f76">tempest-TaggedAttachmentsTest-671856852-project-member</nova:user>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:project uuid="56c8770bee784ba5af885002d30db7dc">tempest-TaggedAttachmentsTest-671856852</nova:project>
Aug 17 18:26:36 user nova-compute[72874]:   </nova:owner>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:26:36 user nova-compute[72874]:   <nova:ports>
Aug 17 18:26:36 user nova-compute[72874]:     <nova:port uuid="3a5303af-3fe8-41ec-a01c-5a0223d20dfa">
Aug 17 18:26:36 user nova-compute[72874]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 18:26:36 user nova-compute[72874]:     </nova:port>
Aug 17 18:26:36 user nova-compute[72874]:   </nova:ports>
Aug 17 18:26:36 user nova-compute[72874]: </nova:instance>
Aug 17 18:26:36 user nova-compute[72874]:  {{(pid=72874) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 18:26:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-85c95a66-7958-4832-82ba-5cc80225cb24 req-2c94463f-5bf1-453a-ac59-fec32febc09b service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received event network-vif-unplugged-d95cf4a2-706e-43fb-9929-37ad8e0a86b9 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-85c95a66-7958-4832-82ba-5cc80225cb24 req-2c94463f-5bf1-453a-ac59-fec32febc09b service nova] Acquiring lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-85c95a66-7958-4832-82ba-5cc80225cb24 req-2c94463f-5bf1-453a-ac59-fec32febc09b service nova] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-85c95a66-7958-4832-82ba-5cc80225cb24 req-2c94463f-5bf1-453a-ac59-fec32febc09b service nova] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-85c95a66-7958-4832-82ba-5cc80225cb24 req-2c94463f-5bf1-453a-ac59-fec32febc09b service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] No waiting events found dispatching network-vif-unplugged-d95cf4a2-706e-43fb-9929-37ad8e0a86b9 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:26:37 user nova-compute[72874]: WARNING nova.compute.manager [req-85c95a66-7958-4832-82ba-5cc80225cb24 req-2c94463f-5bf1-453a-ac59-fec32febc09b service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received unexpected event network-vif-unplugged-d95cf4a2-706e-43fb-9929-37ad8e0a86b9 for instance with vm_state active and task_state None.
Aug 17 18:26:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:26:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquired lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:26:37 user nova-compute[72874]: DEBUG nova.network.neutron [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:26:38 user nova-compute[72874]: INFO nova.network.neutron [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Port d95cf4a2-706e-43fb-9929-37ad8e0a86b9 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 17 18:26:38 user nova-compute[72874]: DEBUG nova.network.neutron [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Updating instance_info_cache with network_info: [{"id": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "address": "fa:16:3e:6d:2e:95", "network": {"id": "d73d605d-c67e-4657-9771-76c2544cbe76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-764769447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5303af-3f", "ovs_interfaceid": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:26:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Releasing lock "refresh_cache-e92e565e-c5d9-433e-8c6a-0cb049c000a7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:26:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1e24fa2e-02d5-4eb9-a67e-d82fc6650e97 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "interface-e92e565e-c5d9-433e-8c6a-0cb049c000a7-d95cf4a2-706e-43fb-9929-37ad8e0a86b9" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.944s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-d769e7ad-272a-46b1-a954-4298774cc739 req-2f81bd67-9370-43d3-98d3-feac215afef6 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received event network-vif-plugged-d95cf4a2-706e-43fb-9929-37ad8e0a86b9 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d769e7ad-272a-46b1-a954-4298774cc739 req-2f81bd67-9370-43d3-98d3-feac215afef6 service nova] Acquiring lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d769e7ad-272a-46b1-a954-4298774cc739 req-2f81bd67-9370-43d3-98d3-feac215afef6 service nova] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d769e7ad-272a-46b1-a954-4298774cc739 req-2f81bd67-9370-43d3-98d3-feac215afef6 service nova] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-d769e7ad-272a-46b1-a954-4298774cc739 req-2f81bd67-9370-43d3-98d3-feac215afef6 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] No waiting events found dispatching network-vif-plugged-d95cf4a2-706e-43fb-9929-37ad8e0a86b9 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:26:39 user nova-compute[72874]: WARNING nova.compute.manager [req-d769e7ad-272a-46b1-a954-4298774cc739 req-2f81bd67-9370-43d3-98d3-feac215afef6 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received unexpected event network-vif-plugged-d95cf4a2-706e-43fb-9929-37ad8e0a86b9 for instance with vm_state active and task_state None.
Aug 17 18:26:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-d769e7ad-272a-46b1-a954-4298774cc739 req-2f81bd67-9370-43d3-98d3-feac215afef6 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received event network-vif-deleted-d95cf4a2-706e-43fb-9929-37ad8e0a86b9 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:54 user nova-compute[72874]: INFO nova.compute.manager [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Rescuing
Aug 17 18:26:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:26:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquired lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:26:54 user nova-compute[72874]: DEBUG nova.network.neutron [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:26:55 user nova-compute[72874]: DEBUG nova.network.neutron [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Updating instance_info_cache with network_info: [{"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:26:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Releasing lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:26:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-a3b105a5-d00c-4800-8e12-7a347d3e99fd req-f7b30140-20f0-45a9-a564-35eda7705eab service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received event network-vif-unplugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a3b105a5-d00c-4800-8e12-7a347d3e99fd req-f7b30140-20f0-45a9-a564-35eda7705eab service nova] Acquiring lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a3b105a5-d00c-4800-8e12-7a347d3e99fd req-f7b30140-20f0-45a9-a564-35eda7705eab service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a3b105a5-d00c-4800-8e12-7a347d3e99fd req-f7b30140-20f0-45a9-a564-35eda7705eab service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-a3b105a5-d00c-4800-8e12-7a347d3e99fd req-f7b30140-20f0-45a9-a564-35eda7705eab service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] No waiting events found dispatching network-vif-unplugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:26:55 user nova-compute[72874]: WARNING nova.compute.manager [req-a3b105a5-d00c-4800-8e12-7a347d3e99fd req-f7b30140-20f0-45a9-a564-35eda7705eab service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received unexpected event network-vif-unplugged-2d5c5445-861c-412b-8929-030ec72e68fb for instance with vm_state active and task_state rescuing.
Aug 17 18:26:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:56 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Instance destroyed successfully.
Aug 17 18:26:56 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Attempting a stable device rescue
Aug 17 18:26:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72874) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 18:26:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Instance directory exists: not creating {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 18:26:56 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Creating image(s)
Aug 17 18:26:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "/opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "/opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "/opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:56 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2961b0b8-98d0-4ba5-a0fa-b719753589ea {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:26:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "31f0344b24e5a1c26bd94e55a349038dc3853362" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "31f0344b24e5a1c26bd94e55a349038dc3853362" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31f0344b24e5a1c26bd94e55a349038dc3853362.part --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:26:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31f0344b24e5a1c26bd94e55a349038dc3853362.part --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:57 user nova-compute[72874]: DEBUG nova.virt.images [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] 7e59656a-b2dc-4028-ba64-877619283278 was qcow2, converting to raw {{(pid=72874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 18:26:57 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:26:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/31f0344b24e5a1c26bd94e55a349038dc3853362.part /opt/stack/data/nova/instances/_base/31f0344b24e5a1c26bd94e55a349038dc3853362.converted {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-a8f79475-1e78-4f22-aca8-6372c5786940 req-b06f35c3-05ba-4445-8c0a-ce675970cc22 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:26:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a8f79475-1e78-4f22-aca8-6372c5786940 req-b06f35c3-05ba-4445-8c0a-ce675970cc22 service nova] Acquiring lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a8f79475-1e78-4f22-aca8-6372c5786940 req-b06f35c3-05ba-4445-8c0a-ce675970cc22 service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a8f79475-1e78-4f22-aca8-6372c5786940 req-b06f35c3-05ba-4445-8c0a-ce675970cc22 service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-a8f79475-1e78-4f22-aca8-6372c5786940 req-b06f35c3-05ba-4445-8c0a-ce675970cc22 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] No waiting events found dispatching network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:26:57 user nova-compute[72874]: WARNING nova.compute.manager [req-a8f79475-1e78-4f22-aca8-6372c5786940 req-b06f35c3-05ba-4445-8c0a-ce675970cc22 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received unexpected event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb for instance with vm_state active and task_state rescuing.
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/31f0344b24e5a1c26bd94e55a349038dc3853362.part /opt/stack/data/nova/instances/_base/31f0344b24e5a1c26bd94e55a349038dc3853362.converted" returned: 0 in 0.654s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31f0344b24e5a1c26bd94e55a349038dc3853362.converted --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31f0344b24e5a1c26bd94e55a349038dc3853362.converted --force-share --output=json" returned: 0 in 0.193s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "31f0344b24e5a1c26bd94e55a349038dc3853362" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.163s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "31f0344b24e5a1c26bd94e55a349038dc3853362" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "31f0344b24e5a1c26bd94e55a349038dc3853362" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31f0344b24e5a1c26bd94e55a349038dc3853362 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31f0344b24e5a1c26bd94e55a349038dc3853362 --force-share --output=json" returned: 0 in 0.170s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/31f0344b24e5a1c26bd94e55a349038dc3853362,backing_fmt=raw /opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/disk.rescue {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/31f0344b24e5a1c26bd94e55a349038dc3853362,backing_fmt=raw /opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/disk.rescue" returned: 0 in 0.048s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "31f0344b24e5a1c26bd94e55a349038dc3853362" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'migration_context' on Instance uuid 2961b0b8-98d0-4ba5-a0fa-b719753589ea {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Start _get_guest_xml network_info=[{"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "vif_mac": "fa:16:3e:3d:02:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7e59656a-b2dc-4028-ba64-877619283278', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxjuHieG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2961b0b8-98d0-4ba5-a0fa-b719753589ea', 'attached_at': '', 'detached_at': '', 'volume_id': '8c51cc2b-ba5d-4ed0-818d-17bad96f23b3', 'serial': '8c51cc2b-ba5d-4ed0-818d-17bad96f23b3'}, 'delete_on_termination': False, 'attachment_id': '7c73e30d-2092-4c0f-8c65-07039ddae22c', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'resources' on Instance uuid 2961b0b8-98d0-4ba5-a0fa-b719753589ea {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'numa_topology' on Instance uuid 2961b0b8-98d0-4ba5-a0fa-b719753589ea {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:26:58 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:26:58 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2961b0b8-98d0-4ba5-a0fa-b719753589ea {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxjuHieG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:26:58 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:26:58 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:26:58 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[063b0b45-488d-4b01-8a50-30bd989436e3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = wxjuHieG\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 18:26:58 user nova-compute[72874]: node.name = iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3
Aug 17 18:26:58 user nova-compute[72874]: node.tpgt = -1
Aug 17 18:26:58 user nova-compute[72874]: node.startup = automatic
Aug 17 18:26:58 user nova-compute[72874]: node.leading_login = No
Aug 17 18:26:58 user nova-compute[72874]: iface.iscsi_ifacename = default
Aug 17 18:26:58 user nova-compute[72874]: iface.net_ifacename = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.ipaddress = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.prefix_len = 0
Aug 17 18:26:58 user nova-compute[72874]: iface.hwaddress = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.transport_name = tcp
Aug 17 18:26:58 user nova-compute[72874]: iface.initiatorname = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.state = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.vlan_id = 0
Aug 17 18:26:58 user nova-compute[72874]: iface.vlan_priority = 0
Aug 17 18:26:58 user nova-compute[72874]: iface.vlan_state = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.iface_num = 0
Aug 17 18:26:58 user nova-compute[72874]: iface.mtu = 0
Aug 17 18:26:58 user nova-compute[72874]: iface.port = 0
Aug 17 18:26:58 user nova-compute[72874]: iface.bootproto = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.subnet_mask = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.gateway = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.dhcp_alt_client_id = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.dhcp_dns = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.dhcp_learn_iqn = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.dhcp_vendor_id_state = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.dhcp_vendor_id = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.dhcp_slp_da = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.fragmentation = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.gratuitous_arp = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.incoming_forwarding = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.tos_state = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.tos = 0
Aug 17 18:26:58 user nova-compute[72874]: iface.ttl = 0
Aug 17 18:26:58 user nova-compute[72874]: iface.delayed_ack = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.tcp_nagle = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.tcp_wsf_state = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.tcp_wsf = 0
Aug 17 18:26:58 user nova-compute[72874]: iface.tcp_timer_scale = 0
Aug 17 18:26:58 user nova-compute[72874]: iface.tcp_timestamp = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.redirect = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.def_task_mgmt_timeout = 0
Aug 17 18:26:58 user nova-compute[72874]: iface.header_digest = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.data_digest = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.immediate_data = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.initial_r2t = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.data_seq_inorder = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.data_pdu_inorder = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.erl = 0
Aug 17 18:26:58 user nova-compute[72874]: iface.max_receive_data_len = 0
Aug 17 18:26:58 user nova-compute[72874]: iface.first_burst_len = 0
Aug 17 18:26:58 user nova-compute[72874]: iface.max_outstanding_r2t = 0
Aug 17 18:26:58 user nova-compute[72874]: iface.max_burst_len = 0
Aug 17 18:26:58 user nova-compute[72874]: iface.chap_auth = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.bidi_chap = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.strict_login_compliance = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.discovery_auth = <empty>
Aug 17 18:26:58 user nova-compute[72874]: iface.discovery_logout = <empty>
Aug 17 18:26:58 user nova-compute[72874]: node.discovery_address = <empty>
Aug 17 18:26:58 user nova-compute[72874]: node.discovery_port = 0
Aug 17 18:26:58 user nova-compute[72874]: node.discovery_type = static
Aug 17 18:26:58 user nova-compute[72874]: node.session.initial_cmdsn = 0
Aug 17 18:26:58 user nova-compute[72874]: node.session.initial_login_retry_max = 8
Aug 17 18:26:58 user nova-compute[72874]: node.session.xmit_thread_priority = -20
Aug 17 18:26:58 user nova-compute[72874]: node.session.cmds_max = 128
Aug 17 18:26:58 user nova-compute[72874]: node.session.queue_depth = 32
Aug 17 18:26:58 user nova-compute[72874]: node.session.nr_sessions = 1
Aug 17 18:26:58 user nova-compute[72874]: node.session.auth.authmethod = CHAP
Aug 17 18:26:58 user nova-compute[72874]: node.session.auth.username = wxjuHieG
Aug 17 18:26:58 user nova-compute[72874]: node.session.auth.password = ***
Aug 17 18:26:58 user nova-compute[72874]: node.session.auth.username_in = <empty>
Aug 17 18:26:58 user nova-compute[72874]: node.session.auth.password_in = <empty>
Aug 17 18:26:58 user nova-compute[72874]: node.session.auth.chap_algs = MD5
Aug 17 18:26:58 user nova-compute[72874]: node.session.timeo.replacement_timeout = 120
Aug 17 18:26:58 user nova-compute[72874]: node.session.err_timeo.abort_timeout = 15
Aug 17 18:26:58 user nova-compute[72874]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 18:26:58 user nova-compute[72874]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 18:26:58 user nova-compute[72874]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 18:26:58 user nova-compute[72874]: node.session.iscsi.FastAbort = Yes
Aug 17 18:26:58 user nova-compute[72874]: node.session.iscsi.InitialR2T = No
Aug 17 18:26:58 user nova-compute[72874]: node.session.iscsi.ImmediateData = Yes
Aug 17 18:26:58 user nova-compute[72874]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 18:26:58 user nova-compute[72874]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 18:26:58 user nova-compute[72874]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 18:26:58 user nova-compute[72874]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 18:26:58 user nova-compute[72874]: node.session.iscsi.MaxConnections = 1
Aug 17 18:26:58 user nova-compute[72874]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 18:26:58 user nova-compute[72874]: node.session.iscsi.ERL = 0
Aug 17 18:26:58 user nova-compute[72874]: node.session.scan = manual
Aug 17 18:26:58 user nova-compute[72874]: node.session.reopen_max = 0
Aug 17 18:26:58 user nova-compute[72874]: node.conn[0].address = 172.16.0.220
Aug 17 18:26:58 user nova-compute[72874]: node.conn[0].port = 3260
Aug 17 18:26:58 user nova-compute[72874]: node.conn[0].startup = manual
Aug 17 18:26:58 user nova-compute[72874]: node.conn[0].tcp.window_size = 524288
Aug 17 18:26:58 user nova-compute[72874]: node.conn[0].tcp.type_of_service = 0
Aug 17 18:26:58 user nova-compute[72874]: node.conn[0].timeo.logout_timeout = 15
Aug 17 18:26:58 user nova-compute[72874]: node.conn[0].timeo.login_timeout = 15
Aug 17 18:26:58 user nova-compute[72874]: node.conn[0].timeo.auth_timeout = 45
Aug 17 18:26:58 user nova-compute[72874]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 18:26:58 user nova-compute[72874]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 18:26:58 user nova-compute[72874]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 18:26:58 user nova-compute[72874]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 18:26:58 user nova-compute[72874]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 18:26:58 user nova-compute[72874]: node.conn[0].iscsi.DataDigest = None
Aug 17 18:26:58 user nova-compute[72874]: node.conn[0].iscsi.IFMarker = No
Aug 17 18:26:58 user nova-compute[72874]: node.conn[0].iscsi.OFMarker = No
Aug 17 18:26:58 user nova-compute[72874]: # END RECORD
Aug 17 18:26:58 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[da19fdab-94df-42d4-8693-6839a7ed5560]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da44ae9-5e49-4a8c-9e1a-5ecbd48669cc]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxjuHieG {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wxjuHieG" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4106ed8d-be84-4352-8816-00b622344db8]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wxjuHieG'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d159ced7-bebc-46c8-bf65-6260e5dbc6ae]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddbc916-180d-4da3-8c36-59bf46640481]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:26:58 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:26:58 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:26:58 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:26:58 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] HCTL ('33', '0', '0', 0) found on session 29 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0afa933-63d6-4877-849f-d410edf0dd3c]: (4, ('0 0 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching for a device in session 29 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxjuHieG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.181s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] <== connect_volume: return (183ms) {'type': 'block', 'scsi_wwn': '23436623063613861', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436623063613861', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-584565083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-584565083',id=23,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:25:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a550f3591d1347bf8b9fb4d3e90b8aad',ramdisk_id='',reservation_id='r-7lqgm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-68498997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:25:29Z,user_data=None,user_id='d13289795c8b4991a9cf6bb2880ad6ef',uuid=2961b0b8-98d0-4ba5-a0fa-b719753589ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "vif_mac": "fa:16:3e:3d:02:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converting VIF {"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "vif_mac": "fa:16:3e:3d:02:9b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:02:9b,bridge_name='br-int',has_traffic_filtering=True,id=2d5c5445-861c-412b-8929-030ec72e68fb,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5c5445-86') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'pci_devices' on Instance uuid 2961b0b8-98d0-4ba5-a0fa-b719753589ea {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:26:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:26:58 user nova-compute[72874]:   <uuid>2961b0b8-98d0-4ba5-a0fa-b719753589ea</uuid>
Aug 17 18:26:58 user nova-compute[72874]:   <name>instance-00000017</name>
Aug 17 18:26:58 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:26:58 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:26:58 user nova-compute[72874]:   <metadata>
Aug 17 18:26:58 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:26:58 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:26:58 user nova-compute[72874]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-584565083</nova:name>
Aug 17 18:26:58 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:26:58</nova:creationTime>
Aug 17 18:26:58 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:26:58 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:26:58 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:26:58 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:26:58 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:26:58 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:26:58 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:26:58 user nova-compute[72874]:       <nova:owner>
Aug 17 18:26:58 user nova-compute[72874]:         <nova:user uuid="d13289795c8b4991a9cf6bb2880ad6ef">tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member</nova:user>
Aug 17 18:26:58 user nova-compute[72874]:         <nova:project uuid="a550f3591d1347bf8b9fb4d3e90b8aad">tempest-ServerBootFromVolumeStableRescueTest-68498997</nova:project>
Aug 17 18:26:58 user nova-compute[72874]:       </nova:owner>
Aug 17 18:26:58 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:26:58 user nova-compute[72874]:       <nova:ports>
Aug 17 18:26:58 user nova-compute[72874]:         <nova:port uuid="2d5c5445-861c-412b-8929-030ec72e68fb">
Aug 17 18:26:58 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 18:26:58 user nova-compute[72874]:         </nova:port>
Aug 17 18:26:58 user nova-compute[72874]:       </nova:ports>
Aug 17 18:26:58 user nova-compute[72874]:     </nova:instance>
Aug 17 18:26:58 user nova-compute[72874]:   </metadata>
Aug 17 18:26:58 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:26:58 user nova-compute[72874]:     <system>
Aug 17 18:26:58 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:26:58 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:26:58 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:26:58 user nova-compute[72874]:       <entry name="serial">2961b0b8-98d0-4ba5-a0fa-b719753589ea</entry>
Aug 17 18:26:58 user nova-compute[72874]:       <entry name="uuid">2961b0b8-98d0-4ba5-a0fa-b719753589ea</entry>
Aug 17 18:26:58 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:26:58 user nova-compute[72874]:     </system>
Aug 17 18:26:58 user nova-compute[72874]:   </sysinfo>
Aug 17 18:26:58 user nova-compute[72874]:   <os>
Aug 17 18:26:58 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:26:58 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:26:58 user nova-compute[72874]:   </os>
Aug 17 18:26:58 user nova-compute[72874]:   <features>
Aug 17 18:26:58 user nova-compute[72874]:     <acpi/>
Aug 17 18:26:58 user nova-compute[72874]:     <apic/>
Aug 17 18:26:58 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:26:58 user nova-compute[72874]:   </features>
Aug 17 18:26:58 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:26:58 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:26:58 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:26:58 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:26:58 user nova-compute[72874]:   </clock>
Aug 17 18:26:58 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:26:58 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:26:58 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:26:58 user nova-compute[72874]:   </cpu>
Aug 17 18:26:58 user nova-compute[72874]:   <devices>
Aug 17 18:26:58 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:26:58 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:26:58 user nova-compute[72874]:       <source dev="/dev/sdb"/>
Aug 17 18:26:58 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:26:58 user nova-compute[72874]:       <serial>8c51cc2b-ba5d-4ed0-818d-17bad96f23b3</serial>
Aug 17 18:26:58 user nova-compute[72874]:     </disk>
Aug 17 18:26:58 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:26:58 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:26:58 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/disk.rescue"/>
Aug 17 18:26:58 user nova-compute[72874]:       <target dev="vdb" bus="virtio"/>
Aug 17 18:26:58 user nova-compute[72874]:       <boot order="1"/>
Aug 17 18:26:58 user nova-compute[72874]:     </disk>
Aug 17 18:26:58 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:26:58 user nova-compute[72874]:       <mac address="fa:16:3e:3d:02:9b"/>
Aug 17 18:26:58 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:26:58 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:26:58 user nova-compute[72874]:       <target dev="tap2d5c5445-86"/>
Aug 17 18:26:58 user nova-compute[72874]:     </interface>
Aug 17 18:26:58 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:26:58 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/console.log" append="off"/>
Aug 17 18:26:58 user nova-compute[72874]:     </serial>
Aug 17 18:26:58 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:26:58 user nova-compute[72874]:     <video>
Aug 17 18:26:58 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:26:58 user nova-compute[72874]:     </video>
Aug 17 18:26:58 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:26:58 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:26:58 user nova-compute[72874]:     </rng>
Aug 17 18:26:58 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:26:58 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:26:58 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:26:58 user nova-compute[72874]:     </memballoon>
Aug 17 18:26:58 user nova-compute[72874]:   </devices>
Aug 17 18:26:58 user nova-compute[72874]: </domain>
Aug 17 18:26:58 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:26:58 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Instance destroyed successfully.
Aug 17 18:26:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:26:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:26:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] No VIF found with MAC fa:16:3e:3d:02:9b, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:27:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-a9b0e183-7002-459f-b27b-a8197413d0b5 req-f3625a1d-025e-4ab9-9f58-531a19ceca93 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:27:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a9b0e183-7002-459f-b27b-a8197413d0b5 req-f3625a1d-025e-4ab9-9f58-531a19ceca93 service nova] Acquiring lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a9b0e183-7002-459f-b27b-a8197413d0b5 req-f3625a1d-025e-4ab9-9f58-531a19ceca93 service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a9b0e183-7002-459f-b27b-a8197413d0b5 req-f3625a1d-025e-4ab9-9f58-531a19ceca93 service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-a9b0e183-7002-459f-b27b-a8197413d0b5 req-f3625a1d-025e-4ab9-9f58-531a19ceca93 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] No waiting events found dispatching network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:27:00 user nova-compute[72874]: WARNING nova.compute.manager [req-a9b0e183-7002-459f-b27b-a8197413d0b5 req-f3625a1d-025e-4ab9-9f58-531a19ceca93 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received unexpected event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb for instance with vm_state active and task_state rescuing.
Aug 17 18:27:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Removed pending event for 2961b0b8-98d0-4ba5-a0fa-b719753589ea due to event {{(pid=72874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 18:27:02 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296822.782406, 2961b0b8-98d0-4ba5-a0fa-b719753589ea => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:27:02 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] VM Resumed (Lifecycle Event)
Aug 17 18:27:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e7c86faa-beaa-42ac-9156-e40e420e45f1 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:27:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:27:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:27:02 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 18:27:02 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296822.786195, 2961b0b8-98d0-4ba5-a0fa-b719753589ea => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:27:02 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] VM Started (Lifecycle Event)
Aug 17 18:27:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:27:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-47cb08bd-74d7-4666-b700-1f53b4de9ca5 req-aead911b-5bde-4048-a60b-7281e6576686 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:27:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-47cb08bd-74d7-4666-b700-1f53b4de9ca5 req-aead911b-5bde-4048-a60b-7281e6576686 service nova] Acquiring lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-47cb08bd-74d7-4666-b700-1f53b4de9ca5 req-aead911b-5bde-4048-a60b-7281e6576686 service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-47cb08bd-74d7-4666-b700-1f53b4de9ca5 req-aead911b-5bde-4048-a60b-7281e6576686 service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-47cb08bd-74d7-4666-b700-1f53b4de9ca5 req-aead911b-5bde-4048-a60b-7281e6576686 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] No waiting events found dispatching network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:27:02 user nova-compute[72874]: WARNING nova.compute.manager [req-47cb08bd-74d7-4666-b700-1f53b4de9ca5 req-aead911b-5bde-4048-a60b-7281e6576686 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received unexpected event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb for instance with vm_state active and task_state rescuing.
Aug 17 18:27:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:27:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "857d43f7-6f53-4c82-9e68-fca3078e97ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:10 user nova-compute[72874]: INFO nova.compute.manager [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Terminating instance
Aug 17 18:27:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:27:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG nova.compute.manager [req-460636af-df2e-4d23-a801-057442dec431 req-d72fe3fe-9278-41e8-9418-9ec23d543342 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Received event network-vif-unplugged-903af9b8-b067-4ada-adc9-3183fe6654ed {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-460636af-df2e-4d23-a801-057442dec431 req-d72fe3fe-9278-41e8-9418-9ec23d543342 service nova] Acquiring lock "857d43f7-6f53-4c82-9e68-fca3078e97ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-460636af-df2e-4d23-a801-057442dec431 req-d72fe3fe-9278-41e8-9418-9ec23d543342 service nova] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-460636af-df2e-4d23-a801-057442dec431 req-d72fe3fe-9278-41e8-9418-9ec23d543342 service nova] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG nova.compute.manager [req-460636af-df2e-4d23-a801-057442dec431 req-d72fe3fe-9278-41e8-9418-9ec23d543342 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] No waiting events found dispatching network-vif-unplugged-903af9b8-b067-4ada-adc9-3183fe6654ed {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG nova.compute.manager [req-460636af-df2e-4d23-a801-057442dec431 req-d72fe3fe-9278-41e8-9418-9ec23d543342 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Received event network-vif-unplugged-903af9b8-b067-4ada-adc9-3183fe6654ed for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:27:11 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Instance destroyed successfully.
Aug 17 18:27:11 user nova-compute[72874]: DEBUG nova.objects.instance [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'resources' on Instance uuid 857d43f7-6f53-4c82-9e68-fca3078e97ea {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:21:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-475172127',display_name='tempest-AttachVolumeNegativeTest-server-475172127',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-475172127',id=15,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFF2qiZMR35MqSrduhNh6ko9KsMQarvyIrmKZfOkASekMWzo0/KGVJSS/2QmNOaYddA0vkTdXnRbdawCp5ZNkjMLF1iT56V5eAIyqaxQnotjs4NPfIHyXMd1uxHGo4lR1g==',key_name='tempest-keypair-2085572254',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:21:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d44ed4bf46e4f6bb8d9f9255bfceded',ramdisk_id='',reservation_id='r-sdbb7m8n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1092460488',owner_user_name='tempest-AttachVolumeNegativeTest-1092460488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:21:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eba99d36a842ca93af2d82be67dea1',uuid=857d43f7-6f53-4c82-9e68-fca3078e97ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "903af9b8-b067-4ada-adc9-3183fe6654ed", "address": "fa:16:3e:85:9f:87", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903af9b8-b0", "ovs_interfaceid": "903af9b8-b067-4ada-adc9-3183fe6654ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converting VIF {"id": "903af9b8-b067-4ada-adc9-3183fe6654ed", "address": "fa:16:3e:85:9f:87", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903af9b8-b0", "ovs_interfaceid": "903af9b8-b067-4ada-adc9-3183fe6654ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:85:9f:87,bridge_name='br-int',has_traffic_filtering=True,id=903af9b8-b067-4ada-adc9-3183fe6654ed,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903af9b8-b0') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG os_vif [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:9f:87,bridge_name='br-int',has_traffic_filtering=True,id=903af9b8-b067-4ada-adc9-3183fe6654ed,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903af9b8-b0') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap903af9b8-b0, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:27:11 user nova-compute[72874]: INFO os_vif [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:85:9f:87,bridge_name='br-int',has_traffic_filtering=True,id=903af9b8-b067-4ada-adc9-3183fe6654ed,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903af9b8-b0')
Aug 17 18:27:11 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Deleting instance files /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea_del
Aug 17 18:27:11 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Deletion of /opt/stack/data/nova/instances/857d43f7-6f53-4c82-9e68-fca3078e97ea_del complete
Aug 17 18:27:11 user nova-compute[72874]: INFO nova.compute.manager [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 17 18:27:11 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:27:11 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:27:13 user nova-compute[72874]: DEBUG nova.compute.manager [req-3715a95a-bbc9-4912-9dd3-18f0ad6fe05f req-665a25fd-e4ce-421f-b7e7-ffa2a6ca9304 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Received event network-vif-plugged-903af9b8-b067-4ada-adc9-3183fe6654ed {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:27:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3715a95a-bbc9-4912-9dd3-18f0ad6fe05f req-665a25fd-e4ce-421f-b7e7-ffa2a6ca9304 service nova] Acquiring lock "857d43f7-6f53-4c82-9e68-fca3078e97ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3715a95a-bbc9-4912-9dd3-18f0ad6fe05f req-665a25fd-e4ce-421f-b7e7-ffa2a6ca9304 service nova] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3715a95a-bbc9-4912-9dd3-18f0ad6fe05f req-665a25fd-e4ce-421f-b7e7-ffa2a6ca9304 service nova] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:13 user nova-compute[72874]: DEBUG nova.compute.manager [req-3715a95a-bbc9-4912-9dd3-18f0ad6fe05f req-665a25fd-e4ce-421f-b7e7-ffa2a6ca9304 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] No waiting events found dispatching network-vif-plugged-903af9b8-b067-4ada-adc9-3183fe6654ed {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:27:13 user nova-compute[72874]: WARNING nova.compute.manager [req-3715a95a-bbc9-4912-9dd3-18f0ad6fe05f req-665a25fd-e4ce-421f-b7e7-ffa2a6ca9304 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Received unexpected event network-vif-plugged-903af9b8-b067-4ada-adc9-3183fe6654ed for instance with vm_state active and task_state deleting.
Aug 17 18:27:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:13 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:27:13 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Took 1.67 seconds to deallocate network for instance.
Aug 17 18:27:13 user nova-compute[72874]: DEBUG nova.compute.manager [req-ede85a91-ecd3-4e5b-8430-8b33d681d4bb req-46c93db7-3206-4f66-ae39-1f7227522127 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Received event network-vif-deleted-903af9b8-b067-4ada-adc9-3183fe6654ed {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:27:13 user nova-compute[72874]: INFO nova.compute.manager [req-ede85a91-ecd3-4e5b-8430-8b33d681d4bb req-46c93db7-3206-4f66-ae39-1f7227522127 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Neutron deleted interface 903af9b8-b067-4ada-adc9-3183fe6654ed; detaching it from the instance and deleting it from the info cache
Aug 17 18:27:13 user nova-compute[72874]: DEBUG nova.network.neutron [req-ede85a91-ecd3-4e5b-8430-8b33d681d4bb req-46c93db7-3206-4f66-ae39-1f7227522127 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:27:13 user nova-compute[72874]: DEBUG nova.compute.manager [req-ede85a91-ecd3-4e5b-8430-8b33d681d4bb req-46c93db7-3206-4f66-ae39-1f7227522127 service nova] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Detach interface failed, port_id=903af9b8-b067-4ada-adc9-3183fe6654ed, reason: Instance 857d43f7-6f53-4c82-9e68-fca3078e97ea could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:27:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:13 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:27:13 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:27:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:14 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Deleted allocations for instance 857d43f7-6f53-4c82-9e68-fca3078e97ea
Aug 17 18:27:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0b396852-cc49-4149-bc2b-325641c464b0 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "857d43f7-6f53-4c82-9e68-fca3078e97ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.518s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:15 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:27:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:15 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:27:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:15 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:27:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "62dd0b51-1320-4529-907b-f632f96b48dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "62dd0b51-1320-4529-907b-f632f96b48dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:27:16 user nova-compute[72874]: INFO nova.compute.claims [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Claim successful on node user
Aug 17 18:27:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:16 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.569s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:27:17 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG nova.policy [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '55c7ca8d3b6d4d42b656d9a4a9bc11a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1f96ef08868f45aea64ddf76a0bb68f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:27:17 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Creating image(s)
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "/opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "/opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "/opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.168s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.169s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk 1073741824" returned: 0 in 0.049s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Successfully created port: 4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.504s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:18 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:27:18 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7891MB free_disk=25.265239715576172GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Cannot resize image /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.objects.instance [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lazy-loading 'migration_context' on Instance uuid 62dd0b51-1320-4529-907b-f632f96b48dc {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 7044ab36-115d-454b-a787-b3199a815d4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2ace97e1-c2ee-462e-a929-22c7cb2584d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance e92e565e-c5d9-433e-8c6a-0cb049c000a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 62dd0b51-1320-4529-907b-f632f96b48dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Ensure instance console log exists: /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:27:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Successfully updated port: 4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "refresh_cache-62dd0b51-1320-4529-907b-f632f96b48dc" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquired lock "refresh_cache-62dd0b51-1320-4529-907b-f632f96b48dc" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-0feb3f4e-05b6-41cf-9e11-da428e3d27ef req-29c9f0e4-e58b-47f4-a37a-ef365ea36021 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Received event network-changed-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-0feb3f4e-05b6-41cf-9e11-da428e3d27ef req-29c9f0e4-e58b-47f4-a37a-ef365ea36021 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Refreshing instance network info cache due to event network-changed-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0feb3f4e-05b6-41cf-9e11-da428e3d27ef req-29c9f0e4-e58b-47f4-a37a-ef365ea36021 service nova] Acquiring lock "refresh_cache-62dd0b51-1320-4529-907b-f632f96b48dc" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] There are 0 instances to clean {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Updating instance_info_cache with network_info: [{"id": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "address": "fa:16:3e:91:29:02", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ef4e9-5d", "ovs_interfaceid": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Releasing lock "refresh_cache-62dd0b51-1320-4529-907b-f632f96b48dc" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Instance network_info: |[{"id": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "address": "fa:16:3e:91:29:02", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ef4e9-5d", "ovs_interfaceid": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0feb3f4e-05b6-41cf-9e11-da428e3d27ef req-29c9f0e4-e58b-47f4-a37a-ef365ea36021 service nova] Acquired lock "refresh_cache-62dd0b51-1320-4529-907b-f632f96b48dc" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.network.neutron [req-0feb3f4e-05b6-41cf-9e11-da428e3d27ef req-29c9f0e4-e58b-47f4-a37a-ef365ea36021 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Refreshing network info cache for port 4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Start _get_guest_xml network_info=[{"id": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "address": "fa:16:3e:91:29:02", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ef4e9-5d", "ovs_interfaceid": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:27:19 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:27:19 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:27:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-63962111',display_name='tempest-VolumesSnapshotTestJSON-instance-63962111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-63962111',id=24,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2qe/ZHYOTMRsXfuWgAlHZhnSmAVM6rjI67SizzDq8euUufDJVChjL4gLBcMqeBPY742rMlxUCgJLe+9XoD3E1/plsFdmAkwNU870axaGEQ8qGivfjfQ6bxWODa6WZ43A==',key_name='tempest-keypair-1420259346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f96ef08868f45aea64ddf76a0bb68f5',ramdisk_id='',reservation_id='r-tz5zam3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1222672370',owner_user_name='tempest-VolumesSnapshotTestJSON-1222672370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:27:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55c7ca8d3b6d4d42b656d9a4a9bc11a5',uuid=62dd0b51-1320-4529-907b-f632f96b48dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "address": "fa:16:3e:91:29:02", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ef4e9-5d", "ovs_interfaceid": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Converting VIF {"id": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "address": "fa:16:3e:91:29:02", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ef4e9-5d", "ovs_interfaceid": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:29:02,bridge_name='br-int',has_traffic_filtering=True,id=4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff,network=Network(b0620144-0532-4223-82f2-0fe7d1bd449e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ef4e9-5d') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.objects.instance [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lazy-loading 'pci_devices' on Instance uuid 62dd0b51-1320-4529-907b-f632f96b48dc {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:27:19 user nova-compute[72874]:   <uuid>62dd0b51-1320-4529-907b-f632f96b48dc</uuid>
Aug 17 18:27:19 user nova-compute[72874]:   <name>instance-00000018</name>
Aug 17 18:27:19 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:27:19 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:27:19 user nova-compute[72874]:   <metadata>
Aug 17 18:27:19 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:27:19 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:27:19 user nova-compute[72874]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-63962111</nova:name>
Aug 17 18:27:19 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:27:19</nova:creationTime>
Aug 17 18:27:19 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:27:19 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:27:19 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:27:19 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:27:19 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:27:19 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:27:19 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:27:19 user nova-compute[72874]:       <nova:owner>
Aug 17 18:27:19 user nova-compute[72874]:         <nova:user uuid="55c7ca8d3b6d4d42b656d9a4a9bc11a5">tempest-VolumesSnapshotTestJSON-1222672370-project-member</nova:user>
Aug 17 18:27:19 user nova-compute[72874]:         <nova:project uuid="1f96ef08868f45aea64ddf76a0bb68f5">tempest-VolumesSnapshotTestJSON-1222672370</nova:project>
Aug 17 18:27:19 user nova-compute[72874]:       </nova:owner>
Aug 17 18:27:19 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:27:19 user nova-compute[72874]:       <nova:ports>
Aug 17 18:27:19 user nova-compute[72874]:         <nova:port uuid="4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff">
Aug 17 18:27:19 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 18:27:19 user nova-compute[72874]:         </nova:port>
Aug 17 18:27:19 user nova-compute[72874]:       </nova:ports>
Aug 17 18:27:19 user nova-compute[72874]:     </nova:instance>
Aug 17 18:27:19 user nova-compute[72874]:   </metadata>
Aug 17 18:27:19 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:27:19 user nova-compute[72874]:     <system>
Aug 17 18:27:19 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:27:19 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:27:19 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:27:19 user nova-compute[72874]:       <entry name="serial">62dd0b51-1320-4529-907b-f632f96b48dc</entry>
Aug 17 18:27:19 user nova-compute[72874]:       <entry name="uuid">62dd0b51-1320-4529-907b-f632f96b48dc</entry>
Aug 17 18:27:19 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:27:19 user nova-compute[72874]:     </system>
Aug 17 18:27:19 user nova-compute[72874]:   </sysinfo>
Aug 17 18:27:19 user nova-compute[72874]:   <os>
Aug 17 18:27:19 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:27:19 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:27:19 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:27:19 user nova-compute[72874]:   </os>
Aug 17 18:27:19 user nova-compute[72874]:   <features>
Aug 17 18:27:19 user nova-compute[72874]:     <acpi/>
Aug 17 18:27:19 user nova-compute[72874]:     <apic/>
Aug 17 18:27:19 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:27:19 user nova-compute[72874]:   </features>
Aug 17 18:27:19 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:27:19 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:27:19 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:27:19 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:27:19 user nova-compute[72874]:   </clock>
Aug 17 18:27:19 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:27:19 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:27:19 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:27:19 user nova-compute[72874]:   </cpu>
Aug 17 18:27:19 user nova-compute[72874]:   <devices>
Aug 17 18:27:19 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:27:19 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:27:19 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk"/>
Aug 17 18:27:19 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:27:19 user nova-compute[72874]:     </disk>
Aug 17 18:27:19 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:27:19 user nova-compute[72874]:       <mac address="fa:16:3e:91:29:02"/>
Aug 17 18:27:19 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:27:19 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:27:19 user nova-compute[72874]:       <target dev="tap4a4ef4e9-5d"/>
Aug 17 18:27:19 user nova-compute[72874]:     </interface>
Aug 17 18:27:19 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:27:19 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/console.log" append="off"/>
Aug 17 18:27:19 user nova-compute[72874]:     </serial>
Aug 17 18:27:19 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:27:19 user nova-compute[72874]:     <video>
Aug 17 18:27:19 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:27:19 user nova-compute[72874]:     </video>
Aug 17 18:27:19 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:27:19 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:27:19 user nova-compute[72874]:     </rng>
Aug 17 18:27:19 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:27:19 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:27:19 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:27:19 user nova-compute[72874]:     </memballoon>
Aug 17 18:27:19 user nova-compute[72874]:   </devices>
Aug 17 18:27:19 user nova-compute[72874]: </domain>
Aug 17 18:27:19 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:27:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-63962111',display_name='tempest-VolumesSnapshotTestJSON-instance-63962111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-63962111',id=24,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2qe/ZHYOTMRsXfuWgAlHZhnSmAVM6rjI67SizzDq8euUufDJVChjL4gLBcMqeBPY742rMlxUCgJLe+9XoD3E1/plsFdmAkwNU870axaGEQ8qGivfjfQ6bxWODa6WZ43A==',key_name='tempest-keypair-1420259346',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1f96ef08868f45aea64ddf76a0bb68f5',ramdisk_id='',reservation_id='r-tz5zam3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1222672370',owner_user_name='tempest-VolumesSnapshotTestJSON-1222672370-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:27:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55c7ca8d3b6d4d42b656d9a4a9bc11a5',uuid=62dd0b51-1320-4529-907b-f632f96b48dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "address": "fa:16:3e:91:29:02", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ef4e9-5d", "ovs_interfaceid": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Converting VIF {"id": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "address": "fa:16:3e:91:29:02", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ef4e9-5d", "ovs_interfaceid": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:29:02,bridge_name='br-int',has_traffic_filtering=True,id=4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff,network=Network(b0620144-0532-4223-82f2-0fe7d1bd449e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ef4e9-5d') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG os_vif [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:29:02,bridge_name='br-int',has_traffic_filtering=True,id=4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff,network=Network(b0620144-0532-4223-82f2-0fe7d1bd449e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ef4e9-5d') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a4ef4e9-5d, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a4ef4e9-5d, col_values=(('external_ids', {'iface-id': '4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:29:02', 'vm-uuid': '62dd0b51-1320-4529-907b-f632f96b48dc'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:19 user nova-compute[72874]: INFO os_vif [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:29:02,bridge_name='br-int',has_traffic_filtering=True,id=4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff,network=Network(b0620144-0532-4223-82f2-0fe7d1bd449e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ef4e9-5d')
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:27:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] No VIF found with MAC fa:16:3e:91:29:02, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:27:20 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:27:20 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:27:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:27:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:27:20 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:27:20 user nova-compute[72874]: DEBUG nova.network.neutron [req-0feb3f4e-05b6-41cf-9e11-da428e3d27ef req-29c9f0e4-e58b-47f4-a37a-ef365ea36021 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Updated VIF entry in instance network info cache for port 4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:27:20 user nova-compute[72874]: DEBUG nova.network.neutron [req-0feb3f4e-05b6-41cf-9e11-da428e3d27ef req-29c9f0e4-e58b-47f4-a37a-ef365ea36021 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Updating instance_info_cache with network_info: [{"id": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "address": "fa:16:3e:91:29:02", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ef4e9-5d", "ovs_interfaceid": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:27:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0feb3f4e-05b6-41cf-9e11-da428e3d27ef req-29c9f0e4-e58b-47f4-a37a-ef365ea36021 service nova] Releasing lock "refresh_cache-62dd0b51-1320-4529-907b-f632f96b48dc" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:27:20 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Updating instance_info_cache with network_info: [{"id": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "address": "fa:16:3e:25:a4:9a", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e25bfc2-df", "ovs_interfaceid": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:27:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:27:20 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:27:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:27:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:27:22 user nova-compute[72874]: DEBUG nova.compute.manager [req-910db1d3-033d-4002-be22-0c98628bc229 req-e395b3f7-8522-4c34-89d7-8d520f5cb8f2 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Received event network-vif-plugged-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:27:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-910db1d3-033d-4002-be22-0c98628bc229 req-e395b3f7-8522-4c34-89d7-8d520f5cb8f2 service nova] Acquiring lock "62dd0b51-1320-4529-907b-f632f96b48dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-910db1d3-033d-4002-be22-0c98628bc229 req-e395b3f7-8522-4c34-89d7-8d520f5cb8f2 service nova] Lock "62dd0b51-1320-4529-907b-f632f96b48dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-910db1d3-033d-4002-be22-0c98628bc229 req-e395b3f7-8522-4c34-89d7-8d520f5cb8f2 service nova] Lock "62dd0b51-1320-4529-907b-f632f96b48dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:22 user nova-compute[72874]: DEBUG nova.compute.manager [req-910db1d3-033d-4002-be22-0c98628bc229 req-e395b3f7-8522-4c34-89d7-8d520f5cb8f2 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] No waiting events found dispatching network-vif-plugged-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:27:22 user nova-compute[72874]: WARNING nova.compute.manager [req-910db1d3-033d-4002-be22-0c98628bc229 req-e395b3f7-8522-4c34-89d7-8d520f5cb8f2 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Received unexpected event network-vif-plugged-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff for instance with vm_state building and task_state spawning.
Aug 17 18:27:23 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:27:23 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296843.6963272, 62dd0b51-1320-4529-907b-f632f96b48dc => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:27:23 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] VM Resumed (Lifecycle Event)
Aug 17 18:27:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:27:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:27:23 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Instance spawned successfully.
Aug 17 18:27:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:27:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:27:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:27:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:27:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:27:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:27:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:27:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:27:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:27:23 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:27:23 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296843.703776, 62dd0b51-1320-4529-907b-f632f96b48dc => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:27:23 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] VM Started (Lifecycle Event)
Aug 17 18:27:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:27:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:27:23 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:27:23 user nova-compute[72874]: INFO nova.compute.manager [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Took 6.59 seconds to spawn the instance on the hypervisor.
Aug 17 18:27:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:27:23 user nova-compute[72874]: INFO nova.compute.manager [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Took 7.54 seconds to build instance.
Aug 17 18:27:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc39e79c-8e3e-4d75-b26f-c76628ece2e6 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "62dd0b51-1320-4529-907b-f632f96b48dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.650s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-249fb8dd-c833-499c-994c-4b3a8c368326 req-84e67b99-469f-4531-8468-809bd58296d1 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Received event network-vif-plugged-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:27:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-249fb8dd-c833-499c-994c-4b3a8c368326 req-84e67b99-469f-4531-8468-809bd58296d1 service nova] Acquiring lock "62dd0b51-1320-4529-907b-f632f96b48dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-249fb8dd-c833-499c-994c-4b3a8c368326 req-84e67b99-469f-4531-8468-809bd58296d1 service nova] Lock "62dd0b51-1320-4529-907b-f632f96b48dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-249fb8dd-c833-499c-994c-4b3a8c368326 req-84e67b99-469f-4531-8468-809bd58296d1 service nova] Lock "62dd0b51-1320-4529-907b-f632f96b48dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-249fb8dd-c833-499c-994c-4b3a8c368326 req-84e67b99-469f-4531-8468-809bd58296d1 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] No waiting events found dispatching network-vif-plugged-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:27:24 user nova-compute[72874]: WARNING nova.compute.manager [req-249fb8dd-c833-499c-994c-4b3a8c368326 req-84e67b99-469f-4531-8468-809bd58296d1 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Received unexpected event network-vif-plugged-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff for instance with vm_state active and task_state None.
Aug 17 18:27:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:26 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:27:26 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:27:26 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296831.624322, 857d43f7-6f53-4c82-9e68-fca3078e97ea => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:27:26 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] VM Stopped (Lifecycle Event)
Aug 17 18:27:26 user nova-compute[72874]: DEBUG nova.compute.manager [None req-c4dedf9a-7491-4ec7-b386-8fa358b5b990 None None] [instance: 857d43f7-6f53-4c82-9e68-fca3078e97ea] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:27 user nova-compute[72874]: INFO nova.compute.manager [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Terminating instance
Aug 17 18:27:27 user nova-compute[72874]: DEBUG nova.compute.manager [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-53ad6382-ab3f-43ac-9d49-39f483790f9d req-9b2dd350-6b25-43d7-9c50-3f2c0648f79a service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received event network-vif-unplugged-3a5303af-3fe8-41ec-a01c-5a0223d20dfa {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-53ad6382-ab3f-43ac-9d49-39f483790f9d req-9b2dd350-6b25-43d7-9c50-3f2c0648f79a service nova] Acquiring lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-53ad6382-ab3f-43ac-9d49-39f483790f9d req-9b2dd350-6b25-43d7-9c50-3f2c0648f79a service nova] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-53ad6382-ab3f-43ac-9d49-39f483790f9d req-9b2dd350-6b25-43d7-9c50-3f2c0648f79a service nova] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-53ad6382-ab3f-43ac-9d49-39f483790f9d req-9b2dd350-6b25-43d7-9c50-3f2c0648f79a service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] No waiting events found dispatching network-vif-unplugged-3a5303af-3fe8-41ec-a01c-5a0223d20dfa {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-53ad6382-ab3f-43ac-9d49-39f483790f9d req-9b2dd350-6b25-43d7-9c50-3f2c0648f79a service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received event network-vif-unplugged-3a5303af-3fe8-41ec-a01c-5a0223d20dfa for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:27:27 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Instance destroyed successfully.
Aug 17 18:27:27 user nova-compute[72874]: DEBUG nova.objects.instance [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lazy-loading 'resources' on Instance uuid e92e565e-c5d9-433e-8c6a-0cb049c000a7 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T18:24:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1784183103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1784183103',id=22,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODORGFU372BNdOaIwC88Uz6tubqWS+C4jqGAbM5re2MuHMJFjzHyXf/75k8RdxtFKwcVsHrr4vNfLeqVS5Zfg09lw8vrsW0zlhTritsP1Yjsx1ETqQHCdS8D+8n7979wg==',key_name='tempest-keypair-1258010050',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:24:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56c8770bee784ba5af885002d30db7dc',ramdisk_id='',reservation_id='r-numhxl95',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-671856852',owner_user_name='tempest-TaggedAttachmentsTest-671856852-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:24:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='eb48e4d34e494fabbe1af3fd7eef2f76',uuid=e92e565e-c5d9-433e-8c6a-0cb049c000a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "address": "fa:16:3e:6d:2e:95", "network": {"id": "d73d605d-c67e-4657-9771-76c2544cbe76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-764769447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5303af-3f", "ovs_interfaceid": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Converting VIF {"id": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "address": "fa:16:3e:6d:2e:95", "network": {"id": "d73d605d-c67e-4657-9771-76c2544cbe76", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-764769447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56c8770bee784ba5af885002d30db7dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a5303af-3f", "ovs_interfaceid": "3a5303af-3fe8-41ec-a01c-5a0223d20dfa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6d:2e:95,bridge_name='br-int',has_traffic_filtering=True,id=3a5303af-3fe8-41ec-a01c-5a0223d20dfa,network=Network(d73d605d-c67e-4657-9771-76c2544cbe76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5303af-3f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:27:27 user nova-compute[72874]: DEBUG os_vif [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:2e:95,bridge_name='br-int',has_traffic_filtering=True,id=3a5303af-3fe8-41ec-a01c-5a0223d20dfa,network=Network(d73d605d-c67e-4657-9771-76c2544cbe76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5303af-3f') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:27:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a5303af-3f, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:27:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:27:28 user nova-compute[72874]: INFO os_vif [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6d:2e:95,bridge_name='br-int',has_traffic_filtering=True,id=3a5303af-3fe8-41ec-a01c-5a0223d20dfa,network=Network(d73d605d-c67e-4657-9771-76c2544cbe76),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a5303af-3f')
Aug 17 18:27:28 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Deleting instance files /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7_del
Aug 17 18:27:28 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Deletion of /opt/stack/data/nova/instances/e92e565e-c5d9-433e-8c6a-0cb049c000a7_del complete
Aug 17 18:27:28 user nova-compute[72874]: INFO nova.compute.manager [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 18:27:28 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:27:28 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:27:28 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:27:29 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:27:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-113d07c0-edf0-4cfb-9990-37453882aa3d req-2cd79dbd-b248-4aae-aa20-de915fd25cdd service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received event network-vif-deleted-3a5303af-3fe8-41ec-a01c-5a0223d20dfa {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:27:29 user nova-compute[72874]: INFO nova.compute.manager [req-113d07c0-edf0-4cfb-9990-37453882aa3d req-2cd79dbd-b248-4aae-aa20-de915fd25cdd service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Neutron deleted interface 3a5303af-3fe8-41ec-a01c-5a0223d20dfa; detaching it from the instance and deleting it from the info cache
Aug 17 18:27:29 user nova-compute[72874]: DEBUG nova.network.neutron [req-113d07c0-edf0-4cfb-9990-37453882aa3d req-2cd79dbd-b248-4aae-aa20-de915fd25cdd service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:27:29 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Took 1.05 seconds to deallocate network for instance.
Aug 17 18:27:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-113d07c0-edf0-4cfb-9990-37453882aa3d req-2cd79dbd-b248-4aae-aa20-de915fd25cdd service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Detach interface failed, port_id=3a5303af-3fe8-41ec-a01c-5a0223d20dfa, reason: Instance e92e565e-c5d9-433e-8c6a-0cb049c000a7 could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:27:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:29 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:27:29 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:27:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:29 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Deleted allocations for instance e92e565e-c5d9-433e-8c6a-0cb049c000a7
Aug 17 18:27:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-135c9113-c83c-4c11-b0c3-31a2db831e94 req-f2b64d40-b928-49fe-9955-650332843fe5 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received event network-vif-plugged-3a5303af-3fe8-41ec-a01c-5a0223d20dfa {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:27:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-135c9113-c83c-4c11-b0c3-31a2db831e94 req-f2b64d40-b928-49fe-9955-650332843fe5 service nova] Acquiring lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-135c9113-c83c-4c11-b0c3-31a2db831e94 req-f2b64d40-b928-49fe-9955-650332843fe5 service nova] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-135c9113-c83c-4c11-b0c3-31a2db831e94 req-f2b64d40-b928-49fe-9955-650332843fe5 service nova] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-135c9113-c83c-4c11-b0c3-31a2db831e94 req-f2b64d40-b928-49fe-9955-650332843fe5 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] No waiting events found dispatching network-vif-plugged-3a5303af-3fe8-41ec-a01c-5a0223d20dfa {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:27:29 user nova-compute[72874]: WARNING nova.compute.manager [req-135c9113-c83c-4c11-b0c3-31a2db831e94 req-f2b64d40-b928-49fe-9955-650332843fe5 service nova] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Received unexpected event network-vif-plugged-3a5303af-3fe8-41ec-a01c-5a0223d20dfa for instance with vm_state deleted and task_state None.
Aug 17 18:27:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f9c4f0d9-634d-4113-a8d1-89310caa9ae0 tempest-TaggedAttachmentsTest-671856852 tempest-TaggedAttachmentsTest-671856852-project-member] Lock "e92e565e-c5d9-433e-8c6a-0cb049c000a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.494s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "cf9f3116-5e42-4858-a391-ab75d2046f1a" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:34 user nova-compute[72874]: INFO nova.compute.manager [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Unshelving
Aug 17 18:27:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:34 user nova-compute[72874]: DEBUG nova.objects.instance [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'pci_requests' on Instance uuid cf9f3116-5e42-4858-a391-ab75d2046f1a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:27:34 user nova-compute[72874]: DEBUG nova.objects.instance [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'numa_topology' on Instance uuid cf9f3116-5e42-4858-a391-ab75d2046f1a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:27:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:27:34 user nova-compute[72874]: INFO nova.compute.claims [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Claim successful on node user
Aug 17 18:27:34 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:27:34 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:27:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:35 user nova-compute[72874]: INFO nova.network.neutron [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Updating port dbb991ed-781f-4666-a0b6-c360ab742952 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 18:27:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:27:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquired lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:27:35 user nova-compute[72874]: DEBUG nova.network.neutron [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:27:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-1cabccfe-8caa-4581-b0ac-db6eef2b2df1 req-b96c1970-cc6d-42e5-a90f-b45c2769d0e8 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received event network-changed-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:27:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-1cabccfe-8caa-4581-b0ac-db6eef2b2df1 req-b96c1970-cc6d-42e5-a90f-b45c2769d0e8 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Refreshing instance network info cache due to event network-changed-dbb991ed-781f-4666-a0b6-c360ab742952. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:27:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1cabccfe-8caa-4581-b0ac-db6eef2b2df1 req-b96c1970-cc6d-42e5-a90f-b45c2769d0e8 service nova] Acquiring lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:27:36 user nova-compute[72874]: DEBUG nova.network.neutron [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Updating instance_info_cache with network_info: [{"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:27:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Releasing lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:27:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:27:36 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Creating image(s)
Aug 17 18:27:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "/opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "/opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:36 user nova-compute[72874]: DEBUG nova.objects.instance [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'trusted_certs' on Instance uuid cf9f3116-5e42-4858-a391-ab75d2046f1a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:27:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1cabccfe-8caa-4581-b0ac-db6eef2b2df1 req-b96c1970-cc6d-42e5-a90f-b45c2769d0e8 service nova] Acquired lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:27:36 user nova-compute[72874]: DEBUG nova.network.neutron [req-1cabccfe-8caa-4581-b0ac-db6eef2b2df1 req-b96c1970-cc6d-42e5-a90f-b45c2769d0e8 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Refreshing network info cache for port dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:27:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "01c407a0d5a2122bb361b9a096e8b1ea9189ff98" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "01c407a0d5a2122bb361b9a096e8b1ea9189ff98" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98.part --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98.part --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:37 user nova-compute[72874]: DEBUG nova.virt.images [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] 8dbc732f-4402-45b4-aab2-577524eb50bb was qcow2, converting to raw {{(pid=72874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 18:27:37 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:27:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98.part /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98.converted {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:38 user nova-compute[72874]: DEBUG nova.network.neutron [req-1cabccfe-8caa-4581-b0ac-db6eef2b2df1 req-b96c1970-cc6d-42e5-a90f-b45c2769d0e8 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Updated VIF entry in instance network info cache for port dbb991ed-781f-4666-a0b6-c360ab742952. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:27:38 user nova-compute[72874]: DEBUG nova.network.neutron [req-1cabccfe-8caa-4581-b0ac-db6eef2b2df1 req-b96c1970-cc6d-42e5-a90f-b45c2769d0e8 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Updating instance_info_cache with network_info: [{"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:27:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1cabccfe-8caa-4581-b0ac-db6eef2b2df1 req-b96c1970-cc6d-42e5-a90f-b45c2769d0e8 service nova] Releasing lock "refresh_cache-cf9f3116-5e42-4858-a391-ab75d2046f1a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:27:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98.part /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98.converted" returned: 0 in 0.628s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98.converted --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98.converted --force-share --output=json" returned: 0 in 0.232s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "01c407a0d5a2122bb361b9a096e8b1ea9189ff98" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.543s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98 --force-share --output=json" returned: 0 in 0.171s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "01c407a0d5a2122bb361b9a096e8b1ea9189ff98" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "01c407a0d5a2122bb361b9a096e8b1ea9189ff98" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98 --force-share --output=json" returned: 0 in 0.203s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98,backing_fmt=raw /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98,backing_fmt=raw /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk 1073741824" returned: 0 in 0.055s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "01c407a0d5a2122bb361b9a096e8b1ea9189ff98" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98 --force-share --output=json" returned: 0 in 0.192s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:39 user nova-compute[72874]: DEBUG nova.objects.instance [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'migration_context' on Instance uuid cf9f3116-5e42-4858-a391-ab75d2046f1a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:27:39 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Rebasing disk image.
Aug 17 18:27:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.190s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 -F raw /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 -F raw /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk" returned: 0 in 2.830s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Ensure instance console log exists: /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.008s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Start _get_guest_xml network_info=[{"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='476064b2d1a88e33048ebd830484b17b',container_format='bare',created_at=2023-08-17T18:25:41Z,direct_url=<?>,disk_format='qcow2',id=8dbc732f-4402-45b4-aab2-577524eb50bb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-256691474-shelved',owner='5c20349a873f4ec7a0f72a7d64c636e4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T18:25:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:27:42 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:27:42 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='476064b2d1a88e33048ebd830484b17b',container_format='bare',created_at=2023-08-17T18:25:41Z,direct_url=<?>,disk_format='qcow2',id=8dbc732f-4402-45b4-aab2-577524eb50bb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-256691474-shelved',owner='5c20349a873f4ec7a0f72a7d64c636e4',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T18:25:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.objects.instance [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'vcpu_model' on Instance uuid cf9f3116-5e42-4858-a391-ab75d2046f1a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T18:23:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-256691474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-256691474',id=21,image_ref='8dbc732f-4402-45b4-aab2-577524eb50bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1928119168',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5c20349a873f4ec7a0f72a7d64c636e4',ramdisk_id='',reservation_id='r-ju6xb3sz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1376162523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1376162523-project-member',shelved_at='2023-08-17T18:25:45.316943',shelved_host='user',shelved_image_id='8dbc732f-4402-45b4-aab2-577524eb50bb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:27:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b47defaba840e1ba8f91603d99caac',uuid=cf9f3116-5e42-4858-a391-ab75d2046f1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converting VIF {"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cd:60,bridge_name='br-int',has_traffic_filtering=True,id=dbb991ed-781f-4666-a0b6-c360ab742952,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb991ed-78') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.objects.instance [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'pci_devices' on Instance uuid cf9f3116-5e42-4858-a391-ab75d2046f1a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:27:42 user nova-compute[72874]:   <uuid>cf9f3116-5e42-4858-a391-ab75d2046f1a</uuid>
Aug 17 18:27:42 user nova-compute[72874]:   <name>instance-00000015</name>
Aug 17 18:27:42 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:27:42 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:27:42 user nova-compute[72874]:   <metadata>
Aug 17 18:27:42 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:27:42 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:27:42 user nova-compute[72874]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-256691474</nova:name>
Aug 17 18:27:42 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:27:42</nova:creationTime>
Aug 17 18:27:42 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:27:42 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:27:42 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:27:42 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:27:42 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:27:42 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:27:42 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:27:42 user nova-compute[72874]:       <nova:owner>
Aug 17 18:27:42 user nova-compute[72874]:         <nova:user uuid="01b47defaba840e1ba8f91603d99caac">tempest-AttachVolumeShelveTestJSON-1376162523-project-member</nova:user>
Aug 17 18:27:42 user nova-compute[72874]:         <nova:project uuid="5c20349a873f4ec7a0f72a7d64c636e4">tempest-AttachVolumeShelveTestJSON-1376162523</nova:project>
Aug 17 18:27:42 user nova-compute[72874]:       </nova:owner>
Aug 17 18:27:42 user nova-compute[72874]:       <nova:root type="image" uuid="8dbc732f-4402-45b4-aab2-577524eb50bb"/>
Aug 17 18:27:42 user nova-compute[72874]:       <nova:ports>
Aug 17 18:27:42 user nova-compute[72874]:         <nova:port uuid="dbb991ed-781f-4666-a0b6-c360ab742952">
Aug 17 18:27:42 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 18:27:42 user nova-compute[72874]:         </nova:port>
Aug 17 18:27:42 user nova-compute[72874]:       </nova:ports>
Aug 17 18:27:42 user nova-compute[72874]:     </nova:instance>
Aug 17 18:27:42 user nova-compute[72874]:   </metadata>
Aug 17 18:27:42 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:27:42 user nova-compute[72874]:     <system>
Aug 17 18:27:42 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:27:42 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:27:42 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:27:42 user nova-compute[72874]:       <entry name="serial">cf9f3116-5e42-4858-a391-ab75d2046f1a</entry>
Aug 17 18:27:42 user nova-compute[72874]:       <entry name="uuid">cf9f3116-5e42-4858-a391-ab75d2046f1a</entry>
Aug 17 18:27:42 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:27:42 user nova-compute[72874]:     </system>
Aug 17 18:27:42 user nova-compute[72874]:   </sysinfo>
Aug 17 18:27:42 user nova-compute[72874]:   <os>
Aug 17 18:27:42 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:27:42 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:27:42 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:27:42 user nova-compute[72874]:   </os>
Aug 17 18:27:42 user nova-compute[72874]:   <features>
Aug 17 18:27:42 user nova-compute[72874]:     <acpi/>
Aug 17 18:27:42 user nova-compute[72874]:     <apic/>
Aug 17 18:27:42 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:27:42 user nova-compute[72874]:   </features>
Aug 17 18:27:42 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:27:42 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:27:42 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:27:42 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:27:42 user nova-compute[72874]:   </clock>
Aug 17 18:27:42 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:27:42 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:27:42 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:27:42 user nova-compute[72874]:   </cpu>
Aug 17 18:27:42 user nova-compute[72874]:   <devices>
Aug 17 18:27:42 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:27:42 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:27:42 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk"/>
Aug 17 18:27:42 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:27:42 user nova-compute[72874]:     </disk>
Aug 17 18:27:42 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:27:42 user nova-compute[72874]:       <mac address="fa:16:3e:ac:cd:60"/>
Aug 17 18:27:42 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:27:42 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:27:42 user nova-compute[72874]:       <target dev="tapdbb991ed-78"/>
Aug 17 18:27:42 user nova-compute[72874]:     </interface>
Aug 17 18:27:42 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:27:42 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/console.log" append="off"/>
Aug 17 18:27:42 user nova-compute[72874]:     </serial>
Aug 17 18:27:42 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:27:42 user nova-compute[72874]:     <video>
Aug 17 18:27:42 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:27:42 user nova-compute[72874]:     </video>
Aug 17 18:27:42 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:27:42 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:27:42 user nova-compute[72874]:     </rng>
Aug 17 18:27:42 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:27:42 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:27:42 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:27:42 user nova-compute[72874]:     </memballoon>
Aug 17 18:27:42 user nova-compute[72874]:   </devices>
Aug 17 18:27:42 user nova-compute[72874]: </domain>
Aug 17 18:27:42 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T18:23:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-256691474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-256691474',id=21,image_ref='8dbc732f-4402-45b4-aab2-577524eb50bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1928119168',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5c20349a873f4ec7a0f72a7d64c636e4',ramdisk_id='',reservation_id='r-ju6xb3sz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1376162523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1376162523-project-member',shelved_at='2023-08-17T18:25:45.316943',shelved_host='user',shelved_image_id='8dbc732f-4402-45b4-aab2-577524eb50bb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:27:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b47defaba840e1ba8f91603d99caac',uuid=cf9f3116-5e42-4858-a391-ab75d2046f1a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converting VIF {"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cd:60,bridge_name='br-int',has_traffic_filtering=True,id=dbb991ed-781f-4666-a0b6-c360ab742952,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb991ed-78') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG os_vif [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cd:60,bridge_name='br-int',has_traffic_filtering=True,id=dbb991ed-781f-4666-a0b6-c360ab742952,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb991ed-78') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbb991ed-78, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbb991ed-78, col_values=(('external_ids', {'iface-id': 'dbb991ed-781f-4666-a0b6-c360ab742952', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:cd:60', 'vm-uuid': 'cf9f3116-5e42-4858-a391-ab75d2046f1a'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:42 user nova-compute[72874]: INFO os_vif [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cd:60,bridge_name='br-int',has_traffic_filtering=True,id=dbb991ed-781f-4666-a0b6-c360ab742952,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb991ed-78')
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] No VIF found with MAC fa:16:3e:ac:cd:60, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:27:42 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296847.9775944, e92e565e-c5d9-433e-8c6a-0cb049c000a7 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:27:42 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] VM Stopped (Lifecycle Event)
Aug 17 18:27:43 user nova-compute[72874]: DEBUG nova.compute.manager [None req-82f4449f-6dcb-46ea-b8eb-a6c0b1f9b41a None None] [instance: e92e565e-c5d9-433e-8c6a-0cb049c000a7] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:27:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-b3d87da6-9770-4aa6-b2d8-702831ea0aa8 req-9aa1fc47-3181-41a8-b7b0-d44c86873430 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received event network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:27:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b3d87da6-9770-4aa6-b2d8-702831ea0aa8 req-9aa1fc47-3181-41a8-b7b0-d44c86873430 service nova] Acquiring lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b3d87da6-9770-4aa6-b2d8-702831ea0aa8 req-9aa1fc47-3181-41a8-b7b0-d44c86873430 service nova] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b3d87da6-9770-4aa6-b2d8-702831ea0aa8 req-9aa1fc47-3181-41a8-b7b0-d44c86873430 service nova] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-b3d87da6-9770-4aa6-b2d8-702831ea0aa8 req-9aa1fc47-3181-41a8-b7b0-d44c86873430 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] No waiting events found dispatching network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:27:44 user nova-compute[72874]: WARNING nova.compute.manager [req-b3d87da6-9770-4aa6-b2d8-702831ea0aa8 req-9aa1fc47-3181-41a8-b7b0-d44c86873430 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received unexpected event network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 18:27:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:46 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296866.4236906, cf9f3116-5e42-4858-a391-ab75d2046f1a => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:27:46 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] VM Resumed (Lifecycle Event)
Aug 17 18:27:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:27:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:27:46 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Instance spawned successfully.
Aug 17 18:27:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:27:46 user nova-compute[72874]: DEBUG nova.compute.manager [req-ea35b6c4-994c-4a97-a452-481a6c7bea1c req-e9e9786d-7a5a-4559-ac83-01a2a5a80dc4 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received event network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:27:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ea35b6c4-994c-4a97-a452-481a6c7bea1c req-e9e9786d-7a5a-4559-ac83-01a2a5a80dc4 service nova] Acquiring lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ea35b6c4-994c-4a97-a452-481a6c7bea1c req-e9e9786d-7a5a-4559-ac83-01a2a5a80dc4 service nova] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ea35b6c4-994c-4a97-a452-481a6c7bea1c req-e9e9786d-7a5a-4559-ac83-01a2a5a80dc4 service nova] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:46 user nova-compute[72874]: DEBUG nova.compute.manager [req-ea35b6c4-994c-4a97-a452-481a6c7bea1c req-e9e9786d-7a5a-4559-ac83-01a2a5a80dc4 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] No waiting events found dispatching network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:27:46 user nova-compute[72874]: WARNING nova.compute.manager [req-ea35b6c4-994c-4a97-a452-481a6c7bea1c req-e9e9786d-7a5a-4559-ac83-01a2a5a80dc4 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received unexpected event network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 18:27:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:27:46 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:27:46 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296866.4248261, cf9f3116-5e42-4858-a391-ab75d2046f1a => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:27:46 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] VM Started (Lifecycle Event)
Aug 17 18:27:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:27:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:27:46 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:27:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:27:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-92f9faf0-a979-4fb6-9a97-e085b90cf387 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.272s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Acquiring lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:27:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:57 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:27:57 user nova-compute[72874]: INFO nova.compute.claims [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Claim successful on node user
Aug 17 18:27:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:27:57 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Refreshing inventories for resource provider b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 18:27:57 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Updating ProviderTree inventory for provider b677d836-b01b-4674-8972-53d526f1b5f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 18:27:57 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Updating inventory in ProviderTree for provider b677d836-b01b-4674-8972-53d526f1b5f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 18:27:57 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Refreshing aggregate associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, aggregates: None {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 18:27:57 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Refreshing trait associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, traits: HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.635s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:27:58 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:27:58 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG nova.policy [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ac3941cb59b94fd8842ee7b9427dfb32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '093218eed532483ebd64f6b97cdc1ee8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:27:58 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Creating image(s)
Aug 17 18:27:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "/opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "/opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.195s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk 1073741824" returned: 0 in 0.050s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:27:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.199s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:59 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:27:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:27:59 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Successfully created port: 65ab9470-0aab-47c5-88ee-bddd58e7d035 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:27:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:27:59 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Cannot resize image /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:27:59 user nova-compute[72874]: DEBUG nova.objects.instance [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lazy-loading 'migration_context' on Instance uuid ce433d26-f10d-4d06-a0a2-96ae9bde4dff {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:27:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:27:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Ensure instance console log exists: /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:27:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:27:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:27:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Successfully updated port: 65ab9470-0aab-47c5-88ee-bddd58e7d035 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Acquiring lock "refresh_cache-ce433d26-f10d-4d06-a0a2-96ae9bde4dff" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Acquired lock "refresh_cache-ce433d26-f10d-4d06-a0a2-96ae9bde4dff" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-7411fb03-88f9-483c-9e61-886ff55712b4 req-7df8706d-6737-4851-a30f-a3aee7601c67 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Received event network-changed-65ab9470-0aab-47c5-88ee-bddd58e7d035 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-7411fb03-88f9-483c-9e61-886ff55712b4 req-7df8706d-6737-4851-a30f-a3aee7601c67 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Refreshing instance network info cache due to event network-changed-65ab9470-0aab-47c5-88ee-bddd58e7d035. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7411fb03-88f9-483c-9e61-886ff55712b4 req-7df8706d-6737-4851-a30f-a3aee7601c67 service nova] Acquiring lock "refresh_cache-ce433d26-f10d-4d06-a0a2-96ae9bde4dff" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Updating instance_info_cache with network_info: [{"id": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "address": "fa:16:3e:c2:2d:43", "network": {"id": "cadafcef-708e-45df-b9f3-cfbdd35b71c7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-249057465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093218eed532483ebd64f6b97cdc1ee8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ab9470-0a", "ovs_interfaceid": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Releasing lock "refresh_cache-ce433d26-f10d-4d06-a0a2-96ae9bde4dff" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Instance network_info: |[{"id": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "address": "fa:16:3e:c2:2d:43", "network": {"id": "cadafcef-708e-45df-b9f3-cfbdd35b71c7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-249057465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093218eed532483ebd64f6b97cdc1ee8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ab9470-0a", "ovs_interfaceid": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7411fb03-88f9-483c-9e61-886ff55712b4 req-7df8706d-6737-4851-a30f-a3aee7601c67 service nova] Acquired lock "refresh_cache-ce433d26-f10d-4d06-a0a2-96ae9bde4dff" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.network.neutron [req-7411fb03-88f9-483c-9e61-886ff55712b4 req-7df8706d-6737-4851-a30f-a3aee7601c67 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Refreshing network info cache for port 65ab9470-0aab-47c5-88ee-bddd58e7d035 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Start _get_guest_xml network_info=[{"id": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "address": "fa:16:3e:c2:2d:43", "network": {"id": "cadafcef-708e-45df-b9f3-cfbdd35b71c7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-249057465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093218eed532483ebd64f6b97cdc1ee8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ab9470-0a", "ovs_interfaceid": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:28:00 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:28:00 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:27:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1216974258',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1216974258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1216974',id=25,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTEKmleU3vcdVlRLhdhEpogyL3MEP9Z0DpUJVxOZ0y+QIZ+kalU508aNC27HcEdM5RQ+I8A2IYlF6Hfm3W9vzfFEidUb17qtQiUBMfz5zqa125uZvKfycmZHPcbL3cVZA==',key_name='tempest-keypair-445470352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='093218eed532483ebd64f6b97cdc1ee8',ramdisk_id='',reservation_id='r-s90thqc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-945112022',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:27:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac3941cb59b94fd8842ee7b9427dfb32',uuid=ce433d26-f10d-4d06-a0a2-96ae9bde4dff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "address": "fa:16:3e:c2:2d:43", "network": {"id": "cadafcef-708e-45df-b9f3-cfbdd35b71c7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-249057465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093218eed532483ebd64f6b97cdc1ee8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ab9470-0a", "ovs_interfaceid": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Converting VIF {"id": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "address": "fa:16:3e:c2:2d:43", "network": {"id": "cadafcef-708e-45df-b9f3-cfbdd35b71c7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-249057465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093218eed532483ebd64f6b97cdc1ee8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ab9470-0a", "ovs_interfaceid": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:2d:43,bridge_name='br-int',has_traffic_filtering=True,id=65ab9470-0aab-47c5-88ee-bddd58e7d035,network=Network(cadafcef-708e-45df-b9f3-cfbdd35b71c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ab9470-0a') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.objects.instance [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lazy-loading 'pci_devices' on Instance uuid ce433d26-f10d-4d06-a0a2-96ae9bde4dff {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:28:00 user nova-compute[72874]:   <uuid>ce433d26-f10d-4d06-a0a2-96ae9bde4dff</uuid>
Aug 17 18:28:00 user nova-compute[72874]:   <name>instance-00000019</name>
Aug 17 18:28:00 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:28:00 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:28:00 user nova-compute[72874]:   <metadata>
Aug 17 18:28:00 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:28:00 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:28:00 user nova-compute[72874]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1216974258</nova:name>
Aug 17 18:28:00 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:28:00</nova:creationTime>
Aug 17 18:28:00 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:28:00 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:28:00 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:28:00 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:28:00 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:28:00 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:28:00 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:28:00 user nova-compute[72874]:       <nova:owner>
Aug 17 18:28:00 user nova-compute[72874]:         <nova:user uuid="ac3941cb59b94fd8842ee7b9427dfb32">tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member</nova:user>
Aug 17 18:28:00 user nova-compute[72874]:         <nova:project uuid="093218eed532483ebd64f6b97cdc1ee8">tempest-TestServerVolumeAttachScenarioOldVersion-945112022</nova:project>
Aug 17 18:28:00 user nova-compute[72874]:       </nova:owner>
Aug 17 18:28:00 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:28:00 user nova-compute[72874]:       <nova:ports>
Aug 17 18:28:00 user nova-compute[72874]:         <nova:port uuid="65ab9470-0aab-47c5-88ee-bddd58e7d035">
Aug 17 18:28:00 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 18:28:00 user nova-compute[72874]:         </nova:port>
Aug 17 18:28:00 user nova-compute[72874]:       </nova:ports>
Aug 17 18:28:00 user nova-compute[72874]:     </nova:instance>
Aug 17 18:28:00 user nova-compute[72874]:   </metadata>
Aug 17 18:28:00 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:28:00 user nova-compute[72874]:     <system>
Aug 17 18:28:00 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:28:00 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:28:00 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:28:00 user nova-compute[72874]:       <entry name="serial">ce433d26-f10d-4d06-a0a2-96ae9bde4dff</entry>
Aug 17 18:28:00 user nova-compute[72874]:       <entry name="uuid">ce433d26-f10d-4d06-a0a2-96ae9bde4dff</entry>
Aug 17 18:28:00 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:28:00 user nova-compute[72874]:     </system>
Aug 17 18:28:00 user nova-compute[72874]:   </sysinfo>
Aug 17 18:28:00 user nova-compute[72874]:   <os>
Aug 17 18:28:00 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:28:00 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:28:00 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:28:00 user nova-compute[72874]:   </os>
Aug 17 18:28:00 user nova-compute[72874]:   <features>
Aug 17 18:28:00 user nova-compute[72874]:     <acpi/>
Aug 17 18:28:00 user nova-compute[72874]:     <apic/>
Aug 17 18:28:00 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:28:00 user nova-compute[72874]:   </features>
Aug 17 18:28:00 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:28:00 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:28:00 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:28:00 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:28:00 user nova-compute[72874]:   </clock>
Aug 17 18:28:00 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:28:00 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:28:00 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:28:00 user nova-compute[72874]:   </cpu>
Aug 17 18:28:00 user nova-compute[72874]:   <devices>
Aug 17 18:28:00 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:28:00 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:28:00 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk"/>
Aug 17 18:28:00 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:28:00 user nova-compute[72874]:     </disk>
Aug 17 18:28:00 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:28:00 user nova-compute[72874]:       <mac address="fa:16:3e:c2:2d:43"/>
Aug 17 18:28:00 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:28:00 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:28:00 user nova-compute[72874]:       <target dev="tap65ab9470-0a"/>
Aug 17 18:28:00 user nova-compute[72874]:     </interface>
Aug 17 18:28:00 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:28:00 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/console.log" append="off"/>
Aug 17 18:28:00 user nova-compute[72874]:     </serial>
Aug 17 18:28:00 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:28:00 user nova-compute[72874]:     <video>
Aug 17 18:28:00 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:28:00 user nova-compute[72874]:     </video>
Aug 17 18:28:00 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:28:00 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:28:00 user nova-compute[72874]:     </rng>
Aug 17 18:28:00 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:28:00 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:28:00 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:28:00 user nova-compute[72874]:     </memballoon>
Aug 17 18:28:00 user nova-compute[72874]:   </devices>
Aug 17 18:28:00 user nova-compute[72874]: </domain>
Aug 17 18:28:00 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:27:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1216974258',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1216974258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1216974',id=25,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTEKmleU3vcdVlRLhdhEpogyL3MEP9Z0DpUJVxOZ0y+QIZ+kalU508aNC27HcEdM5RQ+I8A2IYlF6Hfm3W9vzfFEidUb17qtQiUBMfz5zqa125uZvKfycmZHPcbL3cVZA==',key_name='tempest-keypair-445470352',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='093218eed532483ebd64f6b97cdc1ee8',ramdisk_id='',reservation_id='r-s90thqc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-945112022',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:27:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac3941cb59b94fd8842ee7b9427dfb32',uuid=ce433d26-f10d-4d06-a0a2-96ae9bde4dff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "address": "fa:16:3e:c2:2d:43", "network": {"id": "cadafcef-708e-45df-b9f3-cfbdd35b71c7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-249057465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093218eed532483ebd64f6b97cdc1ee8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ab9470-0a", "ovs_interfaceid": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Converting VIF {"id": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "address": "fa:16:3e:c2:2d:43", "network": {"id": "cadafcef-708e-45df-b9f3-cfbdd35b71c7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-249057465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093218eed532483ebd64f6b97cdc1ee8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ab9470-0a", "ovs_interfaceid": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:2d:43,bridge_name='br-int',has_traffic_filtering=True,id=65ab9470-0aab-47c5-88ee-bddd58e7d035,network=Network(cadafcef-708e-45df-b9f3-cfbdd35b71c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ab9470-0a') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG os_vif [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:2d:43,bridge_name='br-int',has_traffic_filtering=True,id=65ab9470-0aab-47c5-88ee-bddd58e7d035,network=Network(cadafcef-708e-45df-b9f3-cfbdd35b71c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ab9470-0a') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65ab9470-0a, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap65ab9470-0a, col_values=(('external_ids', {'iface-id': '65ab9470-0aab-47c5-88ee-bddd58e7d035', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:2d:43', 'vm-uuid': 'ce433d26-f10d-4d06-a0a2-96ae9bde4dff'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:00 user nova-compute[72874]: INFO os_vif [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:2d:43,bridge_name='br-int',has_traffic_filtering=True,id=65ab9470-0aab-47c5-88ee-bddd58e7d035,network=Network(cadafcef-708e-45df-b9f3-cfbdd35b71c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ab9470-0a')
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] No VIF found with MAC fa:16:3e:c2:2d:43, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.network.neutron [req-7411fb03-88f9-483c-9e61-886ff55712b4 req-7df8706d-6737-4851-a30f-a3aee7601c67 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Updated VIF entry in instance network info cache for port 65ab9470-0aab-47c5-88ee-bddd58e7d035. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG nova.network.neutron [req-7411fb03-88f9-483c-9e61-886ff55712b4 req-7df8706d-6737-4851-a30f-a3aee7601c67 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Updating instance_info_cache with network_info: [{"id": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "address": "fa:16:3e:c2:2d:43", "network": {"id": "cadafcef-708e-45df-b9f3-cfbdd35b71c7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-249057465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093218eed532483ebd64f6b97cdc1ee8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ab9470-0a", "ovs_interfaceid": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:28:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7411fb03-88f9-483c-9e61-886ff55712b4 req-7df8706d-6737-4851-a30f-a3aee7601c67 service nova] Releasing lock "refresh_cache-ce433d26-f10d-4d06-a0a2-96ae9bde4dff" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:28:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-ae17f595-f8a1-4bc7-86e7-e3b2b97ce0df req-8bad4523-7047-4d19-a7c5-a4e6bf23e825 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Received event network-vif-plugged-65ab9470-0aab-47c5-88ee-bddd58e7d035 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ae17f595-f8a1-4bc7-86e7-e3b2b97ce0df req-8bad4523-7047-4d19-a7c5-a4e6bf23e825 service nova] Acquiring lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ae17f595-f8a1-4bc7-86e7-e3b2b97ce0df req-8bad4523-7047-4d19-a7c5-a4e6bf23e825 service nova] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ae17f595-f8a1-4bc7-86e7-e3b2b97ce0df req-8bad4523-7047-4d19-a7c5-a4e6bf23e825 service nova] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-ae17f595-f8a1-4bc7-86e7-e3b2b97ce0df req-8bad4523-7047-4d19-a7c5-a4e6bf23e825 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] No waiting events found dispatching network-vif-plugged-65ab9470-0aab-47c5-88ee-bddd58e7d035 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:02 user nova-compute[72874]: WARNING nova.compute.manager [req-ae17f595-f8a1-4bc7-86e7-e3b2b97ce0df req-8bad4523-7047-4d19-a7c5-a4e6bf23e825 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Received unexpected event network-vif-plugged-65ab9470-0aab-47c5-88ee-bddd58e7d035 for instance with vm_state building and task_state spawning.
Aug 17 18:28:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296884.2568645, ce433d26-f10d-4d06-a0a2-96ae9bde4dff => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:28:04 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] VM Resumed (Lifecycle Event)
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:28:04 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Instance spawned successfully.
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:04 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296884.2605002, ce433d26-f10d-4d06-a0a2-96ae9bde4dff => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:28:04 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] VM Started (Lifecycle Event)
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.compute.manager [req-d3b93201-936c-4e9e-98dd-5a0a3e857c92 req-853982f1-d19c-46dd-a974-cb683c5297bb service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Received event network-vif-plugged-65ab9470-0aab-47c5-88ee-bddd58e7d035 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d3b93201-936c-4e9e-98dd-5a0a3e857c92 req-853982f1-d19c-46dd-a974-cb683c5297bb service nova] Acquiring lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d3b93201-936c-4e9e-98dd-5a0a3e857c92 req-853982f1-d19c-46dd-a974-cb683c5297bb service nova] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d3b93201-936c-4e9e-98dd-5a0a3e857c92 req-853982f1-d19c-46dd-a974-cb683c5297bb service nova] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.compute.manager [req-d3b93201-936c-4e9e-98dd-5a0a3e857c92 req-853982f1-d19c-46dd-a974-cb683c5297bb service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] No waiting events found dispatching network-vif-plugged-65ab9470-0aab-47c5-88ee-bddd58e7d035 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:04 user nova-compute[72874]: WARNING nova.compute.manager [req-d3b93201-936c-4e9e-98dd-5a0a3e857c92 req-853982f1-d19c-46dd-a974-cb683c5297bb service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Received unexpected event network-vif-plugged-65ab9470-0aab-47c5-88ee-bddd58e7d035 for instance with vm_state building and task_state spawning.
Aug 17 18:28:04 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:28:04 user nova-compute[72874]: INFO nova.compute.manager [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Took 5.86 seconds to spawn the instance on the hypervisor.
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:04 user nova-compute[72874]: INFO nova.compute.manager [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Took 7.20 seconds to build instance.
Aug 17 18:28:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cc4990eb-b003-41f9-834d-68967dca95f0 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.337s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "2515d301-f1ff-42bd-b067-61713baf519a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "2515d301-f1ff-42bd-b067-61713baf519a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:28:05 user nova-compute[72874]: INFO nova.compute.claims [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Claim successful on node user
Aug 17 18:28:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:28:05 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:28:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG nova.policy [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37eba99d36a842ca93af2d82be67dea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d44ed4bf46e4f6bb8d9f9255bfceded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:28:05 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Creating image(s)
Aug 17 18:28:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "/opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "/opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "/opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.191s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk 1073741824" returned: 0 in 0.069s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.207s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Successfully created port: 8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Cannot resize image /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG nova.objects.instance [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'migration_context' on Instance uuid 2515d301-f1ff-42bd-b067-61713baf519a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Ensure instance console log exists: /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:07 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Successfully updated port: 8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:28:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "refresh_cache-2515d301-f1ff-42bd-b067-61713baf519a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:28:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquired lock "refresh_cache-2515d301-f1ff-42bd-b067-61713baf519a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:28:07 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:28:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-fbae0224-fe02-499a-a0c1-fe6a27b4dadf req-36458b61-1854-49a8-a2b1-822d7beb9ecd service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received event network-changed-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-fbae0224-fe02-499a-a0c1-fe6a27b4dadf req-36458b61-1854-49a8-a2b1-822d7beb9ecd service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Refreshing instance network info cache due to event network-changed-8e92b898-61f1-4540-9618-69298f5be3c4. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:28:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fbae0224-fe02-499a-a0c1-fe6a27b4dadf req-36458b61-1854-49a8-a2b1-822d7beb9ecd service nova] Acquiring lock "refresh_cache-2515d301-f1ff-42bd-b067-61713baf519a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:28:07 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Updating instance_info_cache with network_info: [{"id": "8e92b898-61f1-4540-9618-69298f5be3c4", "address": "fa:16:3e:ad:d2:11", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e92b898-61", "ovs_interfaceid": "8e92b898-61f1-4540-9618-69298f5be3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Releasing lock "refresh_cache-2515d301-f1ff-42bd-b067-61713baf519a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Instance network_info: |[{"id": "8e92b898-61f1-4540-9618-69298f5be3c4", "address": "fa:16:3e:ad:d2:11", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e92b898-61", "ovs_interfaceid": "8e92b898-61f1-4540-9618-69298f5be3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fbae0224-fe02-499a-a0c1-fe6a27b4dadf req-36458b61-1854-49a8-a2b1-822d7beb9ecd service nova] Acquired lock "refresh_cache-2515d301-f1ff-42bd-b067-61713baf519a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.network.neutron [req-fbae0224-fe02-499a-a0c1-fe6a27b4dadf req-36458b61-1854-49a8-a2b1-822d7beb9ecd service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Refreshing network info cache for port 8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Start _get_guest_xml network_info=[{"id": "8e92b898-61f1-4540-9618-69298f5be3c4", "address": "fa:16:3e:ad:d2:11", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e92b898-61", "ovs_interfaceid": "8e92b898-61f1-4540-9618-69298f5be3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:28:08 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:28:08 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1268676760',display_name='tempest-AttachVolumeNegativeTest-server-1268676760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1268676760',id=26,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnHHesLvGXMM12XjUp6dTNI8uc0y80uB2Io6RJgJtIXssgJf50GCfnH9f39zgnIQcH5v19Dj9RL9cBYcFbw/bjScbSnmM+8xjIb+AMxrCJ6u+XxvUCojU3ZVPKAZEBNxA==',key_name='tempest-keypair-2054860192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d44ed4bf46e4f6bb8d9f9255bfceded',ramdisk_id='',reservation_id='r-v7hnemkc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1092460488',owner_user_name='tempest-AttachVolumeNegativeTest-1092460488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:28:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eba99d36a842ca93af2d82be67dea1',uuid=2515d301-f1ff-42bd-b067-61713baf519a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e92b898-61f1-4540-9618-69298f5be3c4", "address": "fa:16:3e:ad:d2:11", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e92b898-61", "ovs_interfaceid": "8e92b898-61f1-4540-9618-69298f5be3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converting VIF {"id": "8e92b898-61f1-4540-9618-69298f5be3c4", "address": "fa:16:3e:ad:d2:11", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e92b898-61", "ovs_interfaceid": "8e92b898-61f1-4540-9618-69298f5be3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d2:11,bridge_name='br-int',has_traffic_filtering=True,id=8e92b898-61f1-4540-9618-69298f5be3c4,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e92b898-61') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.objects.instance [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'pci_devices' on Instance uuid 2515d301-f1ff-42bd-b067-61713baf519a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:28:08 user nova-compute[72874]:   <uuid>2515d301-f1ff-42bd-b067-61713baf519a</uuid>
Aug 17 18:28:08 user nova-compute[72874]:   <name>instance-0000001a</name>
Aug 17 18:28:08 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:28:08 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:28:08 user nova-compute[72874]:   <metadata>
Aug 17 18:28:08 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:28:08 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:28:08 user nova-compute[72874]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1268676760</nova:name>
Aug 17 18:28:08 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:28:08</nova:creationTime>
Aug 17 18:28:08 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:28:08 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:28:08 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:28:08 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:28:08 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:28:08 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:28:08 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:28:08 user nova-compute[72874]:       <nova:owner>
Aug 17 18:28:08 user nova-compute[72874]:         <nova:user uuid="37eba99d36a842ca93af2d82be67dea1">tempest-AttachVolumeNegativeTest-1092460488-project-member</nova:user>
Aug 17 18:28:08 user nova-compute[72874]:         <nova:project uuid="9d44ed4bf46e4f6bb8d9f9255bfceded">tempest-AttachVolumeNegativeTest-1092460488</nova:project>
Aug 17 18:28:08 user nova-compute[72874]:       </nova:owner>
Aug 17 18:28:08 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:28:08 user nova-compute[72874]:       <nova:ports>
Aug 17 18:28:08 user nova-compute[72874]:         <nova:port uuid="8e92b898-61f1-4540-9618-69298f5be3c4">
Aug 17 18:28:08 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 18:28:08 user nova-compute[72874]:         </nova:port>
Aug 17 18:28:08 user nova-compute[72874]:       </nova:ports>
Aug 17 18:28:08 user nova-compute[72874]:     </nova:instance>
Aug 17 18:28:08 user nova-compute[72874]:   </metadata>
Aug 17 18:28:08 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:28:08 user nova-compute[72874]:     <system>
Aug 17 18:28:08 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:28:08 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:28:08 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:28:08 user nova-compute[72874]:       <entry name="serial">2515d301-f1ff-42bd-b067-61713baf519a</entry>
Aug 17 18:28:08 user nova-compute[72874]:       <entry name="uuid">2515d301-f1ff-42bd-b067-61713baf519a</entry>
Aug 17 18:28:08 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:28:08 user nova-compute[72874]:     </system>
Aug 17 18:28:08 user nova-compute[72874]:   </sysinfo>
Aug 17 18:28:08 user nova-compute[72874]:   <os>
Aug 17 18:28:08 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:28:08 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:28:08 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:28:08 user nova-compute[72874]:   </os>
Aug 17 18:28:08 user nova-compute[72874]:   <features>
Aug 17 18:28:08 user nova-compute[72874]:     <acpi/>
Aug 17 18:28:08 user nova-compute[72874]:     <apic/>
Aug 17 18:28:08 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:28:08 user nova-compute[72874]:   </features>
Aug 17 18:28:08 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:28:08 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:28:08 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:28:08 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:28:08 user nova-compute[72874]:   </clock>
Aug 17 18:28:08 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:28:08 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:28:08 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:28:08 user nova-compute[72874]:   </cpu>
Aug 17 18:28:08 user nova-compute[72874]:   <devices>
Aug 17 18:28:08 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:28:08 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:28:08 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk"/>
Aug 17 18:28:08 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:28:08 user nova-compute[72874]:     </disk>
Aug 17 18:28:08 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:28:08 user nova-compute[72874]:       <mac address="fa:16:3e:ad:d2:11"/>
Aug 17 18:28:08 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:28:08 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:28:08 user nova-compute[72874]:       <target dev="tap8e92b898-61"/>
Aug 17 18:28:08 user nova-compute[72874]:     </interface>
Aug 17 18:28:08 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:28:08 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/console.log" append="off"/>
Aug 17 18:28:08 user nova-compute[72874]:     </serial>
Aug 17 18:28:08 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:28:08 user nova-compute[72874]:     <video>
Aug 17 18:28:08 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:28:08 user nova-compute[72874]:     </video>
Aug 17 18:28:08 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:28:08 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:28:08 user nova-compute[72874]:     </rng>
Aug 17 18:28:08 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:28:08 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:28:08 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:28:08 user nova-compute[72874]:     </memballoon>
Aug 17 18:28:08 user nova-compute[72874]:   </devices>
Aug 17 18:28:08 user nova-compute[72874]: </domain>
Aug 17 18:28:08 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1268676760',display_name='tempest-AttachVolumeNegativeTest-server-1268676760',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1268676760',id=26,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnHHesLvGXMM12XjUp6dTNI8uc0y80uB2Io6RJgJtIXssgJf50GCfnH9f39zgnIQcH5v19Dj9RL9cBYcFbw/bjScbSnmM+8xjIb+AMxrCJ6u+XxvUCojU3ZVPKAZEBNxA==',key_name='tempest-keypair-2054860192',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d44ed4bf46e4f6bb8d9f9255bfceded',ramdisk_id='',reservation_id='r-v7hnemkc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1092460488',owner_user_name='tempest-AttachVolumeNegativeTest-1092460488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:28:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eba99d36a842ca93af2d82be67dea1',uuid=2515d301-f1ff-42bd-b067-61713baf519a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e92b898-61f1-4540-9618-69298f5be3c4", "address": "fa:16:3e:ad:d2:11", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e92b898-61", "ovs_interfaceid": "8e92b898-61f1-4540-9618-69298f5be3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converting VIF {"id": "8e92b898-61f1-4540-9618-69298f5be3c4", "address": "fa:16:3e:ad:d2:11", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e92b898-61", "ovs_interfaceid": "8e92b898-61f1-4540-9618-69298f5be3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d2:11,bridge_name='br-int',has_traffic_filtering=True,id=8e92b898-61f1-4540-9618-69298f5be3c4,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e92b898-61') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG os_vif [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d2:11,bridge_name='br-int',has_traffic_filtering=True,id=8e92b898-61f1-4540-9618-69298f5be3c4,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e92b898-61') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e92b898-61, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8e92b898-61, col_values=(('external_ids', {'iface-id': '8e92b898-61f1-4540-9618-69298f5be3c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:d2:11', 'vm-uuid': '2515d301-f1ff-42bd-b067-61713baf519a'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:08 user nova-compute[72874]: INFO os_vif [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:d2:11,bridge_name='br-int',has_traffic_filtering=True,id=8e92b898-61f1-4540-9618-69298f5be3c4,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e92b898-61')
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] No VIF found with MAC fa:16:3e:ad:d2:11, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.network.neutron [req-fbae0224-fe02-499a-a0c1-fe6a27b4dadf req-36458b61-1854-49a8-a2b1-822d7beb9ecd service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Updated VIF entry in instance network info cache for port 8e92b898-61f1-4540-9618-69298f5be3c4. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG nova.network.neutron [req-fbae0224-fe02-499a-a0c1-fe6a27b4dadf req-36458b61-1854-49a8-a2b1-822d7beb9ecd service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Updating instance_info_cache with network_info: [{"id": "8e92b898-61f1-4540-9618-69298f5be3c4", "address": "fa:16:3e:ad:d2:11", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e92b898-61", "ovs_interfaceid": "8e92b898-61f1-4540-9618-69298f5be3c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:28:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fbae0224-fe02-499a-a0c1-fe6a27b4dadf req-36458b61-1854-49a8-a2b1-822d7beb9ecd service nova] Releasing lock "refresh_cache-2515d301-f1ff-42bd-b067-61713baf519a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:28:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-bd3e2de8-21eb-4a8a-9abe-3a7411af35c9 req-9b0a2cf3-d812-488a-a7ce-61d192b061b0 service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received event network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bd3e2de8-21eb-4a8a-9abe-3a7411af35c9 req-9b0a2cf3-d812-488a-a7ce-61d192b061b0 service nova] Acquiring lock "2515d301-f1ff-42bd-b067-61713baf519a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bd3e2de8-21eb-4a8a-9abe-3a7411af35c9 req-9b0a2cf3-d812-488a-a7ce-61d192b061b0 service nova] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bd3e2de8-21eb-4a8a-9abe-3a7411af35c9 req-9b0a2cf3-d812-488a-a7ce-61d192b061b0 service nova] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-bd3e2de8-21eb-4a8a-9abe-3a7411af35c9 req-9b0a2cf3-d812-488a-a7ce-61d192b061b0 service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] No waiting events found dispatching network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:10 user nova-compute[72874]: WARNING nova.compute.manager [req-bd3e2de8-21eb-4a8a-9abe-3a7411af35c9 req-9b0a2cf3-d812-488a-a7ce-61d192b061b0 service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received unexpected event network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 for instance with vm_state building and task_state spawning.
Aug 17 18:28:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-3445a635-97b6-46c7-93d5-83a7fff2d734 req-a8863e85-c247-4f04-81f7-8496e6ace973 service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received event network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3445a635-97b6-46c7-93d5-83a7fff2d734 req-a8863e85-c247-4f04-81f7-8496e6ace973 service nova] Acquiring lock "2515d301-f1ff-42bd-b067-61713baf519a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3445a635-97b6-46c7-93d5-83a7fff2d734 req-a8863e85-c247-4f04-81f7-8496e6ace973 service nova] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3445a635-97b6-46c7-93d5-83a7fff2d734 req-a8863e85-c247-4f04-81f7-8496e6ace973 service nova] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-3445a635-97b6-46c7-93d5-83a7fff2d734 req-a8863e85-c247-4f04-81f7-8496e6ace973 service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] No waiting events found dispatching network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:12 user nova-compute[72874]: WARNING nova.compute.manager [req-3445a635-97b6-46c7-93d5-83a7fff2d734 req-a8863e85-c247-4f04-81f7-8496e6ace973 service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received unexpected event network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 for instance with vm_state building and task_state spawning.
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296892.521528, 2515d301-f1ff-42bd-b067-61713baf519a => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:28:12 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] VM Resumed (Lifecycle Event)
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:28:12 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Instance spawned successfully.
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:12 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296892.523279, 2515d301-f1ff-42bd-b067-61713baf519a => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:28:12 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] VM Started (Lifecycle Event)
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:28:12 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:28:12 user nova-compute[72874]: INFO nova.compute.manager [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Took 6.90 seconds to spawn the instance on the hypervisor.
Aug 17 18:28:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:12 user nova-compute[72874]: INFO nova.compute.manager [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Took 7.64 seconds to build instance.
Aug 17 18:28:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2b524726-01da-421f-9c22-f580f9236900 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "2515d301-f1ff-42bd-b067-61713baf519a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.772s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:15 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:28:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:15 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:28:15 user nova-compute[72874]: INFO nova.compute.claims [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Claim successful on node user
Aug 17 18:28:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:15 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:28:15 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:28:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:15 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:28:15 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:28:15 user nova-compute[72874]: DEBUG nova.network.neutron [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:28:15 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:28:15 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:28:15 user nova-compute[72874]: INFO nova.virt.block_device [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Booting with volume 02a3029d-0c4b-4212-b644-c28603954db9 at /dev/vda
Aug 17 18:28:15 user nova-compute[72874]: DEBUG nova.policy [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aaaa47a37543427eaa1712d29c419dd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4aa04d3ed68a4542b32e2efeca25222a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG os_brick.utils [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3145ca68-2ae7-470d-a744-bf687438a099]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd0b484-39f2-4e37-9a6b-fe820c3b71ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdfd87f-3bca-49e6-bea9-ec526b534a18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea04ed2-ec65-456f-91b5-77b1dd9a7c31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:28:16 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3565049-7371-4db0-9d44-bbc7d0836d0f]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG os_brick.utils [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Updating existing volume attachment record: c8342d1f-d9f8-46fa-87c7-ee0e9c5be17b {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG nova.network.neutron [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Successfully created port: 5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:16 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG nova.network.neutron [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Successfully updated port: 5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquired lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG nova.network.neutron [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG nova.compute.manager [req-e4baadfe-f6e7-4091-8318-0b9eb040cef4 req-81690346-ce27-4b6c-ad09-8598a2864f3e service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received event network-changed-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG nova.compute.manager [req-e4baadfe-f6e7-4091-8318-0b9eb040cef4 req-81690346-ce27-4b6c-ad09-8598a2864f3e service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Refreshing instance network info cache due to event network-changed-5ccb2518-ba24-4885-a6c1-fd247bb0482c. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e4baadfe-f6e7-4091-8318-0b9eb040cef4 req-81690346-ce27-4b6c-ad09-8598a2864f3e service nova] Acquiring lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG nova.network.neutron [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG nova.network.neutron [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Updating instance_info_cache with network_info: [{"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Releasing lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Instance network_info: |[{"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e4baadfe-f6e7-4091-8318-0b9eb040cef4 req-81690346-ce27-4b6c-ad09-8598a2864f3e service nova] Acquired lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG nova.network.neutron [req-e4baadfe-f6e7-4091-8318-0b9eb040cef4 req-81690346-ce27-4b6c-ad09-8598a2864f3e service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Refreshing network info cache for port 5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG nova.network.neutron [req-e4baadfe-f6e7-4091-8318-0b9eb040cef4 req-81690346-ce27-4b6c-ad09-8598a2864f3e service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Updated VIF entry in instance network info cache for port 5ccb2518-ba24-4885-a6c1-fd247bb0482c. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG nova.network.neutron [req-e4baadfe-f6e7-4091-8318-0b9eb040cef4 req-81690346-ce27-4b6c-ad09-8598a2864f3e service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Updating instance_info_cache with network_info: [{"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:28:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e4baadfe-f6e7-4091-8318-0b9eb040cef4 req-81690346-ce27-4b6c-ad09-8598a2864f3e service nova] Releasing lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:28:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:28:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:21 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:28:21 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:28:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7567MB free_disk=25.223052978515625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 7044ab36-115d-454b-a787-b3199a815d4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2ace97e1-c2ee-462e-a929-22c7cb2584d2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 62dd0b51-1320-4529-907b-f632f96b48dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance cf9f3116-5e42-4858-a391-ab75d2046f1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance ce433d26-f10d-4d06-a0a2-96ae9bde4dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2515d301-f1ff-42bd-b067-61713baf519a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance f5760c65-a9c0-4997-8db3-04c1b4095ac5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:28:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:28:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:28:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:28:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Didn't find any instances for network info cache update. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 18:28:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:28:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:28:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:28:23 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:28:23 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:28:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:24 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:28:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:26 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:28:26 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:28:28 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Creating image(s)
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Ensure instance console log exists: /opt/stack/data/nova/instances/f5760c65-a9c0-4997-8db3-04c1b4095ac5/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Start _get_guest_xml network_info=[{"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXlYknCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f5760c65-a9c0-4997-8db3-04c1b4095ac5', 'attached_at': '', 'detached_at': '', 'volume_id': '02a3029d-0c4b-4212-b644-c28603954db9', 'serial': '02a3029d-0c4b-4212-b644-c28603954db9'}, 'delete_on_termination': True, 'attachment_id': 'c8342d1f-d9f8-46fa-87c7-ee0e9c5be17b', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:28:28 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:28:28 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXlYknCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:28:28 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:28:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:28:28 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:28:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:28:28 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[10158400-53ec-4faf-823e-ad0bbf3b5e0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:28:28 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d804e12-cf87-4fce-b93a-38bf4f79004e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9] added
Aug 17 18:28:28 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8384f642-7631-4ea4-a2af-c8a502973325]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1065fa1e-7527-4033-aa15-b8b38730b1b9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXlYknCb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXlYknCb" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df3d6e6-357f-423c-b66f-594488c31745]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vXlYknCb'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae4a34f-0dd1-4c42-a23a-022bbeae06f5]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5c9f1f-f1a9-4d74-9655-c3184f815569]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:28:28 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:28:28 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:28:28 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:28:28 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:28:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4092eaf4-dbbc-41ee-b326-8ba76d1ae9ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9, portal: 172.16.0.220,3260]
Aug 17 18:28:29 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9, portal: 172.16.0.220,3260] successful.
Aug 17 18:28:29 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1508fdf6-392e-4ffb-98e8-2668b2bb0fbb]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf66ee06-f4ed-451b-bc0a-cd733b2015d9]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:28:29 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:28:29 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:28:29 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:28:29 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:28:29 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:28:29 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1590fd0e-7fc5-41ad-b343-39513f1bfdcc]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXlYknCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:28:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23166643664353939', 'path': '/dev/sdc'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166643664353939', 'path': '/dev/sdc'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-557325771',display_name='tempest-ServerActionsTestOtherA-server-557325771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-557325771',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFP6ue+/z3wt8xhCWBOe29hsvUkf+UOWUkfgnV2VGRCWOmbw8F+9gEiC1B84s9ElkFdDnqMgWD7dJiORZ3oQy2cYRrKsSD3Z6YMcgGnOy3TRveU5TvjItrEcSVSb9w9jg==',key_name='tempest-keypair-1711897531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4aa04d3ed68a4542b32e2efeca25222a',ramdisk_id='',reservation_id='r-z37qv7n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1332351935',owner_user_name='tempest-ServerActionsTestOtherA-1332351935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:28:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaaa47a37543427eaa1712d29c419dd9',uuid=f5760c65-a9c0-4997-8db3-04c1b4095ac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converting VIF {"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:73:e1,bridge_name='br-int',has_traffic_filtering=True,id=5ccb2518-ba24-4885-a6c1-fd247bb0482c,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccb2518-ba') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG nova.objects.instance [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'pci_devices' on Instance uuid f5760c65-a9c0-4997-8db3-04c1b4095ac5 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:28:30 user nova-compute[72874]:   <uuid>f5760c65-a9c0-4997-8db3-04c1b4095ac5</uuid>
Aug 17 18:28:30 user nova-compute[72874]:   <name>instance-0000001b</name>
Aug 17 18:28:30 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:28:30 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:28:30 user nova-compute[72874]:   <metadata>
Aug 17 18:28:30 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:28:30 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:28:30 user nova-compute[72874]:       <nova:name>tempest-ServerActionsTestOtherA-server-557325771</nova:name>
Aug 17 18:28:30 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:28:28</nova:creationTime>
Aug 17 18:28:30 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:28:30 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:28:30 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:28:30 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:28:30 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:28:30 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:28:30 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:28:30 user nova-compute[72874]:       <nova:owner>
Aug 17 18:28:30 user nova-compute[72874]:         <nova:user uuid="aaaa47a37543427eaa1712d29c419dd9">tempest-ServerActionsTestOtherA-1332351935-project-member</nova:user>
Aug 17 18:28:30 user nova-compute[72874]:         <nova:project uuid="4aa04d3ed68a4542b32e2efeca25222a">tempest-ServerActionsTestOtherA-1332351935</nova:project>
Aug 17 18:28:30 user nova-compute[72874]:       </nova:owner>
Aug 17 18:28:30 user nova-compute[72874]:       <nova:ports>
Aug 17 18:28:30 user nova-compute[72874]:         <nova:port uuid="5ccb2518-ba24-4885-a6c1-fd247bb0482c">
Aug 17 18:28:30 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 18:28:30 user nova-compute[72874]:         </nova:port>
Aug 17 18:28:30 user nova-compute[72874]:       </nova:ports>
Aug 17 18:28:30 user nova-compute[72874]:     </nova:instance>
Aug 17 18:28:30 user nova-compute[72874]:   </metadata>
Aug 17 18:28:30 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:28:30 user nova-compute[72874]:     <system>
Aug 17 18:28:30 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:28:30 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:28:30 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:28:30 user nova-compute[72874]:       <entry name="serial">f5760c65-a9c0-4997-8db3-04c1b4095ac5</entry>
Aug 17 18:28:30 user nova-compute[72874]:       <entry name="uuid">f5760c65-a9c0-4997-8db3-04c1b4095ac5</entry>
Aug 17 18:28:30 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:28:30 user nova-compute[72874]:     </system>
Aug 17 18:28:30 user nova-compute[72874]:   </sysinfo>
Aug 17 18:28:30 user nova-compute[72874]:   <os>
Aug 17 18:28:30 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:28:30 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:28:30 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:28:30 user nova-compute[72874]:   </os>
Aug 17 18:28:30 user nova-compute[72874]:   <features>
Aug 17 18:28:30 user nova-compute[72874]:     <acpi/>
Aug 17 18:28:30 user nova-compute[72874]:     <apic/>
Aug 17 18:28:30 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:28:30 user nova-compute[72874]:   </features>
Aug 17 18:28:30 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:28:30 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:28:30 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:28:30 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:28:30 user nova-compute[72874]:   </clock>
Aug 17 18:28:30 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:28:30 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:28:30 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:28:30 user nova-compute[72874]:   </cpu>
Aug 17 18:28:30 user nova-compute[72874]:   <devices>
Aug 17 18:28:30 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:28:30 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:28:30 user nova-compute[72874]:       <source dev="/dev/sdc"/>
Aug 17 18:28:30 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:28:30 user nova-compute[72874]:       <serial>02a3029d-0c4b-4212-b644-c28603954db9</serial>
Aug 17 18:28:30 user nova-compute[72874]:     </disk>
Aug 17 18:28:30 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:28:30 user nova-compute[72874]:       <mac address="fa:16:3e:ed:73:e1"/>
Aug 17 18:28:30 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:28:30 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:28:30 user nova-compute[72874]:       <target dev="tap5ccb2518-ba"/>
Aug 17 18:28:30 user nova-compute[72874]:     </interface>
Aug 17 18:28:30 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:28:30 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/f5760c65-a9c0-4997-8db3-04c1b4095ac5/console.log" append="off"/>
Aug 17 18:28:30 user nova-compute[72874]:     </serial>
Aug 17 18:28:30 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:28:30 user nova-compute[72874]:     <video>
Aug 17 18:28:30 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:28:30 user nova-compute[72874]:     </video>
Aug 17 18:28:30 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:28:30 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:28:30 user nova-compute[72874]:     </rng>
Aug 17 18:28:30 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:28:30 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:28:30 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:28:30 user nova-compute[72874]:     </memballoon>
Aug 17 18:28:30 user nova-compute[72874]:   </devices>
Aug 17 18:28:30 user nova-compute[72874]: </domain>
Aug 17 18:28:30 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-557325771',display_name='tempest-ServerActionsTestOtherA-server-557325771',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-557325771',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFP6ue+/z3wt8xhCWBOe29hsvUkf+UOWUkfgnV2VGRCWOmbw8F+9gEiC1B84s9ElkFdDnqMgWD7dJiORZ3oQy2cYRrKsSD3Z6YMcgGnOy3TRveU5TvjItrEcSVSb9w9jg==',key_name='tempest-keypair-1711897531',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4aa04d3ed68a4542b32e2efeca25222a',ramdisk_id='',reservation_id='r-z37qv7n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1332351935',owner_user_name='tempest-ServerActionsTestOtherA-1332351935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:28:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaaa47a37543427eaa1712d29c419dd9',uuid=f5760c65-a9c0-4997-8db3-04c1b4095ac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converting VIF {"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:73:e1,bridge_name='br-int',has_traffic_filtering=True,id=5ccb2518-ba24-4885-a6c1-fd247bb0482c,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccb2518-ba') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG os_vif [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:73:e1,bridge_name='br-int',has_traffic_filtering=True,id=5ccb2518-ba24-4885-a6c1-fd247bb0482c,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccb2518-ba') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ccb2518-ba, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ccb2518-ba, col_values=(('external_ids', {'iface-id': '5ccb2518-ba24-4885-a6c1-fd247bb0482c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:73:e1', 'vm-uuid': 'f5760c65-a9c0-4997-8db3-04c1b4095ac5'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:30 user nova-compute[72874]: INFO os_vif [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:73:e1,bridge_name='br-int',has_traffic_filtering=True,id=5ccb2518-ba24-4885-a6c1-fd247bb0482c,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccb2518-ba')
Aug 17 18:28:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] No VIF found with MAC fa:16:3e:ed:73:e1, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:28:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:31 user nova-compute[72874]: DEBUG nova.compute.manager [req-b91dfb9f-146a-4448-970e-1acfcfeaa568 req-aa4b24ff-29aa-45c8-bd97-48efa12ec747 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received event network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b91dfb9f-146a-4448-970e-1acfcfeaa568 req-aa4b24ff-29aa-45c8-bd97-48efa12ec747 service nova] Acquiring lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b91dfb9f-146a-4448-970e-1acfcfeaa568 req-aa4b24ff-29aa-45c8-bd97-48efa12ec747 service nova] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b91dfb9f-146a-4448-970e-1acfcfeaa568 req-aa4b24ff-29aa-45c8-bd97-48efa12ec747 service nova] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:31 user nova-compute[72874]: DEBUG nova.compute.manager [req-b91dfb9f-146a-4448-970e-1acfcfeaa568 req-aa4b24ff-29aa-45c8-bd97-48efa12ec747 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] No waiting events found dispatching network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:31 user nova-compute[72874]: WARNING nova.compute.manager [req-b91dfb9f-146a-4448-970e-1acfcfeaa568 req-aa4b24ff-29aa-45c8-bd97-48efa12ec747 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received unexpected event network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c for instance with vm_state building and task_state spawning.
Aug 17 18:28:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-48d61c52-2b0a-42c5-b897-9049879c20ea req-ab0219d7-93a7-4392-8cbf-d8b907526bd6 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received event network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-48d61c52-2b0a-42c5-b897-9049879c20ea req-ab0219d7-93a7-4392-8cbf-d8b907526bd6 service nova] Acquiring lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-48d61c52-2b0a-42c5-b897-9049879c20ea req-ab0219d7-93a7-4392-8cbf-d8b907526bd6 service nova] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-48d61c52-2b0a-42c5-b897-9049879c20ea req-ab0219d7-93a7-4392-8cbf-d8b907526bd6 service nova] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-48d61c52-2b0a-42c5-b897-9049879c20ea req-ab0219d7-93a7-4392-8cbf-d8b907526bd6 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] No waiting events found dispatching network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:33 user nova-compute[72874]: WARNING nova.compute.manager [req-48d61c52-2b0a-42c5-b897-9049879c20ea req-ab0219d7-93a7-4392-8cbf-d8b907526bd6 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received unexpected event network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c for instance with vm_state building and task_state spawning.
Aug 17 18:28:34 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296914.0064328, f5760c65-a9c0-4997-8db3-04c1b4095ac5 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:28:34 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] VM Resumed (Lifecycle Event)
Aug 17 18:28:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:28:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:28:34 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Instance spawned successfully.
Aug 17 18:28:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:28:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:28:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:34 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:28:34 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296914.0105004, f5760c65-a9c0-4997-8db3-04c1b4095ac5 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:28:34 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] VM Started (Lifecycle Event)
Aug 17 18:28:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:28:34 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:28:34 user nova-compute[72874]: INFO nova.compute.manager [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Took 5.46 seconds to spawn the instance on the hypervisor.
Aug 17 18:28:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:34 user nova-compute[72874]: INFO nova.compute.manager [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Took 19.17 seconds to build instance.
Aug 17 18:28:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4b8a6798-eac5-4ec2-8c7c-6ffa5e9cd654 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.321s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:40 user nova-compute[72874]: INFO nova.compute.manager [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Terminating instance
Aug 17 18:28:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:28:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG nova.compute.manager [req-50a4f7e5-1d2a-4351-85c3-adb394ddaced req-561f4947-f7b1-495b-984a-bfed8349725f service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received event network-vif-unplugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-50a4f7e5-1d2a-4351-85c3-adb394ddaced req-561f4947-f7b1-495b-984a-bfed8349725f service nova] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-50a4f7e5-1d2a-4351-85c3-adb394ddaced req-561f4947-f7b1-495b-984a-bfed8349725f service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-50a4f7e5-1d2a-4351-85c3-adb394ddaced req-561f4947-f7b1-495b-984a-bfed8349725f service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG nova.compute.manager [req-50a4f7e5-1d2a-4351-85c3-adb394ddaced req-561f4947-f7b1-495b-984a-bfed8349725f service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] No waiting events found dispatching network-vif-unplugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG nova.compute.manager [req-50a4f7e5-1d2a-4351-85c3-adb394ddaced req-561f4947-f7b1-495b-984a-bfed8349725f service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received event network-vif-unplugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:28:41 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Instance destroyed successfully.
Aug 17 18:28:41 user nova-compute[72874]: DEBUG nova.objects.instance [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lazy-loading 'resources' on Instance uuid 2ace97e1-c2ee-462e-a929-22c7cb2584d2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1594135899',display_name='tempest-ServerActionsTestOtherB-server-1594135899',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1594135899',id=13,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJL0wGDO9yYxM59zaPj86jL9bZvPsFDy3YJOsbSwVi+3h9+DinmjEtIZue1FvAOYIc54lSepvgAxdfqkbFKLJ90/SAHzFU18VdJmA0Lh/YqOsAztJ9gMRfqGTMWDprprBA==',key_name='tempest-keypair-1720427808',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:26:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ad9005fd344e470482b0b90baeb97515',ramdisk_id='',reservation_id='r-5cqpdw10',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1909498304',owner_user_name='tempest-ServerActionsTestOtherB-1909498304-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:26:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='31f7828a072847dc9cb4d4fd51908366',uuid=2ace97e1-c2ee-462e-a929-22c7cb2584d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converting VIF {"id": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "address": "fa:16:3e:80:58:cc", "network": {"id": "640cab55-3c9f-4f49-b2ab-4a2f30fe6964", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2007432489-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ad9005fd344e470482b0b90baeb97515", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6319754-2b", "ovs_interfaceid": "d6319754-2bba-45a4-9db3-9fcf99c0c33c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG os_vif [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6319754-2b, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:28:41 user nova-compute[72874]: INFO os_vif [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:58:cc,bridge_name='br-int',has_traffic_filtering=True,id=d6319754-2bba-45a4-9db3-9fcf99c0c33c,network=Network(640cab55-3c9f-4f49-b2ab-4a2f30fe6964),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6319754-2b')
Aug 17 18:28:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DJCicowN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:28:41 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:28:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10a82e1-1124-4ef2-9c02-d2321043e195]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b81fe0b-2478-4c21-be9d-646e661d9fc3]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:28:41 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:28:41 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:28:41 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:28:41 user nova-compute[72874]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 (non-flash)
Aug 17 18:28:41 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:28:41 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c06715a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913'): ({'sdd'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Removing single pathed devices sdd {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f775fa-e270-4f53-b13b-5cbc0eeda495]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a582b91d-2b62-4f0f-9158-d8baa221bffe]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Flushing IO for device /dev/sdd {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49d0be5-1750-4d2c-a4f0-66dde37b1e13]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.061s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a209057-0abd-4dad-91d8-919b806908a8]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:42 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc0889a-6168-4d2e-a621-7a619d93d182]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:42 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:28:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:42 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1356f2bf-f634-4c9d-a07d-53fd6f425bb7]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:42 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260]
Aug 17 18:28:42 user nova-compute[72874]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913, portal: 172.16.0.220,3260] successful.
Aug 17 18:28:42 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:28:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19c92b6f-990a-4e2a-97df-5bb870e61913 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:42 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9be04ec-d5a8-49ff-906f-467c280f5254]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:28:42 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:28:42 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:28:42 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] <== disconnect_volume: return (386ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:28:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:28:42 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Deleting instance files /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2_del
Aug 17 18:28:42 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Deletion of /opt/stack/data/nova/instances/2ace97e1-c2ee-462e-a929-22c7cb2584d2_del complete
Aug 17 18:28:42 user nova-compute[72874]: INFO nova.compute.manager [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Took 1.37 seconds to destroy the instance on the hypervisor.
Aug 17 18:28:42 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:28:42 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:28:42 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:28:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-8849573c-3105-4005-b15d-b99ad7169caf req-e1125821-e1ef-4a4a-ba00-fd43110f7924 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8849573c-3105-4005-b15d-b99ad7169caf req-e1125821-e1ef-4a4a-ba00-fd43110f7924 service nova] Acquiring lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8849573c-3105-4005-b15d-b99ad7169caf req-e1125821-e1ef-4a4a-ba00-fd43110f7924 service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8849573c-3105-4005-b15d-b99ad7169caf req-e1125821-e1ef-4a4a-ba00-fd43110f7924 service nova] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-8849573c-3105-4005-b15d-b99ad7169caf req-e1125821-e1ef-4a4a-ba00-fd43110f7924 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] No waiting events found dispatching network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:43 user nova-compute[72874]: WARNING nova.compute.manager [req-8849573c-3105-4005-b15d-b99ad7169caf req-e1125821-e1ef-4a4a-ba00-fd43110f7924 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received unexpected event network-vif-plugged-d6319754-2bba-45a4-9db3-9fcf99c0c33c for instance with vm_state active and task_state deleting.
Aug 17 18:28:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "7044ab36-115d-454b-a787-b3199a815d4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "7044ab36-115d-454b-a787-b3199a815d4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "7044ab36-115d-454b-a787-b3199a815d4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "7044ab36-115d-454b-a787-b3199a815d4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "7044ab36-115d-454b-a787-b3199a815d4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:43 user nova-compute[72874]: INFO nova.compute.manager [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Terminating instance
Aug 17 18:28:43 user nova-compute[72874]: DEBUG nova.compute.manager [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:28:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:44 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:28:44 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Took 2.05 seconds to deallocate network for instance.
Aug 17 18:28:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-4ec9d45e-ab49-4a8c-be54-c41f3f96ae5e req-13afabdf-3987-4b4a-bcba-790fd935bef5 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Received event network-vif-deleted-d6319754-2bba-45a4-9db3-9fcf99c0c33c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:44 user nova-compute[72874]: INFO nova.compute.manager [req-4ec9d45e-ab49-4a8c-be54-c41f3f96ae5e req-13afabdf-3987-4b4a-bcba-790fd935bef5 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Neutron deleted interface d6319754-2bba-45a4-9db3-9fcf99c0c33c; detaching it from the instance and deleting it from the info cache
Aug 17 18:28:44 user nova-compute[72874]: DEBUG nova.network.neutron [req-4ec9d45e-ab49-4a8c-be54-c41f3f96ae5e req-13afabdf-3987-4b4a-bcba-790fd935bef5 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:28:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-4ec9d45e-ab49-4a8c-be54-c41f3f96ae5e req-13afabdf-3987-4b4a-bcba-790fd935bef5 service nova] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Detach interface failed, port_id=d6319754-2bba-45a4-9db3-9fcf99c0c33c, reason: Instance 2ace97e1-c2ee-462e-a929-22c7cb2584d2 could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:28:44 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Instance destroyed successfully.
Aug 17 18:28:44 user nova-compute[72874]: DEBUG nova.objects.instance [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lazy-loading 'resources' on Instance uuid 7044ab36-115d-454b-a787-b3199a815d4e {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:28:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:23:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1393165526',display_name='tempest-TestMinimumBasicScenario-server-1393165526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1393165526',id=19,image_ref='61db7187-9851-4469-83f6-e39a4e544055',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOW3GIoziXYjj2lk4gqitkMchmuo16RuJkN8+50HTf9poMcymF9ysUVFLkF+/fBftEiqELbyd25ohsRktPfhXRsaCAyz83dIVGDhOdBWBrdtsKxEC4QaVkPbr3WzkkztqQ==',key_name='tempest-TestMinimumBasicScenario-285091982',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:23:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a608a48fc27947bcbbc84e5c078cea4c',ramdisk_id='',reservation_id='r-kjrmrs2s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='61db7187-9851-4469-83f6-e39a4e544055',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1549406810',owner_user_name='tempest-TestMinimumBasicScenario-1549406810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:23:33Z,user_data=None,user_id='576a655170bb4dc3b1c45cb9bbfe5ae7',uuid=7044ab36-115d-454b-a787-b3199a815d4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "address": "fa:16:3e:03:c0:3f", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51bbddc6-88", "ovs_interfaceid": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:28:44 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Converting VIF {"id": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "address": "fa:16:3e:03:c0:3f", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51bbddc6-88", "ovs_interfaceid": "51bbddc6-885b-4d2e-a436-a08f1ee3a204", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:28:44 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:c0:3f,bridge_name='br-int',has_traffic_filtering=True,id=51bbddc6-885b-4d2e-a436-a08f1ee3a204,network=Network(6badf08e-0db0-44c7-a8e8-1825dc05ee9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51bbddc6-88') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:28:44 user nova-compute[72874]: DEBUG os_vif [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:c0:3f,bridge_name='br-int',has_traffic_filtering=True,id=51bbddc6-885b-4d2e-a436-a08f1ee3a204,network=Network(6badf08e-0db0-44c7-a8e8-1825dc05ee9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51bbddc6-88') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:28:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51bbddc6-88, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:44 user nova-compute[72874]: INFO os_vif [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:c0:3f,bridge_name='br-int',has_traffic_filtering=True,id=51bbddc6-885b-4d2e-a436-a08f1ee3a204,network=Network(6badf08e-0db0-44c7-a8e8-1825dc05ee9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51bbddc6-88')
Aug 17 18:28:44 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Deleting instance files /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e_del
Aug 17 18:28:44 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Deletion of /opt/stack/data/nova/instances/7044ab36-115d-454b-a787-b3199a815d4e_del complete
Aug 17 18:28:44 user nova-compute[72874]: INFO nova.compute.manager [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 17 18:28:44 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:28:44 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:28:44 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:28:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:45 user nova-compute[72874]: INFO nova.compute.manager [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Took 1.09 seconds to detach 1 volumes for instance.
Aug 17 18:28:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-eb1adf2e-b666-4ee1-a7a2-194772993fe2 req-73a7c63f-05d5-4e69-9018-14e2e791eb15 service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Received event network-vif-unplugged-51bbddc6-885b-4d2e-a436-a08f1ee3a204 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eb1adf2e-b666-4ee1-a7a2-194772993fe2 req-73a7c63f-05d5-4e69-9018-14e2e791eb15 service nova] Acquiring lock "7044ab36-115d-454b-a787-b3199a815d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eb1adf2e-b666-4ee1-a7a2-194772993fe2 req-73a7c63f-05d5-4e69-9018-14e2e791eb15 service nova] Lock "7044ab36-115d-454b-a787-b3199a815d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eb1adf2e-b666-4ee1-a7a2-194772993fe2 req-73a7c63f-05d5-4e69-9018-14e2e791eb15 service nova] Lock "7044ab36-115d-454b-a787-b3199a815d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-eb1adf2e-b666-4ee1-a7a2-194772993fe2 req-73a7c63f-05d5-4e69-9018-14e2e791eb15 service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] No waiting events found dispatching network-vif-unplugged-51bbddc6-885b-4d2e-a436-a08f1ee3a204 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-eb1adf2e-b666-4ee1-a7a2-194772993fe2 req-73a7c63f-05d5-4e69-9018-14e2e791eb15 service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Received event network-vif-unplugged-51bbddc6-885b-4d2e-a436-a08f1ee3a204 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-eb1adf2e-b666-4ee1-a7a2-194772993fe2 req-73a7c63f-05d5-4e69-9018-14e2e791eb15 service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Received event network-vif-plugged-51bbddc6-885b-4d2e-a436-a08f1ee3a204 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eb1adf2e-b666-4ee1-a7a2-194772993fe2 req-73a7c63f-05d5-4e69-9018-14e2e791eb15 service nova] Acquiring lock "7044ab36-115d-454b-a787-b3199a815d4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eb1adf2e-b666-4ee1-a7a2-194772993fe2 req-73a7c63f-05d5-4e69-9018-14e2e791eb15 service nova] Lock "7044ab36-115d-454b-a787-b3199a815d4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eb1adf2e-b666-4ee1-a7a2-194772993fe2 req-73a7c63f-05d5-4e69-9018-14e2e791eb15 service nova] Lock "7044ab36-115d-454b-a787-b3199a815d4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-eb1adf2e-b666-4ee1-a7a2-194772993fe2 req-73a7c63f-05d5-4e69-9018-14e2e791eb15 service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] No waiting events found dispatching network-vif-plugged-51bbddc6-885b-4d2e-a436-a08f1ee3a204 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:45 user nova-compute[72874]: WARNING nova.compute.manager [req-eb1adf2e-b666-4ee1-a7a2-194772993fe2 req-73a7c63f-05d5-4e69-9018-14e2e791eb15 service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Received unexpected event network-vif-plugged-51bbddc6-885b-4d2e-a436-a08f1ee3a204 for instance with vm_state active and task_state deleting.
Aug 17 18:28:45 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:28:45 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Took 1.01 seconds to deallocate network for instance.
Aug 17 18:28:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:45 user nova-compute[72874]: INFO nova.compute.manager [None req-a3d609e1-d20b-4f11-bde6-05ce78af99bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Unrescuing
Aug 17 18:28:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a3d609e1-d20b-4f11-bde6-05ce78af99bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a3d609e1-d20b-4f11-bde6-05ce78af99bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquired lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG nova.network.neutron [None req-a3d609e1-d20b-4f11-bde6-05ce78af99bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.292s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:45 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Deleted allocations for instance 2ace97e1-c2ee-462e-a929-22c7cb2584d2
Aug 17 18:28:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f59a722e-1081-4ece-9963-ceba60f47668 tempest-ServerActionsTestOtherB-1909498304 tempest-ServerActionsTestOtherB-1909498304-project-member] Lock "2ace97e1-c2ee-462e-a929-22c7cb2584d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.189s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:46 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:28:46 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:28:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:46 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Deleted allocations for instance 7044ab36-115d-454b-a787-b3199a815d4e
Aug 17 18:28:46 user nova-compute[72874]: DEBUG nova.network.neutron [None req-a3d609e1-d20b-4f11-bde6-05ce78af99bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Updating instance_info_cache with network_info: [{"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:28:46 user nova-compute[72874]: DEBUG nova.compute.manager [req-e26a695c-9067-4a56-a7e3-2dd5b4da67a9 req-38fcfba0-5f3d-4d57-9b41-e721fccd9108 service nova] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Received event network-vif-deleted-51bbddc6-885b-4d2e-a436-a08f1ee3a204 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-a3d609e1-d20b-4f11-bde6-05ce78af99bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Releasing lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:28:46 user nova-compute[72874]: DEBUG nova.objects.instance [None req-a3d609e1-d20b-4f11-bde6-05ce78af99bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'flavor' on Instance uuid 2961b0b8-98d0-4ba5-a0fa-b719753589ea {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:28:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-147256b9-a2a3-4a58-9396-024f05350576 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "7044ab36-115d-454b-a787-b3199a815d4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.058s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "b41da216-4183-404f-8896-58371c3ae61d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:28:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:46 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:28:46 user nova-compute[72874]: INFO nova.compute.claims [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Claim successful on node user
Aug 17 18:28:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG nova.network.neutron [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:28:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:28:47 user nova-compute[72874]: INFO nova.compute.claims [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Claim successful on node user
Aug 17 18:28:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG nova.policy [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3143ae598e814e359466d90e74f9b00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6287735c21fb4b43b3cbd9e0d742b0ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:28:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Instance destroyed successfully.
Aug 17 18:28:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:28:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Creating image(s)
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "/opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "/opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "/opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.211s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.568s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.223s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG nova.network.neutron [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk 1073741824" returned: 0 in 0.071s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:48 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:28:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG nova.policy [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3143ae598e814e359466d90e74f9b00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6287735c21fb4b43b3cbd9e0d742b0ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG nova.network.neutron [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Successfully created port: e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:28:48 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Creating image(s)
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "/opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "/opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.238s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.209s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Cannot resize image /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG nova.objects.instance [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'migration_context' on Instance uuid b41da216-4183-404f-8896-58371c3ae61d {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Ensure instance console log exists: /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk 1073741824" returned: 0 in 0.067s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.193s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:28:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Cannot resize image /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG nova.objects.instance [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'migration_context' on Instance uuid 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Ensure instance console log exists: /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG nova.network.neutron [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Successfully created port: 14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG nova.network.neutron [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Successfully updated port: e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquired lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG nova.network.neutron [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-94b15ad7-1629-4ac8-be58-e5aeb0b65661 req-a09a61d2-8c12-4431-b4c0-513d9918de48 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-changed-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-94b15ad7-1629-4ac8-be58-e5aeb0b65661 req-a09a61d2-8c12-4431-b4c0-513d9918de48 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Refreshing instance network info cache due to event network-changed-e30432ac-cf52-4ce4-a10a-70700297a63e. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-94b15ad7-1629-4ac8-be58-e5aeb0b65661 req-a09a61d2-8c12-4431-b4c0-513d9918de48 service nova] Acquiring lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:28:49 user nova-compute[72874]: DEBUG nova.network.neutron [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.network.neutron [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Updating instance_info_cache with network_info: [{"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Releasing lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Instance network_info: |[{"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-94b15ad7-1629-4ac8-be58-e5aeb0b65661 req-a09a61d2-8c12-4431-b4c0-513d9918de48 service nova] Acquired lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.network.neutron [req-94b15ad7-1629-4ac8-be58-e5aeb0b65661 req-a09a61d2-8c12-4431-b4c0-513d9918de48 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Refreshing network info cache for port e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Start _get_guest_xml network_info=[{"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:28:50 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:28:50 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-674035551',display_name='tempest-ServerRescueNegativeTestJSON-server-674035551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-674035551',id=28,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6287735c21fb4b43b3cbd9e0d742b0ec',ramdisk_id='',reservation_id='r-5o49sjrl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-717723449',owner_user_name='tempest-ServerRescueNegativeTestJSON-717723449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:28:47Z,user_data=None,user_id='3143ae598e814e359466d90e74f9b00c',uuid=b41da216-4183-404f-8896-58371c3ae61d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converting VIF {"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:cd:aa,bridge_name='br-int',has_traffic_filtering=True,id=e30432ac-cf52-4ce4-a10a-70700297a63e,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30432ac-cf') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.objects.instance [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'pci_devices' on Instance uuid b41da216-4183-404f-8896-58371c3ae61d {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:28:50 user nova-compute[72874]:   <uuid>b41da216-4183-404f-8896-58371c3ae61d</uuid>
Aug 17 18:28:50 user nova-compute[72874]:   <name>instance-0000001c</name>
Aug 17 18:28:50 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:28:50 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:28:50 user nova-compute[72874]:   <metadata>
Aug 17 18:28:50 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:28:50 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:28:50 user nova-compute[72874]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-674035551</nova:name>
Aug 17 18:28:50 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:28:50</nova:creationTime>
Aug 17 18:28:50 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:28:50 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:28:50 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:28:50 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:28:50 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:28:50 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:28:50 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:28:50 user nova-compute[72874]:       <nova:owner>
Aug 17 18:28:50 user nova-compute[72874]:         <nova:user uuid="3143ae598e814e359466d90e74f9b00c">tempest-ServerRescueNegativeTestJSON-717723449-project-member</nova:user>
Aug 17 18:28:50 user nova-compute[72874]:         <nova:project uuid="6287735c21fb4b43b3cbd9e0d742b0ec">tempest-ServerRescueNegativeTestJSON-717723449</nova:project>
Aug 17 18:28:50 user nova-compute[72874]:       </nova:owner>
Aug 17 18:28:50 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:28:50 user nova-compute[72874]:       <nova:ports>
Aug 17 18:28:50 user nova-compute[72874]:         <nova:port uuid="e30432ac-cf52-4ce4-a10a-70700297a63e">
Aug 17 18:28:50 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 18:28:50 user nova-compute[72874]:         </nova:port>
Aug 17 18:28:50 user nova-compute[72874]:       </nova:ports>
Aug 17 18:28:50 user nova-compute[72874]:     </nova:instance>
Aug 17 18:28:50 user nova-compute[72874]:   </metadata>
Aug 17 18:28:50 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:28:50 user nova-compute[72874]:     <system>
Aug 17 18:28:50 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:28:50 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:28:50 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:28:50 user nova-compute[72874]:       <entry name="serial">b41da216-4183-404f-8896-58371c3ae61d</entry>
Aug 17 18:28:50 user nova-compute[72874]:       <entry name="uuid">b41da216-4183-404f-8896-58371c3ae61d</entry>
Aug 17 18:28:50 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:28:50 user nova-compute[72874]:     </system>
Aug 17 18:28:50 user nova-compute[72874]:   </sysinfo>
Aug 17 18:28:50 user nova-compute[72874]:   <os>
Aug 17 18:28:50 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:28:50 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:28:50 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:28:50 user nova-compute[72874]:   </os>
Aug 17 18:28:50 user nova-compute[72874]:   <features>
Aug 17 18:28:50 user nova-compute[72874]:     <acpi/>
Aug 17 18:28:50 user nova-compute[72874]:     <apic/>
Aug 17 18:28:50 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:28:50 user nova-compute[72874]:   </features>
Aug 17 18:28:50 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:28:50 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:28:50 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:28:50 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:28:50 user nova-compute[72874]:   </clock>
Aug 17 18:28:50 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:28:50 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:28:50 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:28:50 user nova-compute[72874]:   </cpu>
Aug 17 18:28:50 user nova-compute[72874]:   <devices>
Aug 17 18:28:50 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:28:50 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:28:50 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk"/>
Aug 17 18:28:50 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:28:50 user nova-compute[72874]:     </disk>
Aug 17 18:28:50 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:28:50 user nova-compute[72874]:       <mac address="fa:16:3e:cd:cd:aa"/>
Aug 17 18:28:50 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:28:50 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:28:50 user nova-compute[72874]:       <target dev="tape30432ac-cf"/>
Aug 17 18:28:50 user nova-compute[72874]:     </interface>
Aug 17 18:28:50 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:28:50 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/console.log" append="off"/>
Aug 17 18:28:50 user nova-compute[72874]:     </serial>
Aug 17 18:28:50 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:28:50 user nova-compute[72874]:     <video>
Aug 17 18:28:50 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:28:50 user nova-compute[72874]:     </video>
Aug 17 18:28:50 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:28:50 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:28:50 user nova-compute[72874]:     </rng>
Aug 17 18:28:50 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:28:50 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:28:50 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:28:50 user nova-compute[72874]:     </memballoon>
Aug 17 18:28:50 user nova-compute[72874]:   </devices>
Aug 17 18:28:50 user nova-compute[72874]: </domain>
Aug 17 18:28:50 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-674035551',display_name='tempest-ServerRescueNegativeTestJSON-server-674035551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-674035551',id=28,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6287735c21fb4b43b3cbd9e0d742b0ec',ramdisk_id='',reservation_id='r-5o49sjrl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-717723449',owner_user_name='tempest-ServerRescueNegativeTestJSON-717723449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:28:47Z,user_data=None,user_id='3143ae598e814e359466d90e74f9b00c',uuid=b41da216-4183-404f-8896-58371c3ae61d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converting VIF {"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:cd:aa,bridge_name='br-int',has_traffic_filtering=True,id=e30432ac-cf52-4ce4-a10a-70700297a63e,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30432ac-cf') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG os_vif [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:cd:aa,bridge_name='br-int',has_traffic_filtering=True,id=e30432ac-cf52-4ce4-a10a-70700297a63e,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30432ac-cf') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape30432ac-cf, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape30432ac-cf, col_values=(('external_ids', {'iface-id': 'e30432ac-cf52-4ce4-a10a-70700297a63e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:cd:aa', 'vm-uuid': 'b41da216-4183-404f-8896-58371c3ae61d'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:50 user nova-compute[72874]: INFO os_vif [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:cd:aa,bridge_name='br-int',has_traffic_filtering=True,id=e30432ac-cf52-4ce4-a10a-70700297a63e,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30432ac-cf')
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No VIF found with MAC fa:16:3e:cd:cd:aa, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Removed pending event for 2961b0b8-98d0-4ba5-a0fa-b719753589ea due to event {{(pid=72874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296930.9397578, 2961b0b8-98d0-4ba5-a0fa-b719753589ea => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:28:50 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] VM Resumed (Lifecycle Event)
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-a3d609e1-d20b-4f11-bde6-05ce78af99bd tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:28:51 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296930.9420397, 2961b0b8-98d0-4ba5-a0fa-b719753589ea => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:28:51 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] VM Started (Lifecycle Event)
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Successfully updated port: 14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquired lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.network.neutron [req-94b15ad7-1629-4ac8-be58-e5aeb0b65661 req-a09a61d2-8c12-4431-b4c0-513d9918de48 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Updated VIF entry in instance network info cache for port e30432ac-cf52-4ce4-a10a-70700297a63e. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.network.neutron [req-94b15ad7-1629-4ac8-be58-e5aeb0b65661 req-a09a61d2-8c12-4431-b4c0-513d9918de48 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Updating instance_info_cache with network_info: [{"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-94b15ad7-1629-4ac8-be58-e5aeb0b65661 req-a09a61d2-8c12-4431-b4c0-513d9918de48 service nova] Releasing lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Updating instance_info_cache with network_info: [{"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Releasing lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Instance network_info: |[{"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Start _get_guest_xml network_info=[{"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:28:51 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:28:51 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1766440334',display_name='tempest-ServerRescueNegativeTestJSON-server-1766440334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1766440334',id=29,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6287735c21fb4b43b3cbd9e0d742b0ec',ramdisk_id='',reservation_id='r-a00wc4ez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-717723449',owner_user_name='tempest-ServerRescueNegativeTestJSON-717723449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:28:48Z,user_data=None,user_id='3143ae598e814e359466d90e74f9b00c',uuid=8c589f00-c893-4ff7-86f3-7f7ebd7b17b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converting VIF {"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:11:cf,bridge_name='br-int',has_traffic_filtering=True,id=14186d03-6c85-4205-8aba-5a2dae028e7a,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14186d03-6c') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.objects.instance [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:28:51 user nova-compute[72874]:   <uuid>8c589f00-c893-4ff7-86f3-7f7ebd7b17b2</uuid>
Aug 17 18:28:51 user nova-compute[72874]:   <name>instance-0000001d</name>
Aug 17 18:28:51 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:28:51 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:28:51 user nova-compute[72874]:   <metadata>
Aug 17 18:28:51 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:28:51 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:28:51 user nova-compute[72874]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1766440334</nova:name>
Aug 17 18:28:51 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:28:51</nova:creationTime>
Aug 17 18:28:51 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:28:51 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:28:51 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:28:51 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:28:51 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:28:51 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:28:51 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:28:51 user nova-compute[72874]:       <nova:owner>
Aug 17 18:28:51 user nova-compute[72874]:         <nova:user uuid="3143ae598e814e359466d90e74f9b00c">tempest-ServerRescueNegativeTestJSON-717723449-project-member</nova:user>
Aug 17 18:28:51 user nova-compute[72874]:         <nova:project uuid="6287735c21fb4b43b3cbd9e0d742b0ec">tempest-ServerRescueNegativeTestJSON-717723449</nova:project>
Aug 17 18:28:51 user nova-compute[72874]:       </nova:owner>
Aug 17 18:28:51 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:28:51 user nova-compute[72874]:       <nova:ports>
Aug 17 18:28:51 user nova-compute[72874]:         <nova:port uuid="14186d03-6c85-4205-8aba-5a2dae028e7a">
Aug 17 18:28:51 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 18:28:51 user nova-compute[72874]:         </nova:port>
Aug 17 18:28:51 user nova-compute[72874]:       </nova:ports>
Aug 17 18:28:51 user nova-compute[72874]:     </nova:instance>
Aug 17 18:28:51 user nova-compute[72874]:   </metadata>
Aug 17 18:28:51 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:28:51 user nova-compute[72874]:     <system>
Aug 17 18:28:51 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:28:51 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:28:51 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:28:51 user nova-compute[72874]:       <entry name="serial">8c589f00-c893-4ff7-86f3-7f7ebd7b17b2</entry>
Aug 17 18:28:51 user nova-compute[72874]:       <entry name="uuid">8c589f00-c893-4ff7-86f3-7f7ebd7b17b2</entry>
Aug 17 18:28:51 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:28:51 user nova-compute[72874]:     </system>
Aug 17 18:28:51 user nova-compute[72874]:   </sysinfo>
Aug 17 18:28:51 user nova-compute[72874]:   <os>
Aug 17 18:28:51 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:28:51 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:28:51 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:28:51 user nova-compute[72874]:   </os>
Aug 17 18:28:51 user nova-compute[72874]:   <features>
Aug 17 18:28:51 user nova-compute[72874]:     <acpi/>
Aug 17 18:28:51 user nova-compute[72874]:     <apic/>
Aug 17 18:28:51 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:28:51 user nova-compute[72874]:   </features>
Aug 17 18:28:51 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:28:51 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:28:51 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:28:51 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:28:51 user nova-compute[72874]:   </clock>
Aug 17 18:28:51 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:28:51 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:28:51 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:28:51 user nova-compute[72874]:   </cpu>
Aug 17 18:28:51 user nova-compute[72874]:   <devices>
Aug 17 18:28:51 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:28:51 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:28:51 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk"/>
Aug 17 18:28:51 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:28:51 user nova-compute[72874]:     </disk>
Aug 17 18:28:51 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:28:51 user nova-compute[72874]:       <mac address="fa:16:3e:1f:11:cf"/>
Aug 17 18:28:51 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:28:51 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:28:51 user nova-compute[72874]:       <target dev="tap14186d03-6c"/>
Aug 17 18:28:51 user nova-compute[72874]:     </interface>
Aug 17 18:28:51 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:28:51 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/console.log" append="off"/>
Aug 17 18:28:51 user nova-compute[72874]:     </serial>
Aug 17 18:28:51 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:28:51 user nova-compute[72874]:     <video>
Aug 17 18:28:51 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:28:51 user nova-compute[72874]:     </video>
Aug 17 18:28:51 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:28:51 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:28:51 user nova-compute[72874]:     </rng>
Aug 17 18:28:51 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:28:51 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:28:51 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:28:51 user nova-compute[72874]:     </memballoon>
Aug 17 18:28:51 user nova-compute[72874]:   </devices>
Aug 17 18:28:51 user nova-compute[72874]: </domain>
Aug 17 18:28:51 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1766440334',display_name='tempest-ServerRescueNegativeTestJSON-server-1766440334',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1766440334',id=29,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6287735c21fb4b43b3cbd9e0d742b0ec',ramdisk_id='',reservation_id='r-a00wc4ez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-717723449',owner_user_name='tempest-ServerRescueNegativeTestJSON-717723449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:28:48Z,user_data=None,user_id='3143ae598e814e359466d90e74f9b00c',uuid=8c589f00-c893-4ff7-86f3-7f7ebd7b17b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converting VIF {"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:11:cf,bridge_name='br-int',has_traffic_filtering=True,id=14186d03-6c85-4205-8aba-5a2dae028e7a,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14186d03-6c') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG os_vif [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:11:cf,bridge_name='br-int',has_traffic_filtering=True,id=14186d03-6c85-4205-8aba-5a2dae028e7a,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14186d03-6c') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.compute.manager [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received event network-vif-unplugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] Acquiring lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.compute.manager [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] No waiting events found dispatching network-vif-unplugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:51 user nova-compute[72874]: WARNING nova.compute.manager [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received unexpected event network-vif-unplugged-2d5c5445-861c-412b-8929-030ec72e68fb for instance with vm_state active and task_state None.
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.compute.manager [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received event network-changed-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.compute.manager [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Refreshing instance network info cache due to event network-changed-14186d03-6c85-4205-8aba-5a2dae028e7a. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] Acquiring lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] Acquired lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.network.neutron [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Refreshing network info cache for port 14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap14186d03-6c, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap14186d03-6c, col_values=(('external_ids', {'iface-id': '14186d03-6c85-4205-8aba-5a2dae028e7a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:11:cf', 'vm-uuid': '8c589f00-c893-4ff7-86f3-7f7ebd7b17b2'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:51 user nova-compute[72874]: INFO os_vif [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:11:cf,bridge_name='br-int',has_traffic_filtering=True,id=14186d03-6c85-4205-8aba-5a2dae028e7a,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14186d03-6c')
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:28:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No VIF found with MAC fa:16:3e:1f:11:cf, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-7cb6e1f3-2116-43d4-8115-1484e38f8e10 req-324152fc-f593-4a82-aa52-623766ae7a37 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7cb6e1f3-2116-43d4-8115-1484e38f8e10 req-324152fc-f593-4a82-aa52-623766ae7a37 service nova] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7cb6e1f3-2116-43d4-8115-1484e38f8e10 req-324152fc-f593-4a82-aa52-623766ae7a37 service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7cb6e1f3-2116-43d4-8115-1484e38f8e10 req-324152fc-f593-4a82-aa52-623766ae7a37 service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-7cb6e1f3-2116-43d4-8115-1484e38f8e10 req-324152fc-f593-4a82-aa52-623766ae7a37 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] No waiting events found dispatching network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:52 user nova-compute[72874]: WARNING nova.compute.manager [req-7cb6e1f3-2116-43d4-8115-1484e38f8e10 req-324152fc-f593-4a82-aa52-623766ae7a37 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received unexpected event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e for instance with vm_state building and task_state spawning.
Aug 17 18:28:52 user nova-compute[72874]: DEBUG nova.network.neutron [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Updated VIF entry in instance network info cache for port 14186d03-6c85-4205-8aba-5a2dae028e7a. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG nova.network.neutron [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Updating instance_info_cache with network_info: [{"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] Releasing lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] Acquiring lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] No waiting events found dispatching network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:52 user nova-compute[72874]: WARNING nova.compute.manager [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received unexpected event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb for instance with vm_state active and task_state None.
Aug 17 18:28:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] Acquiring lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] No waiting events found dispatching network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:52 user nova-compute[72874]: WARNING nova.compute.manager [req-80f936c6-b92a-4ce7-b31d-d405f35ccd70 req-76e1a029-74ef-4084-b71c-6aaa0d2670aa service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received unexpected event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb for instance with vm_state active and task_state None.
Aug 17 18:28:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-17815568-144e-4b67-85c0-dcdb00d6c804 req-2fcc968c-dbb2-4d6a-a77d-3b255fa49c16 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-17815568-144e-4b67-85c0-dcdb00d6c804 req-2fcc968c-dbb2-4d6a-a77d-3b255fa49c16 service nova] Acquiring lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-17815568-144e-4b67-85c0-dcdb00d6c804 req-2fcc968c-dbb2-4d6a-a77d-3b255fa49c16 service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-17815568-144e-4b67-85c0-dcdb00d6c804 req-2fcc968c-dbb2-4d6a-a77d-3b255fa49c16 service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-17815568-144e-4b67-85c0-dcdb00d6c804 req-2fcc968c-dbb2-4d6a-a77d-3b255fa49c16 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] No waiting events found dispatching network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:53 user nova-compute[72874]: WARNING nova.compute.manager [req-17815568-144e-4b67-85c0-dcdb00d6c804 req-2fcc968c-dbb2-4d6a-a77d-3b255fa49c16 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received unexpected event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb for instance with vm_state active and task_state None.
Aug 17 18:28:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] No waiting events found dispatching network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:54 user nova-compute[72874]: WARNING nova.compute.manager [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received unexpected event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e for instance with vm_state building and task_state spawning.
Aug 17 18:28:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received event network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] Acquiring lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] No waiting events found dispatching network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:54 user nova-compute[72874]: WARNING nova.compute.manager [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received unexpected event network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a for instance with vm_state building and task_state spawning.
Aug 17 18:28:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received event network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:28:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] Acquiring lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:28:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:28:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] No waiting events found dispatching network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:28:54 user nova-compute[72874]: WARNING nova.compute.manager [req-25a0d0f8-a57d-4b3a-8471-3f8a311e2b26 req-d05d1284-09c8-48d7-89c6-9d5f13bc2eee service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received unexpected event network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a for instance with vm_state building and task_state spawning.
Aug 17 18:28:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296935.4955397, b41da216-4183-404f-8896-58371c3ae61d => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:28:55 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] VM Resumed (Lifecycle Event)
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:28:55 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: b41da216-4183-404f-8896-58371c3ae61d] Instance spawned successfully.
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:55 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296935.497327, b41da216-4183-404f-8896-58371c3ae61d => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:28:55 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] VM Started (Lifecycle Event)
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:28:55 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:28:55 user nova-compute[72874]: INFO nova.compute.manager [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Took 8.17 seconds to spawn the instance on the hypervisor.
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:55 user nova-compute[72874]: INFO nova.compute.manager [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Took 9.00 seconds to build instance.
Aug 17 18:28:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-68e4ea87-601b-4c70-b906-7e2979875fe3 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "b41da216-4183-404f-8896-58371c3ae61d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.089s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296935.8689413, 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:28:55 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] VM Resumed (Lifecycle Event)
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:28:55 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Instance spawned successfully.
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:28:55 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296935.871931, 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:28:55 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] VM Started (Lifecycle Event)
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:28:55 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:28:56 user nova-compute[72874]: INFO nova.compute.manager [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Took 7.84 seconds to spawn the instance on the hypervisor.
Aug 17 18:28:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:56 user nova-compute[72874]: INFO nova.compute.manager [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Took 8.82 seconds to build instance.
Aug 17 18:28:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-29f91bb8-2d3d-4d1c-9e2b-98505e8c8b24 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.924s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:28:56 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296921.6541636, 2ace97e1-c2ee-462e-a929-22c7cb2584d2 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:28:56 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] VM Stopped (Lifecycle Event)
Aug 17 18:28:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e3ef2455-7249-4b66-9038-2d49782c9736 None None] [instance: 2ace97e1-c2ee-462e-a929-22c7cb2584d2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:28:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:28:59 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296924.3359993, 7044ab36-115d-454b-a787-b3199a815d4e => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:28:59 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] VM Stopped (Lifecycle Event)
Aug 17 18:28:59 user nova-compute[72874]: DEBUG nova.compute.manager [None req-f64cafe9-7a66-4049-99ac-120d67288801 None None] [instance: 7044ab36-115d-454b-a787-b3199a815d4e] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:29:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-84293566-76c8-4af6-9789-72b3fe469d2a req-f106479f-e436-4d54-8da2-5b6894f0e9f9 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Received event network-changed-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:29:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-84293566-76c8-4af6-9789-72b3fe469d2a req-f106479f-e436-4d54-8da2-5b6894f0e9f9 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Refreshing instance network info cache due to event network-changed-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:29:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-84293566-76c8-4af6-9789-72b3fe469d2a req-f106479f-e436-4d54-8da2-5b6894f0e9f9 service nova] Acquiring lock "refresh_cache-62dd0b51-1320-4529-907b-f632f96b48dc" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:29:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-84293566-76c8-4af6-9789-72b3fe469d2a req-f106479f-e436-4d54-8da2-5b6894f0e9f9 service nova] Acquired lock "refresh_cache-62dd0b51-1320-4529-907b-f632f96b48dc" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:29:07 user nova-compute[72874]: DEBUG nova.network.neutron [req-84293566-76c8-4af6-9789-72b3fe469d2a req-f106479f-e436-4d54-8da2-5b6894f0e9f9 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Refreshing network info cache for port 4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:29:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "62dd0b51-1320-4529-907b-f632f96b48dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "62dd0b51-1320-4529-907b-f632f96b48dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:07 user nova-compute[72874]: DEBUG nova.objects.instance [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lazy-loading 'flavor' on Instance uuid 62dd0b51-1320-4529-907b-f632f96b48dc {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:29:07 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Ignoring supplied device name: /dev/vdb
Aug 17 18:29:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "62dd0b51-1320-4529-907b-f632f96b48dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "62dd0b51-1320-4529-907b-f632f96b48dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "62dd0b51-1320-4529-907b-f632f96b48dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:08 user nova-compute[72874]: INFO nova.compute.manager [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Attaching volume dd4610a7-b7e1-4d53-924e-bf48852f9092 to /dev/vdb
Aug 17 18:29:08 user nova-compute[72874]: DEBUG os_brick.utils [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[542ee5f8-4c1e-493c-9df0-449f101bbeb3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6be0685-2c6d-4fb0-acc1-a81577db1caf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f117570d-f3ee-44f7-a99e-22821d87f849]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0187a6-524e-4af9-9fe2-cb8a1bdfa9e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:29:08 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6426090e-2df1-4b41-8ac2-79595a794683]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG os_brick.utils [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Updating existing volume attachment record: 97b93f85-9549-4b70-85f2-bd1019c3d721 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG nova.network.neutron [req-84293566-76c8-4af6-9789-72b3fe469d2a req-f106479f-e436-4d54-8da2-5b6894f0e9f9 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Updated VIF entry in instance network info cache for port 4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG nova.network.neutron [req-84293566-76c8-4af6-9789-72b3fe469d2a req-f106479f-e436-4d54-8da2-5b6894f0e9f9 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Updating instance_info_cache with network_info: [{"id": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "address": "fa:16:3e:91:29:02", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ef4e9-5d", "ovs_interfaceid": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:29:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-84293566-76c8-4af6-9789-72b3fe469d2a req-f106479f-e436-4d54-8da2-5b6894f0e9f9 service nova] Releasing lock "refresh_cache-62dd0b51-1320-4529-907b-f632f96b48dc" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:29:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:17 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:29:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:17 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:29:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:17 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:29:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:29:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AwsbLNJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:29:19 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:29:19 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:29:19 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[807d354d-e22d-4bd5-b0ae-401c58750a26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:29:19 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ab7bb5-a954-40e2-8cc5-c8ac4d69af9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092] added
Aug 17 18:29:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[581fa326-96ab-4aed-ae74-77b4f3c40ba9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3166eb-f0d8-463d-9423-7d45317ea0db]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AwsbLNJp {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AwsbLNJp" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b8d366-68e4-4660-aa33-9f7b88c8317e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AwsbLNJp'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e96b39-8a24-4fce-add1-da6e1770e42f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[818b06ed-5acc-4f3e-b67e-4882e774bbce]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:29:19 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:29:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:29:19 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:29:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf02465-885e-4904-92cd-bf2fc3dad54e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092, portal: 172.16.0.220,3260]
Aug 17 18:29:19 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092, portal: 172.16.0.220,3260] successful.
Aug 17 18:29:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27c307e-35fe-4c24-88d3-6ead8ce1768e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c6030b-c937-4119-9cba-a561fd8d1124]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:29:19 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:29:19 user nova-compute[72874]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 (non-flash)
Aug 17 18:29:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:29:19 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:29:19 user nova-compute[72874]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 (non-flash)
Aug 17 18:29:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[08897dc7-e672-4670-adee-e9bc1df357ff]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AwsbLNJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.686s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] <== connect_volume: return (1688ms) {'type': 'block', 'scsi_wwn': '23534653135323638', 'path': '/dev/sdd'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534653135323638', 'path': '/dev/sdd'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:29:21 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:29:21 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7227MB free_disk=25.157073974609375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.objects.instance [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lazy-loading 'flavor' on Instance uuid 62dd0b51-1320-4529-907b-f632f96b48dc {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:29:21 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:29:21 user nova-compute[72874]:   <source dev="/dev/sdd"/>
Aug 17 18:29:21 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:29:21 user nova-compute[72874]:   <serial>dd4610a7-b7e1-4d53-924e-bf48852f9092</serial>
Aug 17 18:29:21 user nova-compute[72874]: </disk>
Aug 17 18:29:21 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 62dd0b51-1320-4529-907b-f632f96b48dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance cf9f3116-5e42-4858-a391-ab75d2046f1a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance ce433d26-f10d-4d06-a0a2-96ae9bde4dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2515d301-f1ff-42bd-b067-61713baf519a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance f5760c65-a9c0-4997-8db3-04c1b4095ac5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.439s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] No VIF found with MAC fa:16:3e:91:29:02, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-aa9d6d2d-257f-42c7-883c-21073b30e8ac tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "62dd0b51-1320-4529-907b-f632f96b48dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.568s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:23 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:29:23 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:29:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:29:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:29:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:29:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:29:23 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:29:23 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid b143e572-9116-4dc0-8fc3-ba586b290ddd {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Updating instance_info_cache with network_info: [{"id": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "address": "fa:16:3e:3a:30:bb", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17265426-d5", "ovs_interfaceid": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "cf9f3116-5e42-4858-a391-ab75d2046f1a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:24 user nova-compute[72874]: INFO nova.compute.manager [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Terminating instance
Aug 17 18:29:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-4f5b2998-3158-4709-b068-ed3d617c9394 req-ac9bde74-b427-46a7-9b59-420603b14aa4 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received event network-vif-unplugged-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4f5b2998-3158-4709-b068-ed3d617c9394 req-ac9bde74-b427-46a7-9b59-420603b14aa4 service nova] Acquiring lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4f5b2998-3158-4709-b068-ed3d617c9394 req-ac9bde74-b427-46a7-9b59-420603b14aa4 service nova] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4f5b2998-3158-4709-b068-ed3d617c9394 req-ac9bde74-b427-46a7-9b59-420603b14aa4 service nova] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-4f5b2998-3158-4709-b068-ed3d617c9394 req-ac9bde74-b427-46a7-9b59-420603b14aa4 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] No waiting events found dispatching network-vif-unplugged-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:29:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-4f5b2998-3158-4709-b068-ed3d617c9394 req-ac9bde74-b427-46a7-9b59-420603b14aa4 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received event network-vif-unplugged-dbb991ed-781f-4666-a0b6-c360ab742952 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:29:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:29:25 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Instance destroyed successfully.
Aug 17 18:29:25 user nova-compute[72874]: DEBUG nova.objects.instance [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lazy-loading 'resources' on Instance uuid cf9f3116-5e42-4858-a391-ab75d2046f1a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:29:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T18:23:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-256691474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-256691474',id=21,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNRZJI30JvBIOo78Nc4E/vQZ4222PUz6M4VnJyBsVc8RG8pkgZHWCI+wS7Li89ZXnfRpzACIFODv16pw4feyE8jOEDhaILAHNfE95Q4vLeIyPLALwu/lIVovS9PV5DR+JQ==',key_name='tempest-keypair-1928119168',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:27:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c20349a873f4ec7a0f72a7d64c636e4',ramdisk_id='',reservation_id='r-ju6xb3sz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1376162523',owner_user_name='tempest-AttachVolumeShelveTestJSON-1376162523-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:27:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b47defaba840e1ba8f91603d99caac',uuid=cf9f3116-5e42-4858-a391-ab75d2046f1a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:29:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converting VIF {"id": "dbb991ed-781f-4666-a0b6-c360ab742952", "address": "fa:16:3e:ac:cd:60", "network": {"id": "f926ad48-dfc8-48a6-8c36-c8abe9b5b982", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1198482073-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c20349a873f4ec7a0f72a7d64c636e4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb991ed-78", "ovs_interfaceid": "dbb991ed-781f-4666-a0b6-c360ab742952", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:29:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cd:60,bridge_name='br-int',has_traffic_filtering=True,id=dbb991ed-781f-4666-a0b6-c360ab742952,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb991ed-78') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:29:25 user nova-compute[72874]: DEBUG os_vif [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cd:60,bridge_name='br-int',has_traffic_filtering=True,id=dbb991ed-781f-4666-a0b6-c360ab742952,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb991ed-78') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:29:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbb991ed-78, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:29:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:29:25 user nova-compute[72874]: INFO os_vif [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:cd:60,bridge_name='br-int',has_traffic_filtering=True,id=dbb991ed-781f-4666-a0b6-c360ab742952,network=Network(f926ad48-dfc8-48a6-8c36-c8abe9b5b982),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb991ed-78')
Aug 17 18:29:25 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Deleting instance files /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a_del
Aug 17 18:29:25 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Deletion of /opt/stack/data/nova/instances/cf9f3116-5e42-4858-a391-ab75d2046f1a_del complete
Aug 17 18:29:25 user nova-compute[72874]: INFO nova.compute.manager [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 18:29:25 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:29:25 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:29:25 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:29:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:26 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:29:26 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:29:26 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:29:26 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Took 0.82 seconds to deallocate network for instance.
Aug 17 18:29:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-d2c77377-2806-4075-abf2-275443af9d9d req-dbf767f9-193c-4bd6-891b-8b102131725b service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received event network-vif-deleted-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:29:26 user nova-compute[72874]: INFO nova.compute.manager [req-d2c77377-2806-4075-abf2-275443af9d9d req-dbf767f9-193c-4bd6-891b-8b102131725b service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Neutron deleted interface dbb991ed-781f-4666-a0b6-c360ab742952; detaching it from the instance and deleting it from the info cache
Aug 17 18:29:26 user nova-compute[72874]: DEBUG nova.network.neutron [req-d2c77377-2806-4075-abf2-275443af9d9d req-dbf767f9-193c-4bd6-891b-8b102131725b service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:29:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-d2c77377-2806-4075-abf2-275443af9d9d req-dbf767f9-193c-4bd6-891b-8b102131725b service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Detach interface failed, port_id=dbb991ed-781f-4666-a0b6-c360ab742952, reason: Instance cf9f3116-5e42-4858-a391-ab75d2046f1a could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:29:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:26 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:29:26 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:29:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:26 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Deleted allocations for instance cf9f3116-5e42-4858-a391-ab75d2046f1a
Aug 17 18:29:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8228b121-6318-431e-907a-94f130c24ef8 tempest-AttachVolumeShelveTestJSON-1376162523 tempest-AttachVolumeShelveTestJSON-1376162523-project-member] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.203s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-a0128d2f-d5fe-4846-a88d-5ad6d49504dc req-ce95a5b3-d15d-4742-868f-18ff0a0a58f3 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received event network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:29:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a0128d2f-d5fe-4846-a88d-5ad6d49504dc req-ce95a5b3-d15d-4742-868f-18ff0a0a58f3 service nova] Acquiring lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a0128d2f-d5fe-4846-a88d-5ad6d49504dc req-ce95a5b3-d15d-4742-868f-18ff0a0a58f3 service nova] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a0128d2f-d5fe-4846-a88d-5ad6d49504dc req-ce95a5b3-d15d-4742-868f-18ff0a0a58f3 service nova] Lock "cf9f3116-5e42-4858-a391-ab75d2046f1a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-a0128d2f-d5fe-4846-a88d-5ad6d49504dc req-ce95a5b3-d15d-4742-868f-18ff0a0a58f3 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] No waiting events found dispatching network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:29:26 user nova-compute[72874]: WARNING nova.compute.manager [req-a0128d2f-d5fe-4846-a88d-5ad6d49504dc req-ce95a5b3-d15d-4742-868f-18ff0a0a58f3 service nova] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Received unexpected event network-vif-plugged-dbb991ed-781f-4666-a0b6-c360ab742952 for instance with vm_state deleted and task_state None.
Aug 17 18:29:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:29:38 user nova-compute[72874]: INFO nova.compute.claims [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Claim successful on node user
Aug 17 18:29:38 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:29:38 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:29:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG nova.policy [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '576a655170bb4dc3b1c45cb9bbfe5ae7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a608a48fc27947bcbbc84e5c078cea4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:29:38 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Creating image(s)
Aug 17 18:29:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "/opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "/opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "/opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "ec9a9ab938a3a37d9f42c20a72223ab0caa920c7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "ec9a9ab938a3a37d9f42c20a72223ab0caa920c7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7.part --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7.part --force-share --output=json" returned: 0 in 0.182s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:39 user nova-compute[72874]: DEBUG nova.virt.images [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] 76e2554a-dfc0-4883-8db1-6a736b39683e was qcow2, converting to raw {{(pid=72874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 18:29:39 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:29:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7.part /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7.converted {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7.part /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7.converted" returned: 0 in 0.483s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7.converted --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692296965.2364419, cf9f3116-5e42-4858-a391-ab75d2046f1a => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:29:40 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] VM Stopped (Lifecycle Event)
Aug 17 18:29:40 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Successfully created port: a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-68e758e9-4938-4233-8da1-8295fdf09e44 None None] [instance: cf9f3116-5e42-4858-a391-ab75d2046f1a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "ec9a9ab938a3a37d9f42c20a72223ab0caa920c7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.406s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7 --force-share --output=json" returned: 0 in 0.184s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "ec9a9ab938a3a37d9f42c20a72223ab0caa920c7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "ec9a9ab938a3a37d9f42c20a72223ab0caa920c7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7 --force-share --output=json" returned: 0 in 0.197s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7,backing_fmt=raw /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7,backing_fmt=raw /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk 1073741824" returned: 0 in 0.064s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "ec9a9ab938a3a37d9f42c20a72223ab0caa920c7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7 --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:40 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Cannot resize image /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG nova.objects.instance [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lazy-loading 'migration_context' on Instance uuid 90997e0c-bbbf-493f-92f2-f310489eb6a6 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Ensure instance console log exists: /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Successfully updated port: a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquired lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG nova.compute.manager [req-5fdb1fea-0648-48dc-a5cd-4f213c190109 req-f9bef13f-2c20-42bd-a628-8ed5f1ea882b service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-changed-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG nova.compute.manager [req-5fdb1fea-0648-48dc-a5cd-4f213c190109 req-f9bef13f-2c20-42bd-a628-8ed5f1ea882b service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Refreshing instance network info cache due to event network-changed-a465b261-54fe-481e-8abe-be2a50aff00b. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5fdb1fea-0648-48dc-a5cd-4f213c190109 req-f9bef13f-2c20-42bd-a628-8ed5f1ea882b service nova] Acquiring lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:29:41 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Updating instance_info_cache with network_info: [{"id": "a465b261-54fe-481e-8abe-be2a50aff00b", "address": "fa:16:3e:dc:cb:80", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa465b261-54", "ovs_interfaceid": "a465b261-54fe-481e-8abe-be2a50aff00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Releasing lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Instance network_info: |[{"id": "a465b261-54fe-481e-8abe-be2a50aff00b", "address": "fa:16:3e:dc:cb:80", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa465b261-54", "ovs_interfaceid": "a465b261-54fe-481e-8abe-be2a50aff00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5fdb1fea-0648-48dc-a5cd-4f213c190109 req-f9bef13f-2c20-42bd-a628-8ed5f1ea882b service nova] Acquired lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.network.neutron [req-5fdb1fea-0648-48dc-a5cd-4f213c190109 req-f9bef13f-2c20-42bd-a628-8ed5f1ea882b service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Refreshing network info cache for port a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Start _get_guest_xml network_info=[{"id": "a465b261-54fe-481e-8abe-be2a50aff00b", "address": "fa:16:3e:dc:cb:80", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa465b261-54", "ovs_interfaceid": "a465b261-54fe-481e-8abe-be2a50aff00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:29:35Z,direct_url=<?>,disk_format='qcow2',id=76e2554a-dfc0-4883-8db1-6a736b39683e,min_disk=0,min_ram=0,name='tempest-scenario-img--1271817791',owner='a608a48fc27947bcbbc84e5c078cea4c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:29:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '76e2554a-dfc0-4883-8db1-6a736b39683e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:29:42 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:29:42 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:29:35Z,direct_url=<?>,disk_format='qcow2',id=76e2554a-dfc0-4883-8db1-6a736b39683e,min_disk=0,min_ram=0,name='tempest-scenario-img--1271817791',owner='a608a48fc27947bcbbc84e5c078cea4c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:29:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1517624274',display_name='tempest-TestMinimumBasicScenario-server-1517624274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1517624274',id=30,image_ref='76e2554a-dfc0-4883-8db1-6a736b39683e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJgXAXJrsdODoCScIeFKJM20OxQNMEHARGD6Uoo/WKYQgVWYAcHD/WdQf+g25/3X9GmPX7Du4ew2H9jq6c+EZaJ+AsXskJoacnjEbuuIPEjHNbYbuTohmyFH1GJ2ITXFg==',key_name='tempest-TestMinimumBasicScenario-878940498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a608a48fc27947bcbbc84e5c078cea4c',ramdisk_id='',reservation_id='r-d1zu4ypc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2554a-dfc0-4883-8db1-6a736b39683e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1549406810',owner_user_name='tempest-TestMinimumBasicScenario-1549406810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:29:39Z,user_data=None,user_id='576a655170bb4dc3b1c45cb9bbfe5ae7',uuid=90997e0c-bbbf-493f-92f2-f310489eb6a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a465b261-54fe-481e-8abe-be2a50aff00b", "address": "fa:16:3e:dc:cb:80", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa465b261-54", "ovs_interfaceid": "a465b261-54fe-481e-8abe-be2a50aff00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Converting VIF {"id": "a465b261-54fe-481e-8abe-be2a50aff00b", "address": "fa:16:3e:dc:cb:80", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa465b261-54", "ovs_interfaceid": "a465b261-54fe-481e-8abe-be2a50aff00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:cb:80,bridge_name='br-int',has_traffic_filtering=True,id=a465b261-54fe-481e-8abe-be2a50aff00b,network=Network(6badf08e-0db0-44c7-a8e8-1825dc05ee9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa465b261-54') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.objects.instance [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lazy-loading 'pci_devices' on Instance uuid 90997e0c-bbbf-493f-92f2-f310489eb6a6 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:29:42 user nova-compute[72874]:   <uuid>90997e0c-bbbf-493f-92f2-f310489eb6a6</uuid>
Aug 17 18:29:42 user nova-compute[72874]:   <name>instance-0000001e</name>
Aug 17 18:29:42 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:29:42 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:29:42 user nova-compute[72874]:   <metadata>
Aug 17 18:29:42 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:29:42 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:29:42 user nova-compute[72874]:       <nova:name>tempest-TestMinimumBasicScenario-server-1517624274</nova:name>
Aug 17 18:29:42 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:29:42</nova:creationTime>
Aug 17 18:29:42 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:29:42 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:29:42 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:29:42 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:29:42 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:29:42 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:29:42 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:29:42 user nova-compute[72874]:       <nova:owner>
Aug 17 18:29:42 user nova-compute[72874]:         <nova:user uuid="576a655170bb4dc3b1c45cb9bbfe5ae7">tempest-TestMinimumBasicScenario-1549406810-project-member</nova:user>
Aug 17 18:29:42 user nova-compute[72874]:         <nova:project uuid="a608a48fc27947bcbbc84e5c078cea4c">tempest-TestMinimumBasicScenario-1549406810</nova:project>
Aug 17 18:29:42 user nova-compute[72874]:       </nova:owner>
Aug 17 18:29:42 user nova-compute[72874]:       <nova:root type="image" uuid="76e2554a-dfc0-4883-8db1-6a736b39683e"/>
Aug 17 18:29:42 user nova-compute[72874]:       <nova:ports>
Aug 17 18:29:42 user nova-compute[72874]:         <nova:port uuid="a465b261-54fe-481e-8abe-be2a50aff00b">
Aug 17 18:29:42 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 18:29:42 user nova-compute[72874]:         </nova:port>
Aug 17 18:29:42 user nova-compute[72874]:       </nova:ports>
Aug 17 18:29:42 user nova-compute[72874]:     </nova:instance>
Aug 17 18:29:42 user nova-compute[72874]:   </metadata>
Aug 17 18:29:42 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:29:42 user nova-compute[72874]:     <system>
Aug 17 18:29:42 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:29:42 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:29:42 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:29:42 user nova-compute[72874]:       <entry name="serial">90997e0c-bbbf-493f-92f2-f310489eb6a6</entry>
Aug 17 18:29:42 user nova-compute[72874]:       <entry name="uuid">90997e0c-bbbf-493f-92f2-f310489eb6a6</entry>
Aug 17 18:29:42 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:29:42 user nova-compute[72874]:     </system>
Aug 17 18:29:42 user nova-compute[72874]:   </sysinfo>
Aug 17 18:29:42 user nova-compute[72874]:   <os>
Aug 17 18:29:42 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:29:42 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:29:42 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:29:42 user nova-compute[72874]:   </os>
Aug 17 18:29:42 user nova-compute[72874]:   <features>
Aug 17 18:29:42 user nova-compute[72874]:     <acpi/>
Aug 17 18:29:42 user nova-compute[72874]:     <apic/>
Aug 17 18:29:42 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:29:42 user nova-compute[72874]:   </features>
Aug 17 18:29:42 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:29:42 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:29:42 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:29:42 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:29:42 user nova-compute[72874]:   </clock>
Aug 17 18:29:42 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:29:42 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:29:42 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:29:42 user nova-compute[72874]:   </cpu>
Aug 17 18:29:42 user nova-compute[72874]:   <devices>
Aug 17 18:29:42 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:29:42 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:29:42 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk"/>
Aug 17 18:29:42 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:29:42 user nova-compute[72874]:     </disk>
Aug 17 18:29:42 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:29:42 user nova-compute[72874]:       <mac address="fa:16:3e:dc:cb:80"/>
Aug 17 18:29:42 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:29:42 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:29:42 user nova-compute[72874]:       <target dev="tapa465b261-54"/>
Aug 17 18:29:42 user nova-compute[72874]:     </interface>
Aug 17 18:29:42 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:29:42 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/console.log" append="off"/>
Aug 17 18:29:42 user nova-compute[72874]:     </serial>
Aug 17 18:29:42 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:29:42 user nova-compute[72874]:     <video>
Aug 17 18:29:42 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:29:42 user nova-compute[72874]:     </video>
Aug 17 18:29:42 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:29:42 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:29:42 user nova-compute[72874]:     </rng>
Aug 17 18:29:42 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:29:42 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:29:42 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:29:42 user nova-compute[72874]:     </memballoon>
Aug 17 18:29:42 user nova-compute[72874]:   </devices>
Aug 17 18:29:42 user nova-compute[72874]: </domain>
Aug 17 18:29:42 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1517624274',display_name='tempest-TestMinimumBasicScenario-server-1517624274',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1517624274',id=30,image_ref='76e2554a-dfc0-4883-8db1-6a736b39683e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJgXAXJrsdODoCScIeFKJM20OxQNMEHARGD6Uoo/WKYQgVWYAcHD/WdQf+g25/3X9GmPX7Du4ew2H9jq6c+EZaJ+AsXskJoacnjEbuuIPEjHNbYbuTohmyFH1GJ2ITXFg==',key_name='tempest-TestMinimumBasicScenario-878940498',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a608a48fc27947bcbbc84e5c078cea4c',ramdisk_id='',reservation_id='r-d1zu4ypc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2554a-dfc0-4883-8db1-6a736b39683e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1549406810',owner_user_name='tempest-TestMinimumBasicScenario-1549406810-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:29:39Z,user_data=None,user_id='576a655170bb4dc3b1c45cb9bbfe5ae7',uuid=90997e0c-bbbf-493f-92f2-f310489eb6a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a465b261-54fe-481e-8abe-be2a50aff00b", "address": "fa:16:3e:dc:cb:80", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa465b261-54", "ovs_interfaceid": "a465b261-54fe-481e-8abe-be2a50aff00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Converting VIF {"id": "a465b261-54fe-481e-8abe-be2a50aff00b", "address": "fa:16:3e:dc:cb:80", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa465b261-54", "ovs_interfaceid": "a465b261-54fe-481e-8abe-be2a50aff00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:cb:80,bridge_name='br-int',has_traffic_filtering=True,id=a465b261-54fe-481e-8abe-be2a50aff00b,network=Network(6badf08e-0db0-44c7-a8e8-1825dc05ee9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa465b261-54') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG os_vif [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:cb:80,bridge_name='br-int',has_traffic_filtering=True,id=a465b261-54fe-481e-8abe-be2a50aff00b,network=Network(6badf08e-0db0-44c7-a8e8-1825dc05ee9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa465b261-54') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa465b261-54, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa465b261-54, col_values=(('external_ids', {'iface-id': 'a465b261-54fe-481e-8abe-be2a50aff00b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:cb:80', 'vm-uuid': '90997e0c-bbbf-493f-92f2-f310489eb6a6'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:42 user nova-compute[72874]: INFO os_vif [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:cb:80,bridge_name='br-int',has_traffic_filtering=True,id=a465b261-54fe-481e-8abe-be2a50aff00b,network=Network(6badf08e-0db0-44c7-a8e8-1825dc05ee9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa465b261-54')
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] No VIF found with MAC fa:16:3e:dc:cb:80, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.network.neutron [req-5fdb1fea-0648-48dc-a5cd-4f213c190109 req-f9bef13f-2c20-42bd-a628-8ed5f1ea882b service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Updated VIF entry in instance network info cache for port a465b261-54fe-481e-8abe-be2a50aff00b. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG nova.network.neutron [req-5fdb1fea-0648-48dc-a5cd-4f213c190109 req-f9bef13f-2c20-42bd-a628-8ed5f1ea882b service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Updating instance_info_cache with network_info: [{"id": "a465b261-54fe-481e-8abe-be2a50aff00b", "address": "fa:16:3e:dc:cb:80", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa465b261-54", "ovs_interfaceid": "a465b261-54fe-481e-8abe-be2a50aff00b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5fdb1fea-0648-48dc-a5cd-4f213c190109 req-f9bef13f-2c20-42bd-a628-8ed5f1ea882b service nova] Releasing lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:29:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-6c4ebac8-07cc-4a35-92a3-850ad0228a88 req-c6de523d-f522-4984-96b4-5fbdb429fd37 service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:29:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6c4ebac8-07cc-4a35-92a3-850ad0228a88 req-c6de523d-f522-4984-96b4-5fbdb429fd37 service nova] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6c4ebac8-07cc-4a35-92a3-850ad0228a88 req-c6de523d-f522-4984-96b4-5fbdb429fd37 service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6c4ebac8-07cc-4a35-92a3-850ad0228a88 req-c6de523d-f522-4984-96b4-5fbdb429fd37 service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-6c4ebac8-07cc-4a35-92a3-850ad0228a88 req-c6de523d-f522-4984-96b4-5fbdb429fd37 service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] No waiting events found dispatching network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:29:43 user nova-compute[72874]: WARNING nova.compute.manager [req-6c4ebac8-07cc-4a35-92a3-850ad0228a88 req-c6de523d-f522-4984-96b4-5fbdb429fd37 service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received unexpected event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b for instance with vm_state building and task_state spawning.
Aug 17 18:29:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-21889727-7df7-4131-8444-96accc46e3dc req-63cbfb6a-9be8-474e-8312-e4b8ac8acbce service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:29:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-21889727-7df7-4131-8444-96accc46e3dc req-63cbfb6a-9be8-474e-8312-e4b8ac8acbce service nova] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-21889727-7df7-4131-8444-96accc46e3dc req-63cbfb6a-9be8-474e-8312-e4b8ac8acbce service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-21889727-7df7-4131-8444-96accc46e3dc req-63cbfb6a-9be8-474e-8312-e4b8ac8acbce service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-21889727-7df7-4131-8444-96accc46e3dc req-63cbfb6a-9be8-474e-8312-e4b8ac8acbce service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] No waiting events found dispatching network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:29:45 user nova-compute[72874]: WARNING nova.compute.manager [req-21889727-7df7-4131-8444-96accc46e3dc req-63cbfb6a-9be8-474e-8312-e4b8ac8acbce service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received unexpected event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b for instance with vm_state building and task_state spawning.
Aug 17 18:29:46 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296986.0429254, 90997e0c-bbbf-493f-92f2-f310489eb6a6 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:29:46 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] VM Resumed (Lifecycle Event)
Aug 17 18:29:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:29:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:29:46 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Instance spawned successfully.
Aug 17 18:29:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:29:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:29:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:29:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:29:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:29:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:29:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:29:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:29:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:29:46 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:29:46 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692296986.047078, 90997e0c-bbbf-493f-92f2-f310489eb6a6 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:29:46 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] VM Started (Lifecycle Event)
Aug 17 18:29:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:29:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:29:46 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:29:46 user nova-compute[72874]: INFO nova.compute.manager [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Took 7.23 seconds to spawn the instance on the hypervisor.
Aug 17 18:29:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:29:46 user nova-compute[72874]: INFO nova.compute.manager [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Took 8.00 seconds to build instance.
Aug 17 18:29:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ae7ecefc-85c4-4cc0-a04f-e977ab1486fa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.091s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-ef46c39b-08a2-4620-96f3-565868697662 req-9cd8b1da-f1c3-461c-8f01-9860bb6adb07 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Received event network-changed-65ab9470-0aab-47c5-88ee-bddd58e7d035 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:29:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-ef46c39b-08a2-4620-96f3-565868697662 req-9cd8b1da-f1c3-461c-8f01-9860bb6adb07 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Refreshing instance network info cache due to event network-changed-65ab9470-0aab-47c5-88ee-bddd58e7d035. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:29:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ef46c39b-08a2-4620-96f3-565868697662 req-9cd8b1da-f1c3-461c-8f01-9860bb6adb07 service nova] Acquiring lock "refresh_cache-ce433d26-f10d-4d06-a0a2-96ae9bde4dff" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:29:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ef46c39b-08a2-4620-96f3-565868697662 req-9cd8b1da-f1c3-461c-8f01-9860bb6adb07 service nova] Acquired lock "refresh_cache-ce433d26-f10d-4d06-a0a2-96ae9bde4dff" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:29:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-ef46c39b-08a2-4620-96f3-565868697662 req-9cd8b1da-f1c3-461c-8f01-9860bb6adb07 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Refreshing network info cache for port 65ab9470-0aab-47c5-88ee-bddd58e7d035 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:29:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-ef46c39b-08a2-4620-96f3-565868697662 req-9cd8b1da-f1c3-461c-8f01-9860bb6adb07 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Updated VIF entry in instance network info cache for port 65ab9470-0aab-47c5-88ee-bddd58e7d035. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:29:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-ef46c39b-08a2-4620-96f3-565868697662 req-9cd8b1da-f1c3-461c-8f01-9860bb6adb07 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Updating instance_info_cache with network_info: [{"id": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "address": "fa:16:3e:c2:2d:43", "network": {"id": "cadafcef-708e-45df-b9f3-cfbdd35b71c7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-249057465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093218eed532483ebd64f6b97cdc1ee8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ab9470-0a", "ovs_interfaceid": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:29:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ef46c39b-08a2-4620-96f3-565868697662 req-9cd8b1da-f1c3-461c-8f01-9860bb6adb07 service nova] Releasing lock "refresh_cache-ce433d26-f10d-4d06-a0a2-96ae9bde4dff" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:29:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Acquiring lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG nova.objects.instance [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lazy-loading 'flavor' on Instance uuid ce433d26-f10d-4d06-a0a2-96ae9bde4dff {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Acquiring lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:53 user nova-compute[72874]: INFO nova.compute.manager [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Attaching volume eb35601b-8679-4516-86c9-43159ff7dd05 to /dev/vdb
Aug 17 18:29:53 user nova-compute[72874]: DEBUG os_brick.utils [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[71865fc0-7bc9-418a-b662-51455130c6be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7d5d0e-e104-469a-8c48-e00ba3621f34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17e34b4-ea9b-4ce0-bb02-78591911e469]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[280289aa-f446-46d8-89d2-9b24c56592e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:29:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:29:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:29:54 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:29:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b44a356-e6da-48c4-b82a-cd61a440dc72]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:29:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:29:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:29:54 user nova-compute[72874]: DEBUG os_brick.utils [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:29:54 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Updating existing volume attachment record: 0170248d-38c8-4871-b0c8-0f433b17cd7b {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:29:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-12e304f3-6acf-4898-af11-87a836f72055 req-6b7d59ed-237c-492c-9ad1-3522957b36c3 service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received event network-changed-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:29:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-12e304f3-6acf-4898-af11-87a836f72055 req-6b7d59ed-237c-492c-9ad1-3522957b36c3 service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Refreshing instance network info cache due to event network-changed-8e92b898-61f1-4540-9618-69298f5be3c4. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:29:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-12e304f3-6acf-4898-af11-87a836f72055 req-6b7d59ed-237c-492c-9ad1-3522957b36c3 service nova] Acquiring lock "refresh_cache-2515d301-f1ff-42bd-b067-61713baf519a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:29:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-12e304f3-6acf-4898-af11-87a836f72055 req-6b7d59ed-237c-492c-9ad1-3522957b36c3 service nova] Acquired lock "refresh_cache-2515d301-f1ff-42bd-b067-61713baf519a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:29:56 user nova-compute[72874]: DEBUG nova.network.neutron [req-12e304f3-6acf-4898-af11-87a836f72055 req-6b7d59ed-237c-492c-9ad1-3522957b36c3 service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Refreshing network info cache for port 8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:29:56 user nova-compute[72874]: DEBUG nova.network.neutron [req-12e304f3-6acf-4898-af11-87a836f72055 req-6b7d59ed-237c-492c-9ad1-3522957b36c3 service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Updated VIF entry in instance network info cache for port 8e92b898-61f1-4540-9618-69298f5be3c4. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:29:56 user nova-compute[72874]: DEBUG nova.network.neutron [req-12e304f3-6acf-4898-af11-87a836f72055 req-6b7d59ed-237c-492c-9ad1-3522957b36c3 service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Updating instance_info_cache with network_info: [{"id": "8e92b898-61f1-4540-9618-69298f5be3c4", "address": "fa:16:3e:ad:d2:11", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e92b898-61", "ovs_interfaceid": "8e92b898-61f1-4540-9618-69298f5be3c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:29:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-12e304f3-6acf-4898-af11-87a836f72055 req-6b7d59ed-237c-492c-9ad1-3522957b36c3 service nova] Releasing lock "refresh_cache-2515d301-f1ff-42bd-b067-61713baf519a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:29:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "62dd0b51-1320-4529-907b-f632f96b48dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "62dd0b51-1320-4529-907b-f632f96b48dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:29:59 user nova-compute[72874]: INFO nova.compute.manager [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Detaching volume dd4610a7-b7e1-4d53-924e-bf48852f9092
Aug 17 18:29:59 user nova-compute[72874]: INFO nova.virt.block_device [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Attempting to driver detach volume dd4610a7-b7e1-4d53-924e-bf48852f9092 from mountpoint /dev/vdb
Aug 17 18:29:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Attempting to detach device vdb from instance 62dd0b51-1320-4529-907b-f632f96b48dc from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:29:59 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:29:59 user nova-compute[72874]:   <source dev="/dev/sdd"/>
Aug 17 18:29:59 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:29:59 user nova-compute[72874]:   <serial>dd4610a7-b7e1-4d53-924e-bf48852f9092</serial>
Aug 17 18:29:59 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:29:59 user nova-compute[72874]: </disk>
Aug 17 18:29:59 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "62dd0b51-1320-4529-907b-f632f96b48dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:29:59 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Successfully detached device vdb from instance 62dd0b51-1320-4529-907b-f632f96b48dc from the persistent domain config.
Aug 17 18:29:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 62dd0b51-1320-4529-907b-f632f96b48dc from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:29:59 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:29:59 user nova-compute[72874]:   <source dev="/dev/sdd"/>
Aug 17 18:29:59 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:29:59 user nova-compute[72874]:   <serial>dd4610a7-b7e1-4d53-924e-bf48852f9092</serial>
Aug 17 18:29:59 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:29:59 user nova-compute[72874]: </disk>
Aug 17 18:29:59 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692296999.6746967, 62dd0b51-1320-4529-907b-f632f96b48dc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 62dd0b51-1320-4529-907b-f632f96b48dc {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:29:59 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Successfully detached device vdb from instance 62dd0b51-1320-4529-907b-f632f96b48dc from the live domain config.
Aug 17 18:29:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AwsbLNJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:29:59 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:29:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[65da6112-3712-46bc-b03b-253816fc441b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65745a3-c7c3-447b-9bce-974f2903560a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:29:59 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:29:59 user nova-compute[72874]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 (non-flash)
Aug 17 18:29:59 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:29:59 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:29:59 user nova-compute[72874]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 (non-flash)
Aug 17 18:29:59 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a05fe7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092'): ({'sdd'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Removing single pathed devices sdd {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f05692-15ec-49de-95f4-5d49216170f4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[092f7bf5-6fae-4c6e-8d02-40248eca206e]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Flushing IO for device /dev/sdd {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae6ff6f-5e36-4a5d-b5d1-f4f4ff959c20]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[731d59e2-1b34-4e06-97fd-fe80a360809a]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.119s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b753585-0889-4a66-a752-cb3a5aef1aba]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:29:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[df67d448-f2df-4db7-8d25-838de5fb0d1b]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092, portal: 172.16.0.220,3260]
Aug 17 18:30:00 user nova-compute[72874]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092, portal: 172.16.0.220,3260] successful.
Aug 17 18:30:00 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a2e4b8-68d8-4808-9fa0-cf58585d06bf]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] <== disconnect_volume: return (369ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG nova.objects.instance [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lazy-loading 'flavor' on Instance uuid 62dd0b51-1320-4529-907b-f632f96b48dc {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "2515d301-f1ff-42bd-b067-61713baf519a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "2515d301-f1ff-42bd-b067-61713baf519a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-32210fdc-42d4-47e9-be19-8e1ce6e6e7fc tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "62dd0b51-1320-4529-907b-f632f96b48dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.839s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "62dd0b51-1320-4529-907b-f632f96b48dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.700s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "62dd0b51-1320-4529-907b-f632f96b48dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "62dd0b51-1320-4529-907b-f632f96b48dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "62dd0b51-1320-4529-907b-f632f96b48dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:00 user nova-compute[72874]: INFO nova.compute.manager [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Terminating instance
Aug 17 18:30:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'flavor' on Instance uuid 2515d301-f1ff-42bd-b067-61713baf519a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "2515d301-f1ff-42bd-b067-61713baf519a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "2515d301-f1ff-42bd-b067-61713baf519a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "2515d301-f1ff-42bd-b067-61713baf519a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:01 user nova-compute[72874]: INFO nova.compute.manager [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Attaching volume 9377286a-0695-4012-a4fe-a27e64611f08 to /dev/vdb
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_brick.utils [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[860390de-49ab-497c-8ab2-da9db39ba01c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc9263a-52de-456f-b503-0e7023b57171]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a4fd92-7c2e-4363-97f5-4b68b17bd453]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[590ae8a5-1454-4021-8335-ffc4a7caebfd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-6a0988b4-09a4-455f-8118-38747edd1a74 req-8bbed666-437d-45c6-9999-dd9af1b36dfd service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Received event network-vif-unplugged-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6a0988b4-09a4-455f-8118-38747edd1a74 req-8bbed666-437d-45c6-9999-dd9af1b36dfd service nova] Acquiring lock "62dd0b51-1320-4529-907b-f632f96b48dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6a0988b4-09a4-455f-8118-38747edd1a74 req-8bbed666-437d-45c6-9999-dd9af1b36dfd service nova] Lock "62dd0b51-1320-4529-907b-f632f96b48dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6a0988b4-09a4-455f-8118-38747edd1a74 req-8bbed666-437d-45c6-9999-dd9af1b36dfd service nova] Lock "62dd0b51-1320-4529-907b-f632f96b48dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-6a0988b4-09a4-455f-8118-38747edd1a74 req-8bbed666-437d-45c6-9999-dd9af1b36dfd service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] No waiting events found dispatching network-vif-unplugged-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-6a0988b4-09a4-455f-8118-38747edd1a74 req-8bbed666-437d-45c6-9999-dd9af1b36dfd service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Received event network-vif-unplugged-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:30:01 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a3777c-d9ea-4207-a935-44ae4291c88c]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_brick.utils [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Updating existing volume attachment record: 3928bef6-ee82-407b-8207-38fb50d30e2f {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:30:01 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Instance destroyed successfully.
Aug 17 18:30:01 user nova-compute[72874]: DEBUG nova.objects.instance [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lazy-loading 'resources' on Instance uuid 62dd0b51-1320-4529-907b-f632f96b48dc {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:27:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-63962111',display_name='tempest-VolumesSnapshotTestJSON-instance-63962111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-63962111',id=24,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2qe/ZHYOTMRsXfuWgAlHZhnSmAVM6rjI67SizzDq8euUufDJVChjL4gLBcMqeBPY742rMlxUCgJLe+9XoD3E1/plsFdmAkwNU870axaGEQ8qGivfjfQ6bxWODa6WZ43A==',key_name='tempest-keypair-1420259346',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:27:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1f96ef08868f45aea64ddf76a0bb68f5',ramdisk_id='',reservation_id='r-tz5zam3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1222672370',owner_user_name='tempest-VolumesSnapshotTestJSON-1222672370-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:27:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='55c7ca8d3b6d4d42b656d9a4a9bc11a5',uuid=62dd0b51-1320-4529-907b-f632f96b48dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "address": "fa:16:3e:91:29:02", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ef4e9-5d", "ovs_interfaceid": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Converting VIF {"id": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "address": "fa:16:3e:91:29:02", "network": {"id": "b0620144-0532-4223-82f2-0fe7d1bd449e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1219823763-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1f96ef08868f45aea64ddf76a0bb68f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a4ef4e9-5d", "ovs_interfaceid": "4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:29:02,bridge_name='br-int',has_traffic_filtering=True,id=4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff,network=Network(b0620144-0532-4223-82f2-0fe7d1bd449e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ef4e9-5d') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_vif [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:29:02,bridge_name='br-int',has_traffic_filtering=True,id=4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff,network=Network(b0620144-0532-4223-82f2-0fe7d1bd449e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ef4e9-5d') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a4ef4e9-5d, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:30:01 user nova-compute[72874]: INFO os_vif [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:29:02,bridge_name='br-int',has_traffic_filtering=True,id=4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff,network=Network(b0620144-0532-4223-82f2-0fe7d1bd449e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a4ef4e9-5d')
Aug 17 18:30:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AwsbLNJp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:30:01 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd4610a7-b7e1-4d53-924e-bf48852f9092', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce72936-fa18-4ce9-92c3-f5997b97fd75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[182c1371-bfb6-4e1b-81b6-ef9f0759bfe1]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:30:01 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:30:01 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:30:01 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:30:01 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a0751480>, {}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Disconnecting from: [] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.046s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] <== disconnect_volume: return (47ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:30:01 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Deleting instance files /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc_del
Aug 17 18:30:01 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Deletion of /opt/stack/data/nova/instances/62dd0b51-1320-4529-907b-f632f96b48dc_del complete
Aug 17 18:30:01 user nova-compute[72874]: INFO nova.compute.manager [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 17 18:30:01 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:30:01 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:30:02 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:30:02 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Took 0.85 seconds to deallocate network for instance.
Aug 17 18:30:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-1597293e-47e9-4fea-af6f-d91d27e50334 req-2c113f6b-63c8-45c0-ab1c-7ed209c27fac service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Received event network-vif-deleted-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:30:02 user nova-compute[72874]: WARNING nova.volume.cinder [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Attachment 97b93f85-9549-4b70-85f2-bd1019c3d721 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 97b93f85-9549-4b70-85f2-bd1019c3d721. (HTTP 404) (Request-ID: req-8a64cc74-8af9-4faf-bea9-feb6ef59585a)
Aug 17 18:30:02 user nova-compute[72874]: INFO nova.compute.manager [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Took 0.04 seconds to detach 1 volumes for instance.
Aug 17 18:30:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:03 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:30:03 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:30:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:03 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Deleted allocations for instance 62dd0b51-1320-4529-907b-f632f96b48dc
Aug 17 18:30:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-edce8864-2b85-4281-8487-e789c90af881 tempest-VolumesSnapshotTestJSON-1222672370 tempest-VolumesSnapshotTestJSON-1222672370-project-member] Lock "62dd0b51-1320-4529-907b-f632f96b48dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.300s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-791d53ec-6e47-4a3f-ba49-3332eb7d35f3 req-7ed0a131-3faf-40d7-ad54-e8e7247f3cd3 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Received event network-vif-plugged-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:30:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-791d53ec-6e47-4a3f-ba49-3332eb7d35f3 req-7ed0a131-3faf-40d7-ad54-e8e7247f3cd3 service nova] Acquiring lock "62dd0b51-1320-4529-907b-f632f96b48dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-791d53ec-6e47-4a3f-ba49-3332eb7d35f3 req-7ed0a131-3faf-40d7-ad54-e8e7247f3cd3 service nova] Lock "62dd0b51-1320-4529-907b-f632f96b48dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-791d53ec-6e47-4a3f-ba49-3332eb7d35f3 req-7ed0a131-3faf-40d7-ad54-e8e7247f3cd3 service nova] Lock "62dd0b51-1320-4529-907b-f632f96b48dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-791d53ec-6e47-4a3f-ba49-3332eb7d35f3 req-7ed0a131-3faf-40d7-ad54-e8e7247f3cd3 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] No waiting events found dispatching network-vif-plugged-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:30:03 user nova-compute[72874]: WARNING nova.compute.manager [req-791d53ec-6e47-4a3f-ba49-3332eb7d35f3 req-7ed0a131-3faf-40d7-ad54-e8e7247f3cd3 service nova] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Received unexpected event network-vif-plugged-4a4ef4e9-5d5a-482a-a29f-ce8fad4f7cff for instance with vm_state deleted and task_state None.
Aug 17 18:30:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQgkehAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:30:05 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:30:05 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:30:05 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0d617d-1b00-4e2a-bc65-b82038fc82ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:30:05 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5d3293-54da-4396-aca6-28d7046b5352]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05] added
Aug 17 18:30:05 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d857c45-3d15-448a-b11c-d6a501b73f7e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[75795665-6026-468f-85c8-14143ef16e7c]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MQgkehAU {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MQgkehAU" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef3b75c-321f-4c87-807b-c856bda8b3fb]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MQgkehAU'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fe9c93-06dc-4603-b767-278efe8df892]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6887ba-e292-4ac2-ac53-ea0e5c1e8c51]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:30:05 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:30:05 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:30:05 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:30:05 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f3cbda-046f-4c02-a945-64ad2f491c0a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05, portal: 172.16.0.220,3260]
Aug 17 18:30:05 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05, portal: 172.16.0.220,3260] successful.
Aug 17 18:30:05 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2f0d6a-c9e1-410e-8ad4-0a8a7d24029a]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c747e0fd-912b-4182-94f8-c8e92bfa85c1]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:30:05 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:30:05 user nova-compute[72874]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 (non-flash)
Aug 17 18:30:05 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:30:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:30:05 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:30:05 user nova-compute[72874]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 (non-flash)
Aug 17 18:30:05 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b1755a-8c9e-474d-8a35-bcf837d0ce08]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-bbcf9910-5737-4476-9ab7-d3ea959cc374 req-8d12500c-0a5e-4346-bdf8-200ec85e238a service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Received event network-changed-17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-bbcf9910-5737-4476-9ab7-d3ea959cc374 req-8d12500c-0a5e-4346-bdf8-200ec85e238a service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Refreshing instance network info cache due to event network-changed-17265426-d5a6-4028-8c1c-2f84dfa2ac21. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bbcf9910-5737-4476-9ab7-d3ea959cc374 req-8d12500c-0a5e-4346-bdf8-200ec85e238a service nova] Acquiring lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bbcf9910-5737-4476-9ab7-d3ea959cc374 req-8d12500c-0a5e-4346-bdf8-200ec85e238a service nova] Acquired lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG nova.network.neutron [req-bbcf9910-5737-4476-9ab7-d3ea959cc374 req-8d12500c-0a5e-4346-bdf8-200ec85e238a service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Refreshing network info cache for port 17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG nova.network.neutron [req-bbcf9910-5737-4476-9ab7-d3ea959cc374 req-8d12500c-0a5e-4346-bdf8-200ec85e238a service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Updated VIF entry in instance network info cache for port 17265426-d5a6-4028-8c1c-2f84dfa2ac21. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG nova.network.neutron [req-bbcf9910-5737-4476-9ab7-d3ea959cc374 req-8d12500c-0a5e-4346-bdf8-200ec85e238a service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Updating instance_info_cache with network_info: [{"id": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "address": "fa:16:3e:3a:30:bb", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17265426-d5", "ovs_interfaceid": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:30:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bbcf9910-5737-4476-9ab7-d3ea959cc374 req-8d12500c-0a5e-4346-bdf8-200ec85e238a service nova] Releasing lock "refresh_cache-b143e572-9116-4dc0-8fc3-ba586b290ddd" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:30:07 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:30:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQgkehAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:30:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:30:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23433373362623863', 'path': '/dev/sdd'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:30:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433373362623863', 'path': '/dev/sdd'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:30:07 user nova-compute[72874]: DEBUG nova.objects.instance [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lazy-loading 'flavor' on Instance uuid ce433d26-f10d-4d06-a0a2-96ae9bde4dff {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:30:07 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:30:07 user nova-compute[72874]:   <source dev="/dev/sdd"/>
Aug 17 18:30:07 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:30:07 user nova-compute[72874]:   <serial>eb35601b-8679-4516-86c9-43159ff7dd05</serial>
Aug 17 18:30:07 user nova-compute[72874]: </disk>
Aug 17 18:30:07 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:30:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:30:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:30:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] No VIF found with MAC fa:16:3e:c2:2d:43, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:30:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-56ce3b8d-b612-4d55-a707-1782506f5dcf tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.811s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Stashing vm_state: active {{(pid=72874) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 18:30:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:08 user nova-compute[72874]: DEBUG nova.objects.instance [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'pci_requests' on Instance uuid f5760c65-a9c0-4997-8db3-04c1b4095ac5 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:30:08 user nova-compute[72874]: INFO nova.compute.claims [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Claim successful on node user
Aug 17 18:30:08 user nova-compute[72874]: DEBUG nova.objects.instance [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'resources' on Instance uuid f5760c65-a9c0-4997-8db3-04c1b4095ac5 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:08 user nova-compute[72874]: DEBUG nova.objects.instance [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'pci_devices' on Instance uuid f5760c65-a9c0-4997-8db3-04c1b4095ac5 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:08 user nova-compute[72874]: INFO nova.compute.resource_tracker [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Updating resource usage from migration 236dca91-651c-489f-9c85-a636ce006bf0
Aug 17 18:30:08 user nova-compute[72874]: DEBUG nova.compute.manager [req-a748ac9c-db26-42b0-a060-ccb6a2466acf req-a491c5eb-e026-4be0-8322-82e62b9b8443 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received event network-changed-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:30:08 user nova-compute[72874]: DEBUG nova.compute.manager [req-a748ac9c-db26-42b0-a060-ccb6a2466acf req-a491c5eb-e026-4be0-8322-82e62b9b8443 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Refreshing instance network info cache due to event network-changed-5ccb2518-ba24-4885-a6c1-fd247bb0482c. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:30:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a748ac9c-db26-42b0-a060-ccb6a2466acf req-a491c5eb-e026-4be0-8322-82e62b9b8443 service nova] Acquiring lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:30:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a748ac9c-db26-42b0-a060-ccb6a2466acf req-a491c5eb-e026-4be0-8322-82e62b9b8443 service nova] Acquired lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:30:08 user nova-compute[72874]: DEBUG nova.network.neutron [req-a748ac9c-db26-42b0-a060-ccb6a2466acf req-a491c5eb-e026-4be0-8322-82e62b9b8443 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Refreshing network info cache for port 5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:30:08 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:30:08 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:30:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.550s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:08 user nova-compute[72874]: INFO nova.compute.manager [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Migrating
Aug 17 18:30:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:30:08 user nova-compute[72874]: DEBUG nova.network.neutron [req-a748ac9c-db26-42b0-a060-ccb6a2466acf req-a491c5eb-e026-4be0-8322-82e62b9b8443 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Updated VIF entry in instance network info cache for port 5ccb2518-ba24-4885-a6c1-fd247bb0482c. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:30:08 user nova-compute[72874]: DEBUG nova.network.neutron [req-a748ac9c-db26-42b0-a060-ccb6a2466acf req-a491c5eb-e026-4be0-8322-82e62b9b8443 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Updating instance_info_cache with network_info: [{"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:30:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a748ac9c-db26-42b0-a060-ccb6a2466acf req-a491c5eb-e026-4be0-8322-82e62b9b8443 service nova] Releasing lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:30:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquired lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:30:08 user nova-compute[72874]: DEBUG nova.network.neutron [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Acquiring lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:09 user nova-compute[72874]: INFO nova.compute.manager [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Detaching volume eb35601b-8679-4516-86c9-43159ff7dd05
Aug 17 18:30:09 user nova-compute[72874]: DEBUG nova.network.neutron [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Updating instance_info_cache with network_info: [{"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Releasing lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:30:09 user nova-compute[72874]: INFO nova.virt.block_device [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Attempting to driver detach volume eb35601b-8679-4516-86c9-43159ff7dd05 from mountpoint /dev/vdb
Aug 17 18:30:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Attempting to detach device vdb from instance ce433d26-f10d-4d06-a0a2-96ae9bde4dff from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:30:09 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:30:09 user nova-compute[72874]:   <source dev="/dev/sdd"/>
Aug 17 18:30:09 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:30:09 user nova-compute[72874]:   <serial>eb35601b-8679-4516-86c9-43159ff7dd05</serial>
Aug 17 18:30:09 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:30:09 user nova-compute[72874]: </disk>
Aug 17 18:30:09 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:30:09 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Successfully detached device vdb from instance ce433d26-f10d-4d06-a0a2-96ae9bde4dff from the persistent domain config.
Aug 17 18:30:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce433d26-f10d-4d06-a0a2-96ae9bde4dff from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:30:09 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:30:09 user nova-compute[72874]:   <source dev="/dev/sdd"/>
Aug 17 18:30:09 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:30:09 user nova-compute[72874]:   <serial>eb35601b-8679-4516-86c9-43159ff7dd05</serial>
Aug 17 18:30:09 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:30:09 user nova-compute[72874]: </disk>
Aug 17 18:30:09 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Starting migrate_disk_and_power_off {{(pid=72874) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG nova.compute.manager [req-9a1fc932-7fb1-4f57-b1c0-1f175399b0ad req-25b42d15-507d-4ffd-99d3-a9e8f0074d4e service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received event network-vif-unplugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9a1fc932-7fb1-4f57-b1c0-1f175399b0ad req-25b42d15-507d-4ffd-99d3-a9e8f0074d4e service nova] Acquiring lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9a1fc932-7fb1-4f57-b1c0-1f175399b0ad req-25b42d15-507d-4ffd-99d3-a9e8f0074d4e service nova] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9a1fc932-7fb1-4f57-b1c0-1f175399b0ad req-25b42d15-507d-4ffd-99d3-a9e8f0074d4e service nova] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG nova.compute.manager [req-9a1fc932-7fb1-4f57-b1c0-1f175399b0ad req-25b42d15-507d-4ffd-99d3-a9e8f0074d4e service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] No waiting events found dispatching network-vif-unplugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:30:09 user nova-compute[72874]: WARNING nova.compute.manager [req-9a1fc932-7fb1-4f57-b1c0-1f175399b0ad req-25b42d15-507d-4ffd-99d3-a9e8f0074d4e service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received unexpected event network-vif-unplugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c for instance with vm_state active and task_state resize_migrating.
Aug 17 18:30:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692297009.8686845, ce433d26-f10d-4d06-a0a2-96ae9bde4dff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce433d26-f10d-4d06-a0a2-96ae9bde4dff {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:30:09 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Successfully detached device vdb from instance ce433d26-f10d-4d06-a0a2-96ae9bde4dff from the live domain config.
Aug 17 18:30:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MQgkehAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:30:09 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:30:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbd6edf-49b6-45d5-aed8-645ada3a752e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc01988-4b71-4ffd-87f5-e9f946a9ac72]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:30:09 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:30:09 user nova-compute[72874]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 (non-flash)
Aug 17 18:30:09 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:30:09 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:30:09 user nova-compute[72874]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 (non-flash)
Aug 17 18:30:09 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c0460ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05'): ({'sdd'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Removing single pathed devices sdd {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[61652b23-91c0-4d4d-ac8a-a7ffcea84677]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7e3b3a-8fa4-44f8-9fa2-c1c370f4e1e8]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Flushing IO for device /dev/sdd {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:30:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe66a15-586a-46ac-9062-fffb9e9c31b8]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de65a90-b0df-413f-bab2-e76aee2c21fe]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[372e608b-a3d5-4783-9a73-01f5845284f8]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1655a8-25a0-44a9-adf4-bf5842c66e5c]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05, portal: 172.16.0.220,3260]
Aug 17 18:30:10 user nova-compute[72874]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05, portal: 172.16.0.220,3260] successful.
Aug 17 18:30:10 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc151192-c5a1-4aa4-af18-cd91d2b01f67]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] <== disconnect_volume: return (306ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:30:10 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Instance destroyed successfully.
Aug 17 18:30:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-557325771',display_name='tempest-ServerActionsTestOtherA-server-557325771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-557325771',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFP6ue+/z3wt8xhCWBOe29hsvUkf+UOWUkfgnV2VGRCWOmbw8F+9gEiC1B84s9ElkFdDnqMgWD7dJiORZ3oQy2cYRrKsSD3Z6YMcgGnOy3TRveU5TvjItrEcSVSb9w9jg==',key_name='tempest-keypair-1711897531',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:28:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4aa04d3ed68a4542b32e2efeca25222a',ramdisk_id='',reservation_id='r-z37qv7n7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1332351935',owner_user_name='tempest-ServerActionsTestOtherA-1332351935-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:30:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaaa47a37543427eaa1712d29c419dd9',uuid=f5760c65-a9c0-4997-8db3-04c1b4095ac5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1111083406-network", "vif_mac": "fa:16:3e:ed:73:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converting VIF {"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1111083406-network", "vif_mac": "fa:16:3e:ed:73:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:73:e1,bridge_name='br-int',has_traffic_filtering=True,id=5ccb2518-ba24-4885-a6c1-fd247bb0482c,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccb2518-ba') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_vif [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:73:e1,bridge_name='br-int',has_traffic_filtering=True,id=5ccb2518-ba24-4885-a6c1-fd247bb0482c,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccb2518-ba') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ccb2518-ba, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:30:10 user nova-compute[72874]: INFO os_vif [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:73:e1,bridge_name='br-int',has_traffic_filtering=True,id=5ccb2518-ba24-4885-a6c1-fd247bb0482c,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccb2518-ba')
Aug 17 18:30:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXlYknCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:30:10 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3c5159-d1ce-492b-904d-b0a200657274]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4ca70c-03f2-4558-b940-d32401926672]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:30:10 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:30:10 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:30:10 user nova-compute[72874]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:30:10 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a05c2d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9'): ({'sdc'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Removing single pathed devices sdc {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e50716-2aec-46b3-a90a-74aba1a4bfd8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf32b0da-ffa3-4e5e-9bea-9e97dc258601]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Flushing IO for device /dev/sdc {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7da3624-6262-4194-8b6e-74a22def2d9b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[085c0129-f544-482d-bd0c-67fe8eaffdb1]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO3204afae-1fd6d5993ec79c38', '/dev/disk/by-id/scsi-23166643664353939', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_3204afae') {{(pid=83588) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c804c1-bca1-4803-bceb-f5a35f5c5c9e]: (4, None) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[29468484-f973-4e5c-90d5-fb166cc9fd50]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0673039c-baf3-42f1-af69-9e098310f418]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9, portal: 172.16.0.220,3260]
Aug 17 18:30:10 user nova-compute[72874]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9, portal: 172.16.0.220,3260] successful.
Aug 17 18:30:10 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad7c7dc-8d4d-485d-9222-0647616d1939]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] <== disconnect_volume: return (305ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:30:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:30:11 user nova-compute[72874]: DEBUG nova.objects.instance [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lazy-loading 'flavor' on Instance uuid ce433d26-f10d-4d06-a0a2-96ae9bde4dff {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-000d426f-d512-4695-920f-ed247c272892 tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.766s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.volume.cinder [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Update attachment failed for attachment 3928bef6-ee82-407b-8207-38fb50d30e2f. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9377286a-0695-4012-a4fe-a27e64611f08 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9377286a-0695-4012-a4fe-a27e64611f08/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 was not found.).). (HTTP 500) (Request-ID: req-0ea3ff18-1aeb-4510-bf90-296e7a5f11f0) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9377286a-0695-4012-a4fe-a27e64611f08 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9377286a-0695-4012-a4fe-a27e64611f08/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 was not found.).). (HTTP 500) (Request-ID: req-0ea3ff18-1aeb-4510-bf90-296e7a5f11f0)
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Failed to attach 9377286a-0695-4012-a4fe-a27e64611f08 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9377286a-0695-4012-a4fe-a27e64611f08 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9377286a-0695-4012-a4fe-a27e64611f08/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 was not found.).). (HTTP 500) (Request-ID: req-0ea3ff18-1aeb-4510-bf90-296e7a5f11f0)
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Traceback (most recent call last):
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     ret_val = method(obj, context, *args, **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     self._do_attach(context, instance, volume, volume_api,
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     self._volume_attach(context, volume, connector, instance,
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     connection_info = volume_api.attachment_update(
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     res = method(self, ctx, *args, **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     with excutils.save_and_reraise_exception():
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     self.force_reraise()
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     raise self.value
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     context, '3.44', skip_version_check=True).attachments.update(
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     return method.func(obj, *args, **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     resp = self._update('/attachments/%s' % id, body)
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     return self._cs_request(url, 'PUT', **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     return self.request(url, method, **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a]     raise exceptions.from_response(resp, body)
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9377286a-0695-4012-a4fe-a27e64611f08 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9377286a-0695-4012-a4fe-a27e64611f08/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 was not found.).). (HTTP 500) (Request-ID: req-0ea3ff18-1aeb-4510-bf90-296e7a5f11f0)
Aug 17 18:30:11 user nova-compute[72874]: ERROR nova.compute.manager [instance: 2515d301-f1ff-42bd-b067-61713baf519a] 
Aug 17 18:30:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "2515d301-f1ff-42bd-b067-61713baf519a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.304s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server [None req-b65cb183-04b0-48ee-840f-07b1ed0fbcaf tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9377286a-0695-4012-a4fe-a27e64611f08 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9377286a-0695-4012-a4fe-a27e64611f08/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 was not found.).). (HTTP 500) (Request-ID: req-0ea3ff18-1aeb-4510-bf90-296e7a5f11f0)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7473, in attach_volume
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7470, in do_attach_volume
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7468, in do_attach_volume
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7490, in _attach_volume
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7487, in _attach_volume
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 882, in attachment_update
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 876, in attachment_update
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Unable to attach volume to target iqn.2010-10.org.openstack:9377286a-0695-4012-a4fe-a27e64611f08 because of Request to /san/iscsi/targets/iqn.2010-10.org.openstack:9377286a-0695-4012-a4fe-a27e64611f08/luns failed with code: Unknown of type:opene.cfgparser.CfgParserError reason:File /mnt/config/storage_confs/Pool-0_conf/san/iscsi/targets/iqn.2010-10.org.openstack:eb35601b-8679-4516-86c9-43159ff7dd05 was not found.).). (HTTP 500) (Request-ID: req-0ea3ff18-1aeb-4510-bf90-296e7a5f11f0)
Aug 17 18:30:11 user nova-compute[72874]: ERROR oslo_messaging.rpc.server 
Aug 17 18:30:11 user nova-compute[72874]: DEBUG nova.network.neutron [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Port 5ccb2518-ba24-4885-a6c1-fd247bb0482c binding to destination host user is already ACTIVE {{(pid=72874) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 18:30:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:30:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquired lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:30:11 user nova-compute[72874]: DEBUG nova.network.neutron [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:30:11 user nova-compute[72874]: DEBUG nova.compute.manager [req-00331610-45a0-4b57-b143-ba8ceeea9249 req-2ce4142c-3d00-49ce-a26a-675b80919e2c service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received event network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:30:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-00331610-45a0-4b57-b143-ba8ceeea9249 req-2ce4142c-3d00-49ce-a26a-675b80919e2c service nova] Acquiring lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-00331610-45a0-4b57-b143-ba8ceeea9249 req-2ce4142c-3d00-49ce-a26a-675b80919e2c service nova] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-00331610-45a0-4b57-b143-ba8ceeea9249 req-2ce4142c-3d00-49ce-a26a-675b80919e2c service nova] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:11 user nova-compute[72874]: DEBUG nova.compute.manager [req-00331610-45a0-4b57-b143-ba8ceeea9249 req-2ce4142c-3d00-49ce-a26a-675b80919e2c service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] No waiting events found dispatching network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:30:11 user nova-compute[72874]: WARNING nova.compute.manager [req-00331610-45a0-4b57-b143-ba8ceeea9249 req-2ce4142c-3d00-49ce-a26a-675b80919e2c service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received unexpected event network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c for instance with vm_state active and task_state resize_migrated.
Aug 17 18:30:12 user nova-compute[72874]: DEBUG nova.network.neutron [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Updating instance_info_cache with network_info: [{"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Releasing lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG os_brick.utils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fccc22-37f7-4e7f-9666-5973f509ca12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6007e71d-4be8-4a0d-b058-91a14888830e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a613a096-0ed9-4710-9e83-60b6177f882e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6c73e2-00f1-42bc-95f8-40b0e1bc4049]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:30:12 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:30:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e823610-39ed-4bf1-aff7-57000867f6e6]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:30:12 user nova-compute[72874]: DEBUG os_brick.utils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:30:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:16 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297001.6707113, 62dd0b51-1320-4529-907b-f632f96b48dc => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:30:16 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] VM Stopped (Lifecycle Event)
Aug 17 18:30:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ee01b5de-6b0f-41e5-8b9e-515a37dfe8ca None None] [instance: 62dd0b51-1320-4529-907b-f632f96b48dc] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:30:19 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:30:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:19 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:30:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:30:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:30:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:23 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:30:23 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7563MB free_disk=25.14694595336914GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Applying migration context for instance f5760c65-a9c0-4997-8db3-04c1b4095ac5 as it has an incoming, in-progress migration 236dca91-651c-489f-9c85-a636ce006bf0. Migration status is post-migrating {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 18:30:23 user nova-compute[72874]: INFO nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Updating resource usage from migration 236dca91-651c-489f-9c85-a636ce006bf0
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance ce433d26-f10d-4d06-a0a2-96ae9bde4dff actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2515d301-f1ff-42bd-b067-61713baf519a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 90997e0c-bbbf-493f-92f2-f310489eb6a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Migration 236dca91-651c-489f-9c85-a636ce006bf0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance f5760c65-a9c0-4997-8db3-04c1b4095ac5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:30:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Starting finish_migration {{(pid=72874) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Instance directory exists: not creating {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 18:30:24 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Creating image(s)
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Ensure instance console log exists: /opt/stack/data/nova/instances/f5760c65-a9c0-4997-8db3-04c1b4095ac5/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Start _get_guest_xml network_info=[{"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1111083406-network", "vif_mac": "fa:16:3e:ed:73:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXlYknCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f5760c65-a9c0-4997-8db3-04c1b4095ac5', 'attached_at': '2023-08-17T18:30:24.000000', 'detached_at': '', 'volume_id': '02a3029d-0c4b-4212-b644-c28603954db9', 'serial': '02a3029d-0c4b-4212-b644-c28603954db9'}, 'delete_on_termination': True, 'attachment_id': '09280e83-8b77-42d9-9055-491b093a577a', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:30:24 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:30:24 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:27Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.objects.instance [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'vcpu_model' on Instance uuid f5760c65-a9c0-4997-8db3-04c1b4095ac5 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXlYknCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:30:24 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:30:24 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:30:24 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7825f398-2108-4cb6-975a-616170f47b8a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:30:24 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1caec4-4ddb-4fb4-b5e7-d8af02b45f87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9] added
Aug 17 18:30:24 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69abb25-89aa-437a-b2a5-e1bc4eb977e9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd68bf3d-bc22-4dd5-b960-84362a5c28b2]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXlYknCb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXlYknCb" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[18df155c-1d25-4e7e-aa90-a3f8cbaefa71]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vXlYknCb'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3272876d-8995-4a23-8bfa-b18a15ba0ce8]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c24c4a-309f-4c91-af1b-49dbc51021e0]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:30:24 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:30:24 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[48461d3e-39eb-45a1-bbe5-36ad784da648]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9, portal: 172.16.0.220,3260]
Aug 17 18:30:24 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9, portal: 172.16.0.220,3260] successful.
Aug 17 18:30:24 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[165b468a-eb35-43f2-8df4-42e55bf6f999]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b52e900-0e70-4da0-9040-68d052068a14]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:30:24 user nova-compute[72874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:30:24 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:30:24 user nova-compute[72874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:30:24 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[220eea97-e8f9-4c67-b669-4c1e870f390d]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:30:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXlYknCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297010.3164904, f5760c65-a9c0-4997-8db3-04c1b4095ac5 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:30:25 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] VM Stopped (Lifecycle Event)
Aug 17 18:30:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-494038cb-40ae-420f-9a2d-96f7bfd4bcb5 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-494038cb-40ae-420f-9a2d-96f7bfd4bcb5 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:30:25 user nova-compute[72874]: INFO nova.compute.manager [None req-494038cb-40ae-420f-9a2d-96f7bfd4bcb5 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 18:30:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Updating instance_info_cache with network_info: [{"id": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "address": "fa:16:3e:25:a4:9a", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e25bfc2-df", "ovs_interfaceid": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23166643664353939', 'path': '/dev/sdc'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166643664353939', 'path': '/dev/sdc'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-557325771',display_name='tempest-ServerActionsTestOtherA-server-557325771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-557325771',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFP6ue+/z3wt8xhCWBOe29hsvUkf+UOWUkfgnV2VGRCWOmbw8F+9gEiC1B84s9ElkFdDnqMgWD7dJiORZ3oQy2cYRrKsSD3Z6YMcgGnOy3TRveU5TvjItrEcSVSb9w9jg==',key_name='tempest-keypair-1711897531',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:28:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4aa04d3ed68a4542b32e2efeca25222a',ramdisk_id='',reservation_id='r-z37qv7n7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1332351935',owner_user_name='tempest-ServerActionsTestOtherA-1332351935-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaaa47a37543427eaa1712d29c419dd9',uuid=f5760c65-a9c0-4997-8db3-04c1b4095ac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1111083406-network", "vif_mac": "fa:16:3e:ed:73:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converting VIF {"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1111083406-network", "vif_mac": "fa:16:3e:ed:73:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:73:e1,bridge_name='br-int',has_traffic_filtering=True,id=5ccb2518-ba24-4885-a6c1-fd247bb0482c,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccb2518-ba') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:30:25 user nova-compute[72874]:   <uuid>f5760c65-a9c0-4997-8db3-04c1b4095ac5</uuid>
Aug 17 18:30:25 user nova-compute[72874]:   <name>instance-0000001b</name>
Aug 17 18:30:25 user nova-compute[72874]:   <memory>2097152</memory>
Aug 17 18:30:25 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:30:25 user nova-compute[72874]:   <metadata>
Aug 17 18:30:25 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:30:25 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:30:25 user nova-compute[72874]:       <nova:name>tempest-ServerActionsTestOtherA-server-557325771</nova:name>
Aug 17 18:30:25 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:30:24</nova:creationTime>
Aug 17 18:30:25 user nova-compute[72874]:       <nova:flavor name="m1.small">
Aug 17 18:30:25 user nova-compute[72874]:         <nova:memory>2048</nova:memory>
Aug 17 18:30:25 user nova-compute[72874]:         <nova:disk>20</nova:disk>
Aug 17 18:30:25 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:30:25 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:30:25 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:30:25 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:30:25 user nova-compute[72874]:       <nova:owner>
Aug 17 18:30:25 user nova-compute[72874]:         <nova:user uuid="aaaa47a37543427eaa1712d29c419dd9">tempest-ServerActionsTestOtherA-1332351935-project-member</nova:user>
Aug 17 18:30:25 user nova-compute[72874]:         <nova:project uuid="4aa04d3ed68a4542b32e2efeca25222a">tempest-ServerActionsTestOtherA-1332351935</nova:project>
Aug 17 18:30:25 user nova-compute[72874]:       </nova:owner>
Aug 17 18:30:25 user nova-compute[72874]:       <nova:ports>
Aug 17 18:30:25 user nova-compute[72874]:         <nova:port uuid="5ccb2518-ba24-4885-a6c1-fd247bb0482c">
Aug 17 18:30:25 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 18:30:25 user nova-compute[72874]:         </nova:port>
Aug 17 18:30:25 user nova-compute[72874]:       </nova:ports>
Aug 17 18:30:25 user nova-compute[72874]:     </nova:instance>
Aug 17 18:30:25 user nova-compute[72874]:   </metadata>
Aug 17 18:30:25 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:30:25 user nova-compute[72874]:     <system>
Aug 17 18:30:25 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:30:25 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:30:25 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:30:25 user nova-compute[72874]:       <entry name="serial">f5760c65-a9c0-4997-8db3-04c1b4095ac5</entry>
Aug 17 18:30:25 user nova-compute[72874]:       <entry name="uuid">f5760c65-a9c0-4997-8db3-04c1b4095ac5</entry>
Aug 17 18:30:25 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:30:25 user nova-compute[72874]:     </system>
Aug 17 18:30:25 user nova-compute[72874]:   </sysinfo>
Aug 17 18:30:25 user nova-compute[72874]:   <os>
Aug 17 18:30:25 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:30:25 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:30:25 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:30:25 user nova-compute[72874]:   </os>
Aug 17 18:30:25 user nova-compute[72874]:   <features>
Aug 17 18:30:25 user nova-compute[72874]:     <acpi/>
Aug 17 18:30:25 user nova-compute[72874]:     <apic/>
Aug 17 18:30:25 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:30:25 user nova-compute[72874]:   </features>
Aug 17 18:30:25 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:30:25 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:30:25 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:30:25 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:30:25 user nova-compute[72874]:   </clock>
Aug 17 18:30:25 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:30:25 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:30:25 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:30:25 user nova-compute[72874]:   </cpu>
Aug 17 18:30:25 user nova-compute[72874]:   <devices>
Aug 17 18:30:25 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:30:25 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:30:25 user nova-compute[72874]:       <source dev="/dev/sdc"/>
Aug 17 18:30:25 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:30:25 user nova-compute[72874]:       <serial>02a3029d-0c4b-4212-b644-c28603954db9</serial>
Aug 17 18:30:25 user nova-compute[72874]:     </disk>
Aug 17 18:30:25 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:30:25 user nova-compute[72874]:       <mac address="fa:16:3e:ed:73:e1"/>
Aug 17 18:30:25 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:30:25 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:30:25 user nova-compute[72874]:       <target dev="tap5ccb2518-ba"/>
Aug 17 18:30:25 user nova-compute[72874]:     </interface>
Aug 17 18:30:25 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:30:25 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/f5760c65-a9c0-4997-8db3-04c1b4095ac5/console.log" append="off"/>
Aug 17 18:30:25 user nova-compute[72874]:     </serial>
Aug 17 18:30:25 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:30:25 user nova-compute[72874]:     <video>
Aug 17 18:30:25 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:30:25 user nova-compute[72874]:     </video>
Aug 17 18:30:25 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:30:25 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:30:25 user nova-compute[72874]:     </rng>
Aug 17 18:30:25 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:30:25 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:30:25 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:30:25 user nova-compute[72874]:     </memballoon>
Aug 17 18:30:25 user nova-compute[72874]:   </devices>
Aug 17 18:30:25 user nova-compute[72874]: </domain>
Aug 17 18:30:25 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-557325771',display_name='tempest-ServerActionsTestOtherA-server-557325771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-557325771',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFP6ue+/z3wt8xhCWBOe29hsvUkf+UOWUkfgnV2VGRCWOmbw8F+9gEiC1B84s9ElkFdDnqMgWD7dJiORZ3oQy2cYRrKsSD3Z6YMcgGnOy3TRveU5TvjItrEcSVSb9w9jg==',key_name='tempest-keypair-1711897531',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:28:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4aa04d3ed68a4542b32e2efeca25222a',ramdisk_id='',reservation_id='r-z37qv7n7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1332351935',owner_user_name='tempest-ServerActionsTestOtherA-1332351935-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaaa47a37543427eaa1712d29c419dd9',uuid=f5760c65-a9c0-4997-8db3-04c1b4095ac5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1111083406-network", "vif_mac": "fa:16:3e:ed:73:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converting VIF {"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1111083406-network", "vif_mac": "fa:16:3e:ed:73:e1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:73:e1,bridge_name='br-int',has_traffic_filtering=True,id=5ccb2518-ba24-4885-a6c1-fd247bb0482c,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccb2518-ba') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG os_vif [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:73:e1,bridge_name='br-int',has_traffic_filtering=True,id=5ccb2518-ba24-4885-a6c1-fd247bb0482c,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccb2518-ba') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ccb2518-ba, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5ccb2518-ba, col_values=(('external_ids', {'iface-id': '5ccb2518-ba24-4885-a6c1-fd247bb0482c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:73:e1', 'vm-uuid': 'f5760c65-a9c0-4997-8db3-04c1b4095ac5'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:25 user nova-compute[72874]: INFO os_vif [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:73:e1,bridge_name='br-int',has_traffic_filtering=True,id=5ccb2518-ba24-4885-a6c1-fd247bb0482c,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccb2518-ba')
Aug 17 18:30:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:30:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] No VIF found with MAC fa:16:3e:ed:73:e1, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:30:26 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:30:26 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:30:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-ad4e885f-9495-458f-92b1-b4131301fc6e req-ecf1b193-5c6e-447e-9513-b46277ece201 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received event network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:30:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ad4e885f-9495-458f-92b1-b4131301fc6e req-ecf1b193-5c6e-447e-9513-b46277ece201 service nova] Acquiring lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ad4e885f-9495-458f-92b1-b4131301fc6e req-ecf1b193-5c6e-447e-9513-b46277ece201 service nova] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ad4e885f-9495-458f-92b1-b4131301fc6e req-ecf1b193-5c6e-447e-9513-b46277ece201 service nova] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-ad4e885f-9495-458f-92b1-b4131301fc6e req-ecf1b193-5c6e-447e-9513-b46277ece201 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] No waiting events found dispatching network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:30:27 user nova-compute[72874]: WARNING nova.compute.manager [req-ad4e885f-9495-458f-92b1-b4131301fc6e req-ecf1b193-5c6e-447e-9513-b46277ece201 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received unexpected event network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c for instance with vm_state active and task_state resize_finish.
Aug 17 18:30:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:28 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:30:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:30:29 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297029.191369, f5760c65-a9c0-4997-8db3-04c1b4095ac5 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:30:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] VM Resumed (Lifecycle Event)
Aug 17 18:30:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:30:29 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Instance running successfully.
Aug 17 18:30:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Failed to set time: agent not configured {{(pid=72874) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 18:30:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-142d610b-67f6-4637-a755-b23c19e14606 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] finish_migration finished successfully. {{(pid=72874) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 18:30:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:30:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:30:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 18:30:29 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297029.1942399, f5760c65-a9c0-4997-8db3-04c1b4095ac5 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:30:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] VM Started (Lifecycle Event)
Aug 17 18:30:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:30:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:30:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 18:30:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-cd3da4cd-c504-480e-a1bf-81ed1c520914 req-22154f2d-6f98-42d1-ad1a-8a9b67cc4b49 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received event network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:30:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cd3da4cd-c504-480e-a1bf-81ed1c520914 req-22154f2d-6f98-42d1-ad1a-8a9b67cc4b49 service nova] Acquiring lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cd3da4cd-c504-480e-a1bf-81ed1c520914 req-22154f2d-6f98-42d1-ad1a-8a9b67cc4b49 service nova] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cd3da4cd-c504-480e-a1bf-81ed1c520914 req-22154f2d-6f98-42d1-ad1a-8a9b67cc4b49 service nova] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-cd3da4cd-c504-480e-a1bf-81ed1c520914 req-22154f2d-6f98-42d1-ad1a-8a9b67cc4b49 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] No waiting events found dispatching network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:30:29 user nova-compute[72874]: WARNING nova.compute.manager [req-cd3da4cd-c504-480e-a1bf-81ed1c520914 req-22154f2d-6f98-42d1-ad1a-8a9b67cc4b49 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received unexpected event network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c for instance with vm_state resized and task_state None.
Aug 17 18:30:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "38df8d14-531a-42f3-8a4e-c53c1a80185f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:30:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:37 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:30:37 user nova-compute[72874]: INFO nova.compute.claims [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Claim successful on node user
Aug 17 18:30:37 user nova-compute[72874]: INFO nova.compute.manager [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Rescuing
Aug 17 18:30:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:30:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquired lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:30:37 user nova-compute[72874]: DEBUG nova.network.neutron [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:30:38 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:30:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:30:38 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Creating image(s)
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "/opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "/opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "/opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG nova.policy [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd13289795c8b4991a9cf6bb2880ad6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a550f3591d1347bf8b9fb4d3e90b8aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.178s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG nova.network.neutron [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Updating instance_info_cache with network_info: [{"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Releasing lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.200s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk 1073741824" returned: 0 in 0.052s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.205s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:30:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-d2b8d0dc-4c97-4f0a-abbe-dbfa1b0dff29 req-c9970138-9716-4da8-bc40-27b22a4b36a1 service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received event network-vif-unplugged-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d2b8d0dc-4c97-4f0a-abbe-dbfa1b0dff29 req-c9970138-9716-4da8-bc40-27b22a4b36a1 service nova] Acquiring lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d2b8d0dc-4c97-4f0a-abbe-dbfa1b0dff29 req-c9970138-9716-4da8-bc40-27b22a4b36a1 service nova] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d2b8d0dc-4c97-4f0a-abbe-dbfa1b0dff29 req-c9970138-9716-4da8-bc40-27b22a4b36a1 service nova] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-d2b8d0dc-4c97-4f0a-abbe-dbfa1b0dff29 req-c9970138-9716-4da8-bc40-27b22a4b36a1 service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] No waiting events found dispatching network-vif-unplugged-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:30:39 user nova-compute[72874]: WARNING nova.compute.manager [req-d2b8d0dc-4c97-4f0a-abbe-dbfa1b0dff29 req-c9970138-9716-4da8-bc40-27b22a4b36a1 service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received unexpected event network-vif-unplugged-14186d03-6c85-4205-8aba-5a2dae028e7a for instance with vm_state active and task_state rescuing.
Aug 17 18:30:39 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Successfully created port: d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Cannot resize image /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'migration_context' on Instance uuid 38df8d14-531a-42f3-8a4e-c53c1a80185f {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Ensure instance console log exists: /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:39 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Instance destroyed successfully.
Aug 17 18:30:39 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Attempting rescue
Aug 17 18:30:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72874) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Instance directory exists: not creating {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 18:30:39 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Creating image(s)
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "/opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "/opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "/opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG nova.objects.instance [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.203s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue" returned: 0 in 0.059s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG nova.objects.instance [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'migration_context' on Instance uuid 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Start _get_guest_xml network_info=[{"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "vif_mac": "fa:16:3e:1f:11:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:30:39 user nova-compute[72874]: DEBUG nova.objects.instance [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'resources' on Instance uuid 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.objects.instance [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'numa_topology' on Instance uuid 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:40 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:30:40 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.objects.instance [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1766440334',display_name='tempest-ServerRescueNegativeTestJSON-server-1766440334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1766440334',id=29,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:28:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6287735c21fb4b43b3cbd9e0d742b0ec',ramdisk_id='',reservation_id='r-a00wc4ez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-717723449',owner_user_name='tempest-ServerRescueNegativeTestJSON-717723449-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:28:56Z,user_data=None,user_id='3143ae598e814e359466d90e74f9b00c',uuid=8c589f00-c893-4ff7-86f3-7f7ebd7b17b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "vif_mac": "fa:16:3e:1f:11:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converting VIF {"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "vif_mac": "fa:16:3e:1f:11:cf"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:11:cf,bridge_name='br-int',has_traffic_filtering=True,id=14186d03-6c85-4205-8aba-5a2dae028e7a,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14186d03-6c') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.objects.instance [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:30:40 user nova-compute[72874]:   <uuid>8c589f00-c893-4ff7-86f3-7f7ebd7b17b2</uuid>
Aug 17 18:30:40 user nova-compute[72874]:   <name>instance-0000001d</name>
Aug 17 18:30:40 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:30:40 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:30:40 user nova-compute[72874]:   <metadata>
Aug 17 18:30:40 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:30:40 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:30:40 user nova-compute[72874]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1766440334</nova:name>
Aug 17 18:30:40 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:30:40</nova:creationTime>
Aug 17 18:30:40 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:30:40 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:30:40 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:30:40 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:30:40 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:30:40 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:30:40 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:30:40 user nova-compute[72874]:       <nova:owner>
Aug 17 18:30:40 user nova-compute[72874]:         <nova:user uuid="3143ae598e814e359466d90e74f9b00c">tempest-ServerRescueNegativeTestJSON-717723449-project-member</nova:user>
Aug 17 18:30:40 user nova-compute[72874]:         <nova:project uuid="6287735c21fb4b43b3cbd9e0d742b0ec">tempest-ServerRescueNegativeTestJSON-717723449</nova:project>
Aug 17 18:30:40 user nova-compute[72874]:       </nova:owner>
Aug 17 18:30:40 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:30:40 user nova-compute[72874]:       <nova:ports>
Aug 17 18:30:40 user nova-compute[72874]:         <nova:port uuid="14186d03-6c85-4205-8aba-5a2dae028e7a">
Aug 17 18:30:40 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 18:30:40 user nova-compute[72874]:         </nova:port>
Aug 17 18:30:40 user nova-compute[72874]:       </nova:ports>
Aug 17 18:30:40 user nova-compute[72874]:     </nova:instance>
Aug 17 18:30:40 user nova-compute[72874]:   </metadata>
Aug 17 18:30:40 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:30:40 user nova-compute[72874]:     <system>
Aug 17 18:30:40 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:30:40 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:30:40 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:30:40 user nova-compute[72874]:       <entry name="serial">8c589f00-c893-4ff7-86f3-7f7ebd7b17b2</entry>
Aug 17 18:30:40 user nova-compute[72874]:       <entry name="uuid">8c589f00-c893-4ff7-86f3-7f7ebd7b17b2</entry>
Aug 17 18:30:40 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:30:40 user nova-compute[72874]:     </system>
Aug 17 18:30:40 user nova-compute[72874]:   </sysinfo>
Aug 17 18:30:40 user nova-compute[72874]:   <os>
Aug 17 18:30:40 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:30:40 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:30:40 user nova-compute[72874]:   </os>
Aug 17 18:30:40 user nova-compute[72874]:   <features>
Aug 17 18:30:40 user nova-compute[72874]:     <acpi/>
Aug 17 18:30:40 user nova-compute[72874]:     <apic/>
Aug 17 18:30:40 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:30:40 user nova-compute[72874]:   </features>
Aug 17 18:30:40 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:30:40 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:30:40 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:30:40 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:30:40 user nova-compute[72874]:   </clock>
Aug 17 18:30:40 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:30:40 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:30:40 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:30:40 user nova-compute[72874]:   </cpu>
Aug 17 18:30:40 user nova-compute[72874]:   <devices>
Aug 17 18:30:40 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:30:40 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:30:40 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue"/>
Aug 17 18:30:40 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:30:40 user nova-compute[72874]:     </disk>
Aug 17 18:30:40 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:30:40 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:30:40 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk"/>
Aug 17 18:30:40 user nova-compute[72874]:       <target dev="vdb" bus="virtio"/>
Aug 17 18:30:40 user nova-compute[72874]:     </disk>
Aug 17 18:30:40 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:30:40 user nova-compute[72874]:       <mac address="fa:16:3e:1f:11:cf"/>
Aug 17 18:30:40 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:30:40 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:30:40 user nova-compute[72874]:       <target dev="tap14186d03-6c"/>
Aug 17 18:30:40 user nova-compute[72874]:     </interface>
Aug 17 18:30:40 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:30:40 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/console.log" append="off"/>
Aug 17 18:30:40 user nova-compute[72874]:     </serial>
Aug 17 18:30:40 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:30:40 user nova-compute[72874]:     <video>
Aug 17 18:30:40 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:30:40 user nova-compute[72874]:     </video>
Aug 17 18:30:40 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:30:40 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:30:40 user nova-compute[72874]:     </rng>
Aug 17 18:30:40 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:30:40 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:30:40 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:30:40 user nova-compute[72874]:     </memballoon>
Aug 17 18:30:40 user nova-compute[72874]:   </devices>
Aug 17 18:30:40 user nova-compute[72874]: </domain>
Aug 17 18:30:40 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:30:40 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Instance destroyed successfully.
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Successfully updated port: d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.compute.manager [req-d86d2bcf-9a80-4bdd-a3a7-f949d220b6e6 req-6446b2d7-8324-4ca6-a55e-ee0142c4e6df service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received event network-changed-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.compute.manager [req-d86d2bcf-9a80-4bdd-a3a7-f949d220b6e6 req-6446b2d7-8324-4ca6-a55e-ee0142c4e6df service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Refreshing instance network info cache due to event network-changed-d2c43eee-c27d-477d-b02f-1f45a7e1e843. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d86d2bcf-9a80-4bdd-a3a7-f949d220b6e6 req-6446b2d7-8324-4ca6-a55e-ee0142c4e6df service nova] Acquiring lock "refresh_cache-38df8d14-531a-42f3-8a4e-c53c1a80185f" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d86d2bcf-9a80-4bdd-a3a7-f949d220b6e6 req-6446b2d7-8324-4ca6-a55e-ee0142c4e6df service nova] Acquired lock "refresh_cache-38df8d14-531a-42f3-8a4e-c53c1a80185f" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.network.neutron [req-d86d2bcf-9a80-4bdd-a3a7-f949d220b6e6 req-6446b2d7-8324-4ca6-a55e-ee0142c4e6df service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Refreshing network info cache for port d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "refresh_cache-38df8d14-531a-42f3-8a4e-c53c1a80185f" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No VIF found with MAC fa:16:3e:1f:11:cf, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.network.neutron [req-d86d2bcf-9a80-4bdd-a3a7-f949d220b6e6 req-6446b2d7-8324-4ca6-a55e-ee0142c4e6df service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.network.neutron [req-d86d2bcf-9a80-4bdd-a3a7-f949d220b6e6 req-6446b2d7-8324-4ca6-a55e-ee0142c4e6df service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d86d2bcf-9a80-4bdd-a3a7-f949d220b6e6 req-6446b2d7-8324-4ca6-a55e-ee0142c4e6df service nova] Releasing lock "refresh_cache-38df8d14-531a-42f3-8a4e-c53c1a80185f" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquired lock "refresh_cache-38df8d14-531a-42f3-8a4e-c53c1a80185f" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:30:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Updating instance_info_cache with network_info: [{"id": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "address": "fa:16:3e:9c:53:06", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c43eee-c2", "ovs_interfaceid": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Releasing lock "refresh_cache-38df8d14-531a-42f3-8a4e-c53c1a80185f" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Instance network_info: |[{"id": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "address": "fa:16:3e:9c:53:06", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c43eee-c2", "ovs_interfaceid": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Start _get_guest_xml network_info=[{"id": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "address": "fa:16:3e:9c:53:06", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c43eee-c2", "ovs_interfaceid": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:30:41 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:30:41 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1070652381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1070652381',id=31,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a550f3591d1347bf8b9fb4d3e90b8aad',ramdisk_id='',reservation_id='r-6scw0pi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-68498997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:30:38Z,user_data=None,user_id='d13289795c8b4991a9cf6bb2880ad6ef',uuid=38df8d14-531a-42f3-8a4e-c53c1a80185f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "address": "fa:16:3e:9c:53:06", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c43eee-c2", "ovs_interfaceid": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converting VIF {"id": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "address": "fa:16:3e:9c:53:06", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c43eee-c2", "ovs_interfaceid": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d2c43eee-c27d-477d-b02f-1f45a7e1e843,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c43eee-c2') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'pci_devices' on Instance uuid 38df8d14-531a-42f3-8a4e-c53c1a80185f {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:30:41 user nova-compute[72874]:   <uuid>38df8d14-531a-42f3-8a4e-c53c1a80185f</uuid>
Aug 17 18:30:41 user nova-compute[72874]:   <name>instance-0000001f</name>
Aug 17 18:30:41 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:30:41 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:30:41 user nova-compute[72874]:   <metadata>
Aug 17 18:30:41 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:30:41 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:30:41 user nova-compute[72874]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1070652381</nova:name>
Aug 17 18:30:41 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:30:41</nova:creationTime>
Aug 17 18:30:41 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:30:41 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:30:41 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:30:41 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:30:41 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:30:41 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:30:41 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:30:41 user nova-compute[72874]:       <nova:owner>
Aug 17 18:30:41 user nova-compute[72874]:         <nova:user uuid="d13289795c8b4991a9cf6bb2880ad6ef">tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member</nova:user>
Aug 17 18:30:41 user nova-compute[72874]:         <nova:project uuid="a550f3591d1347bf8b9fb4d3e90b8aad">tempest-ServerBootFromVolumeStableRescueTest-68498997</nova:project>
Aug 17 18:30:41 user nova-compute[72874]:       </nova:owner>
Aug 17 18:30:41 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:30:41 user nova-compute[72874]:       <nova:ports>
Aug 17 18:30:41 user nova-compute[72874]:         <nova:port uuid="d2c43eee-c27d-477d-b02f-1f45a7e1e843">
Aug 17 18:30:41 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 18:30:41 user nova-compute[72874]:         </nova:port>
Aug 17 18:30:41 user nova-compute[72874]:       </nova:ports>
Aug 17 18:30:41 user nova-compute[72874]:     </nova:instance>
Aug 17 18:30:41 user nova-compute[72874]:   </metadata>
Aug 17 18:30:41 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:30:41 user nova-compute[72874]:     <system>
Aug 17 18:30:41 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:30:41 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:30:41 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:30:41 user nova-compute[72874]:       <entry name="serial">38df8d14-531a-42f3-8a4e-c53c1a80185f</entry>
Aug 17 18:30:41 user nova-compute[72874]:       <entry name="uuid">38df8d14-531a-42f3-8a4e-c53c1a80185f</entry>
Aug 17 18:30:41 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:30:41 user nova-compute[72874]:     </system>
Aug 17 18:30:41 user nova-compute[72874]:   </sysinfo>
Aug 17 18:30:41 user nova-compute[72874]:   <os>
Aug 17 18:30:41 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:30:41 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:30:41 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:30:41 user nova-compute[72874]:   </os>
Aug 17 18:30:41 user nova-compute[72874]:   <features>
Aug 17 18:30:41 user nova-compute[72874]:     <acpi/>
Aug 17 18:30:41 user nova-compute[72874]:     <apic/>
Aug 17 18:30:41 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:30:41 user nova-compute[72874]:   </features>
Aug 17 18:30:41 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:30:41 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:30:41 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:30:41 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:30:41 user nova-compute[72874]:   </clock>
Aug 17 18:30:41 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:30:41 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:30:41 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:30:41 user nova-compute[72874]:   </cpu>
Aug 17 18:30:41 user nova-compute[72874]:   <devices>
Aug 17 18:30:41 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:30:41 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:30:41 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk"/>
Aug 17 18:30:41 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:30:41 user nova-compute[72874]:     </disk>
Aug 17 18:30:41 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:30:41 user nova-compute[72874]:       <mac address="fa:16:3e:9c:53:06"/>
Aug 17 18:30:41 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:30:41 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:30:41 user nova-compute[72874]:       <target dev="tapd2c43eee-c2"/>
Aug 17 18:30:41 user nova-compute[72874]:     </interface>
Aug 17 18:30:41 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:30:41 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/console.log" append="off"/>
Aug 17 18:30:41 user nova-compute[72874]:     </serial>
Aug 17 18:30:41 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:30:41 user nova-compute[72874]:     <video>
Aug 17 18:30:41 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:30:41 user nova-compute[72874]:     </video>
Aug 17 18:30:41 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:30:41 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:30:41 user nova-compute[72874]:     </rng>
Aug 17 18:30:41 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:30:41 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:30:41 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:30:41 user nova-compute[72874]:     </memballoon>
Aug 17 18:30:41 user nova-compute[72874]:   </devices>
Aug 17 18:30:41 user nova-compute[72874]: </domain>
Aug 17 18:30:41 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1070652381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1070652381',id=31,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a550f3591d1347bf8b9fb4d3e90b8aad',ramdisk_id='',reservation_id='r-6scw0pi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-68498997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:30:38Z,user_data=None,user_id='d13289795c8b4991a9cf6bb2880ad6ef',uuid=38df8d14-531a-42f3-8a4e-c53c1a80185f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "address": "fa:16:3e:9c:53:06", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c43eee-c2", "ovs_interfaceid": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converting VIF {"id": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "address": "fa:16:3e:9c:53:06", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c43eee-c2", "ovs_interfaceid": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d2c43eee-c27d-477d-b02f-1f45a7e1e843,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c43eee-c2') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG os_vif [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d2c43eee-c27d-477d-b02f-1f45a7e1e843,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c43eee-c2') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2c43eee-c2, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2c43eee-c2, col_values=(('external_ids', {'iface-id': 'd2c43eee-c27d-477d-b02f-1f45a7e1e843', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:53:06', 'vm-uuid': '38df8d14-531a-42f3-8a4e-c53c1a80185f'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:41 user nova-compute[72874]: INFO os_vif [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d2c43eee-c27d-477d-b02f-1f45a7e1e843,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c43eee-c2')
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.compute.manager [req-872115e7-37c0-4413-938a-c409c7a0d75f req-3ab1a5ed-cc65-4246-bf45-53e6b6fb2b96 service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received event network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-872115e7-37c0-4413-938a-c409c7a0d75f req-3ab1a5ed-cc65-4246-bf45-53e6b6fb2b96 service nova] Acquiring lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-872115e7-37c0-4413-938a-c409c7a0d75f req-3ab1a5ed-cc65-4246-bf45-53e6b6fb2b96 service nova] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-872115e7-37c0-4413-938a-c409c7a0d75f req-3ab1a5ed-cc65-4246-bf45-53e6b6fb2b96 service nova] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.compute.manager [req-872115e7-37c0-4413-938a-c409c7a0d75f req-3ab1a5ed-cc65-4246-bf45-53e6b6fb2b96 service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] No waiting events found dispatching network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:30:41 user nova-compute[72874]: WARNING nova.compute.manager [req-872115e7-37c0-4413-938a-c409c7a0d75f req-3ab1a5ed-cc65-4246-bf45-53e6b6fb2b96 service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received unexpected event network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a for instance with vm_state active and task_state rescuing.
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:30:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] No VIF found with MAC fa:16:3e:9c:53:06, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:30:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-43a4d39b-381a-45ec-92ec-71f7e7320af4 req-3e629af5-ec6c-4f7b-8dd9-ec5252538c1e service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received event network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:30:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-43a4d39b-381a-45ec-92ec-71f7e7320af4 req-3e629af5-ec6c-4f7b-8dd9-ec5252538c1e service nova] Acquiring lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-43a4d39b-381a-45ec-92ec-71f7e7320af4 req-3e629af5-ec6c-4f7b-8dd9-ec5252538c1e service nova] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-43a4d39b-381a-45ec-92ec-71f7e7320af4 req-3e629af5-ec6c-4f7b-8dd9-ec5252538c1e service nova] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-43a4d39b-381a-45ec-92ec-71f7e7320af4 req-3e629af5-ec6c-4f7b-8dd9-ec5252538c1e service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] No waiting events found dispatching network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:30:43 user nova-compute[72874]: WARNING nova.compute.manager [req-43a4d39b-381a-45ec-92ec-71f7e7320af4 req-3e629af5-ec6c-4f7b-8dd9-ec5252538c1e service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received unexpected event network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a for instance with vm_state active and task_state rescuing.
Aug 17 18:30:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-43a4d39b-381a-45ec-92ec-71f7e7320af4 req-3e629af5-ec6c-4f7b-8dd9-ec5252538c1e service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received event network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:30:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-43a4d39b-381a-45ec-92ec-71f7e7320af4 req-3e629af5-ec6c-4f7b-8dd9-ec5252538c1e service nova] Acquiring lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-43a4d39b-381a-45ec-92ec-71f7e7320af4 req-3e629af5-ec6c-4f7b-8dd9-ec5252538c1e service nova] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-43a4d39b-381a-45ec-92ec-71f7e7320af4 req-3e629af5-ec6c-4f7b-8dd9-ec5252538c1e service nova] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-43a4d39b-381a-45ec-92ec-71f7e7320af4 req-3e629af5-ec6c-4f7b-8dd9-ec5252538c1e service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] No waiting events found dispatching network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:30:43 user nova-compute[72874]: WARNING nova.compute.manager [req-43a4d39b-381a-45ec-92ec-71f7e7320af4 req-3e629af5-ec6c-4f7b-8dd9-ec5252538c1e service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received unexpected event network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a for instance with vm_state active and task_state rescuing.
Aug 17 18:30:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-de0b85cc-2a2c-4fec-9b19-5e27079b9c5b req-b2149a93-411a-4d7d-a06f-9d06af9bffcf service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received event network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-de0b85cc-2a2c-4fec-9b19-5e27079b9c5b req-b2149a93-411a-4d7d-a06f-9d06af9bffcf service nova] Acquiring lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-de0b85cc-2a2c-4fec-9b19-5e27079b9c5b req-b2149a93-411a-4d7d-a06f-9d06af9bffcf service nova] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-de0b85cc-2a2c-4fec-9b19-5e27079b9c5b req-b2149a93-411a-4d7d-a06f-9d06af9bffcf service nova] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-de0b85cc-2a2c-4fec-9b19-5e27079b9c5b req-b2149a93-411a-4d7d-a06f-9d06af9bffcf service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] No waiting events found dispatching network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:30:45 user nova-compute[72874]: WARNING nova.compute.manager [req-de0b85cc-2a2c-4fec-9b19-5e27079b9c5b req-b2149a93-411a-4d7d-a06f-9d06af9bffcf service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received unexpected event network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 for instance with vm_state building and task_state spawning.
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-de0b85cc-2a2c-4fec-9b19-5e27079b9c5b req-b2149a93-411a-4d7d-a06f-9d06af9bffcf service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received event network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-de0b85cc-2a2c-4fec-9b19-5e27079b9c5b req-b2149a93-411a-4d7d-a06f-9d06af9bffcf service nova] Acquiring lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-de0b85cc-2a2c-4fec-9b19-5e27079b9c5b req-b2149a93-411a-4d7d-a06f-9d06af9bffcf service nova] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-de0b85cc-2a2c-4fec-9b19-5e27079b9c5b req-b2149a93-411a-4d7d-a06f-9d06af9bffcf service nova] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-de0b85cc-2a2c-4fec-9b19-5e27079b9c5b req-b2149a93-411a-4d7d-a06f-9d06af9bffcf service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] No waiting events found dispatching network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:30:45 user nova-compute[72874]: WARNING nova.compute.manager [req-de0b85cc-2a2c-4fec-9b19-5e27079b9c5b req-b2149a93-411a-4d7d-a06f-9d06af9bffcf service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received unexpected event network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 for instance with vm_state building and task_state spawning.
Aug 17 18:30:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Removed pending event for 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 due to event {{(pid=72874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297045.6270065, 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:30:45 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] VM Resumed (Lifecycle Event)
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-28d179e1-fb6f-4ee2-9048-34af78c73647 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:30:45 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Instance spawned successfully.
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:30:45 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297045.6273127, 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:30:45 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] VM Started (Lifecycle Event)
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:30:45 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297045.6330607, 38df8d14-531a-42f3-8a4e-c53c1a80185f => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:30:45 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] VM Resumed (Lifecycle Event)
Aug 17 18:30:45 user nova-compute[72874]: INFO nova.compute.manager [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Took 7.49 seconds to spawn the instance on the hypervisor.
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:30:45 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297045.6453567, 38df8d14-531a-42f3-8a4e-c53c1a80185f => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:30:45 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] VM Started (Lifecycle Event)
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:30:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:30:45 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:30:45 user nova-compute[72874]: INFO nova.compute.manager [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Took 8.29 seconds to build instance.
Aug 17 18:30:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b9881b02-6e83-4b7a-a388-4a15b20b539b tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.393s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:30:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:30:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Acquiring lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Acquiring lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:31:07 user nova-compute[72874]: INFO nova.compute.manager [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Terminating instance
Aug 17 18:31:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:31:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-065c34c3-590a-4e5c-85f4-a6d71e0e722b req-7b23ae69-39f5-49f6-ba16-55d26a1299e3 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Received event network-vif-unplugged-65ab9470-0aab-47c5-88ee-bddd58e7d035 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:31:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-065c34c3-590a-4e5c-85f4-a6d71e0e722b req-7b23ae69-39f5-49f6-ba16-55d26a1299e3 service nova] Acquiring lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-065c34c3-590a-4e5c-85f4-a6d71e0e722b req-7b23ae69-39f5-49f6-ba16-55d26a1299e3 service nova] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-065c34c3-590a-4e5c-85f4-a6d71e0e722b req-7b23ae69-39f5-49f6-ba16-55d26a1299e3 service nova] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:31:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-065c34c3-590a-4e5c-85f4-a6d71e0e722b req-7b23ae69-39f5-49f6-ba16-55d26a1299e3 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] No waiting events found dispatching network-vif-unplugged-65ab9470-0aab-47c5-88ee-bddd58e7d035 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:31:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-065c34c3-590a-4e5c-85f4-a6d71e0e722b req-7b23ae69-39f5-49f6-ba16-55d26a1299e3 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Received event network-vif-unplugged-65ab9470-0aab-47c5-88ee-bddd58e7d035 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:31:08 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Instance destroyed successfully.
Aug 17 18:31:08 user nova-compute[72874]: DEBUG nova.objects.instance [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lazy-loading 'resources' on Instance uuid ce433d26-f10d-4d06-a0a2-96ae9bde4dff {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:31:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:27:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1216974258',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1216974258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1216974',id=25,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTEKmleU3vcdVlRLhdhEpogyL3MEP9Z0DpUJVxOZ0y+QIZ+kalU508aNC27HcEdM5RQ+I8A2IYlF6Hfm3W9vzfFEidUb17qtQiUBMfz5zqa125uZvKfycmZHPcbL3cVZA==',key_name='tempest-keypair-445470352',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:28:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='093218eed532483ebd64f6b97cdc1ee8',ramdisk_id='',reservation_id='r-s90thqc8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-945112022',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:28:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ac3941cb59b94fd8842ee7b9427dfb32',uuid=ce433d26-f10d-4d06-a0a2-96ae9bde4dff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "address": "fa:16:3e:c2:2d:43", "network": {"id": "cadafcef-708e-45df-b9f3-cfbdd35b71c7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-249057465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093218eed532483ebd64f6b97cdc1ee8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ab9470-0a", "ovs_interfaceid": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:31:08 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Converting VIF {"id": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "address": "fa:16:3e:c2:2d:43", "network": {"id": "cadafcef-708e-45df-b9f3-cfbdd35b71c7", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-249057465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "093218eed532483ebd64f6b97cdc1ee8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65ab9470-0a", "ovs_interfaceid": "65ab9470-0aab-47c5-88ee-bddd58e7d035", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:31:08 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:2d:43,bridge_name='br-int',has_traffic_filtering=True,id=65ab9470-0aab-47c5-88ee-bddd58e7d035,network=Network(cadafcef-708e-45df-b9f3-cfbdd35b71c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ab9470-0a') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:31:08 user nova-compute[72874]: DEBUG os_vif [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:2d:43,bridge_name='br-int',has_traffic_filtering=True,id=65ab9470-0aab-47c5-88ee-bddd58e7d035,network=Network(cadafcef-708e-45df-b9f3-cfbdd35b71c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ab9470-0a') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:31:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65ab9470-0a, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:31:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:08 user nova-compute[72874]: INFO os_vif [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:2d:43,bridge_name='br-int',has_traffic_filtering=True,id=65ab9470-0aab-47c5-88ee-bddd58e7d035,network=Network(cadafcef-708e-45df-b9f3-cfbdd35b71c7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65ab9470-0a')
Aug 17 18:31:08 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Deleting instance files /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff_del
Aug 17 18:31:08 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Deletion of /opt/stack/data/nova/instances/ce433d26-f10d-4d06-a0a2-96ae9bde4dff_del complete
Aug 17 18:31:08 user nova-compute[72874]: INFO nova.compute.manager [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 17 18:31:08 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:31:08 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:31:08 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:31:09 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:31:09 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Took 1.29 seconds to deallocate network for instance.
Aug 17 18:31:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:09 user nova-compute[72874]: DEBUG nova.compute.manager [req-1748c29c-99ab-4ec9-8c5d-c463896ba914 req-819a5956-2db6-486f-8859-af738645bd34 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Received event network-vif-plugged-65ab9470-0aab-47c5-88ee-bddd58e7d035 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:31:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1748c29c-99ab-4ec9-8c5d-c463896ba914 req-819a5956-2db6-486f-8859-af738645bd34 service nova] Acquiring lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1748c29c-99ab-4ec9-8c5d-c463896ba914 req-819a5956-2db6-486f-8859-af738645bd34 service nova] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1748c29c-99ab-4ec9-8c5d-c463896ba914 req-819a5956-2db6-486f-8859-af738645bd34 service nova] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:31:09 user nova-compute[72874]: DEBUG nova.compute.manager [req-1748c29c-99ab-4ec9-8c5d-c463896ba914 req-819a5956-2db6-486f-8859-af738645bd34 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] No waiting events found dispatching network-vif-plugged-65ab9470-0aab-47c5-88ee-bddd58e7d035 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:31:09 user nova-compute[72874]: WARNING nova.compute.manager [req-1748c29c-99ab-4ec9-8c5d-c463896ba914 req-819a5956-2db6-486f-8859-af738645bd34 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Received unexpected event network-vif-plugged-65ab9470-0aab-47c5-88ee-bddd58e7d035 for instance with vm_state deleted and task_state None.
Aug 17 18:31:09 user nova-compute[72874]: DEBUG nova.compute.manager [req-1748c29c-99ab-4ec9-8c5d-c463896ba914 req-819a5956-2db6-486f-8859-af738645bd34 service nova] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Received event network-vif-deleted-65ab9470-0aab-47c5-88ee-bddd58e7d035 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:31:10 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:31:10 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:31:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:31:10 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Deleted allocations for instance ce433d26-f10d-4d06-a0a2-96ae9bde4dff
Aug 17 18:31:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9bee0179-c960-419d-8141-78a5a087100c tempest-TestServerVolumeAttachScenarioOldVersion-945112022 tempest-TestServerVolumeAttachScenarioOldVersion-945112022-project-member] Lock "ce433d26-f10d-4d06-a0a2-96ae9bde4dff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.934s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:31:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:19 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:31:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:31:19 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:31:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.266s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.274s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:31:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:31:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297068.2233741, ce433d26-f10d-4d06-a0a2-96ae9bde4dff => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:31:23 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] VM Stopped (Lifecycle Event)
Aug 17 18:31:23 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:31:23 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7359MB free_disk=25.13147735595703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-21578807-55d3-4201-ad7d-f3642bb9566c None None] [instance: ce433d26-f10d-4d06-a0a2-96ae9bde4dff] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Applying migration context for instance f5760c65-a9c0-4997-8db3-04c1b4095ac5 as it has an incoming, in-progress migration 236dca91-651c-489f-9c85-a636ce006bf0. Migration status is finished {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 18:31:23 user nova-compute[72874]: INFO nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Updating resource usage from migration 236dca91-651c-489f-9c85-a636ce006bf0
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2515d301-f1ff-42bd-b067-61713baf519a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 90997e0c-bbbf-493f-92f2-f310489eb6a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Migration 236dca91-651c-489f-9c85-a636ce006bf0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance f5760c65-a9c0-4997-8db3-04c1b4095ac5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 38df8d14-531a-42f3-8a4e-c53c1a80185f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:31:23 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:31:24 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:31:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.513s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:31:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:31:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:31:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:31:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:31:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:31:25 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:31:25 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Updating instance_info_cache with network_info: [{"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:31:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:31:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:31:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:31:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:31:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:31:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:31:27 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:31:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:31:29 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:31:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:31:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:31:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:31:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:31:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:31:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:31:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:34 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lazy-loading 'flavor' on Instance uuid 90997e0c-bbbf-493f-92f2-f310489eb6a6 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:31:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:35 user nova-compute[72874]: INFO nova.compute.manager [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Attaching volume d8d6b216-e692-48af-9f7f-aab43b9e4500 to /dev/vdb
Aug 17 18:31:35 user nova-compute[72874]: DEBUG os_brick.utils [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfa3592-f4ef-497e-a1a3-711951a14a4c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8184f7-6a04-4a96-a8d6-52af70d2a273]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0543e913-8267-44b8-af3c-a6a585ee50b0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a538acf-adcf-4008-b5f2-f3ce5a4387b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:31:35 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:31:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[96672939-e9ba-4072-9ae9-1c95ae935db8]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG os_brick.utils [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:31:35 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Updating existing volume attachment record: f9625da0-cd53-42bd-a2de-2a9ea1a9f3c6 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:31:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:31:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVEJOahu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:31:47 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:31:47 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:31:47 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cac4b3-4a27-4371-ba4c-3aa2887c3e90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:31:47 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb352e0-88f2-4d7e-a7b0-d3a3848b5d89]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500] added
Aug 17 18:31:47 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba2c8a3-dc15-4c73-933d-24098d13548c]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[35983ae2-6aca-4904-aaff-8b6096864897]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HVEJOahu {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HVEJOahu" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbad2ba5-3a08-4e5d-862e-8f58acf7b5c9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HVEJOahu'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc18e81-7823-4586-be5b-1c5663ac7481]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a7e535-bedd-4579-8c25-2d51f9e4abe3]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:31:47 user nova-compute[72874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:31:47 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:31:47 user nova-compute[72874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:31:47 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e828e590-dcd8-4974-bb79-518bbca345ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500, portal: 172.16.0.220,3260]
Aug 17 18:31:47 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500, portal: 172.16.0.220,3260] successful.
Aug 17 18:31:47 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7deda18-f3f9-48d0-80ee-29d8ce5da188]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[498b7b66-d411-4d63-8f27-e5b57c93ddde]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:31:47 user nova-compute[72874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:31:47 user nova-compute[72874]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 (non-flash)
Aug 17 18:31:47 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:31:47 user nova-compute[72874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:31:47 user nova-compute[72874]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 (non-flash)
Aug 17 18:31:47 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee3eb8d-966d-4122-af72-73ce336a4a6c]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:31:47 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVEJOahu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:31:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:31:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:31:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23165653834323265', 'path': '/dev/sdd'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:31:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165653834323265', 'path': '/dev/sdd'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:31:48 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lazy-loading 'flavor' on Instance uuid 90997e0c-bbbf-493f-92f2-f310489eb6a6 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:31:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:31:48 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:31:48 user nova-compute[72874]:   <source dev="/dev/sdd"/>
Aug 17 18:31:48 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:31:48 user nova-compute[72874]:   <serial>d8d6b216-e692-48af-9f7f-aab43b9e4500</serial>
Aug 17 18:31:48 user nova-compute[72874]: </disk>
Aug 17 18:31:48 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:31:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:31:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:31:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] No VIF found with MAC fa:16:3e:dc:cb:80, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:31:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0896055-6e37-4a12-beb0-c987bc59eabf tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.160s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:31:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-b6351f0f-20f5-4791-b656-d527fbc2cd36 req-ac436fdb-11cc-40db-9ff9-0958a60a9e3e service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-changed-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:31:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-b6351f0f-20f5-4791-b656-d527fbc2cd36 req-ac436fdb-11cc-40db-9ff9-0958a60a9e3e service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Refreshing instance network info cache due to event network-changed-a465b261-54fe-481e-8abe-be2a50aff00b. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:31:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b6351f0f-20f5-4791-b656-d527fbc2cd36 req-ac436fdb-11cc-40db-9ff9-0958a60a9e3e service nova] Acquiring lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:31:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b6351f0f-20f5-4791-b656-d527fbc2cd36 req-ac436fdb-11cc-40db-9ff9-0958a60a9e3e service nova] Acquired lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:31:52 user nova-compute[72874]: DEBUG nova.network.neutron [req-b6351f0f-20f5-4791-b656-d527fbc2cd36 req-ac436fdb-11cc-40db-9ff9-0958a60a9e3e service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Refreshing network info cache for port a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:31:53 user nova-compute[72874]: DEBUG nova.network.neutron [req-b6351f0f-20f5-4791-b656-d527fbc2cd36 req-ac436fdb-11cc-40db-9ff9-0958a60a9e3e service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Updated VIF entry in instance network info cache for port a465b261-54fe-481e-8abe-be2a50aff00b. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:31:53 user nova-compute[72874]: DEBUG nova.network.neutron [req-b6351f0f-20f5-4791-b656-d527fbc2cd36 req-ac436fdb-11cc-40db-9ff9-0958a60a9e3e service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Updating instance_info_cache with network_info: [{"id": "a465b261-54fe-481e-8abe-be2a50aff00b", "address": "fa:16:3e:dc:cb:80", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa465b261-54", "ovs_interfaceid": "a465b261-54fe-481e-8abe-be2a50aff00b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:31:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b6351f0f-20f5-4791-b656-d527fbc2cd36 req-ac436fdb-11cc-40db-9ff9-0958a60a9e3e service nova] Releasing lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:31:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-b6b8e5a6-2bef-4d2e-9bd8-ea2964fc4a1c req-92f82af3-2b78-4b7c-95ef-be8f30303359 service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-changed-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:31:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-b6b8e5a6-2bef-4d2e-9bd8-ea2964fc4a1c req-92f82af3-2b78-4b7c-95ef-be8f30303359 service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Refreshing instance network info cache due to event network-changed-a465b261-54fe-481e-8abe-be2a50aff00b. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:31:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b6b8e5a6-2bef-4d2e-9bd8-ea2964fc4a1c req-92f82af3-2b78-4b7c-95ef-be8f30303359 service nova] Acquiring lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:31:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b6b8e5a6-2bef-4d2e-9bd8-ea2964fc4a1c req-92f82af3-2b78-4b7c-95ef-be8f30303359 service nova] Acquired lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:31:54 user nova-compute[72874]: DEBUG nova.network.neutron [req-b6b8e5a6-2bef-4d2e-9bd8-ea2964fc4a1c req-92f82af3-2b78-4b7c-95ef-be8f30303359 service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Refreshing network info cache for port a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:31:55 user nova-compute[72874]: DEBUG nova.network.neutron [req-b6b8e5a6-2bef-4d2e-9bd8-ea2964fc4a1c req-92f82af3-2b78-4b7c-95ef-be8f30303359 service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Updated VIF entry in instance network info cache for port a465b261-54fe-481e-8abe-be2a50aff00b. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:31:55 user nova-compute[72874]: DEBUG nova.network.neutron [req-b6b8e5a6-2bef-4d2e-9bd8-ea2964fc4a1c req-92f82af3-2b78-4b7c-95ef-be8f30303359 service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Updating instance_info_cache with network_info: [{"id": "a465b261-54fe-481e-8abe-be2a50aff00b", "address": "fa:16:3e:dc:cb:80", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa465b261-54", "ovs_interfaceid": "a465b261-54fe-481e-8abe-be2a50aff00b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:31:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b6b8e5a6-2bef-4d2e-9bd8-ea2964fc4a1c req-92f82af3-2b78-4b7c-95ef-be8f30303359 service nova] Releasing lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:31:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9982a1b1-f730-4fc4-a947-f8f4ff9d2060 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9982a1b1-f730-4fc4-a947-f8f4ff9d2060 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:55 user nova-compute[72874]: INFO nova.compute.manager [None req-9982a1b1-f730-4fc4-a947-f8f4ff9d2060 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Rebooting instance
Aug 17 18:31:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9982a1b1-f730-4fc4-a947-f8f4ff9d2060 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:31:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9982a1b1-f730-4fc4-a947-f8f4ff9d2060 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquired lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:31:55 user nova-compute[72874]: DEBUG nova.network.neutron [None req-9982a1b1-f730-4fc4-a947-f8f4ff9d2060 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:31:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "4e7369e4-b052-436d-a65a-248742018ee4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "4e7369e4-b052-436d-a65a-248742018ee4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:31:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:56 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:31:56 user nova-compute[72874]: INFO nova.compute.claims [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Claim successful on node user
Aug 17 18:31:56 user nova-compute[72874]: DEBUG nova.network.neutron [None req-9982a1b1-f730-4fc4-a947-f8f4ff9d2060 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Updating instance_info_cache with network_info: [{"id": "a465b261-54fe-481e-8abe-be2a50aff00b", "address": "fa:16:3e:dc:cb:80", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa465b261-54", "ovs_interfaceid": "a465b261-54fe-481e-8abe-be2a50aff00b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:31:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9982a1b1-f730-4fc4-a947-f8f4ff9d2060 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Releasing lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:31:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9982a1b1-f730-4fc4-a947-f8f4ff9d2060 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:31:56 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:31:56 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:31:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:31:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:31:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:31:56 user nova-compute[72874]: DEBUG nova.network.neutron [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:31:56 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:31:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG nova.policy [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92dfb3e7d65a48209708e823cb8f7ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf2398b53784944bcd6b54c36d1fec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:31:57 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Creating image(s)
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "/opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "/opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.198s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk 1073741824" returned: 0 in 0.072s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Going to confirm migration 2 {{(pid=72874) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG nova.network.neutron [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Successfully created port: 20c1bb2a-0893-42d7-8f6a-f3e96128ed24 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.218s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquired lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG nova.network.neutron [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG nova.objects.instance [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'info_cache' on Instance uuid f5760c65-a9c0-4997-8db3-04c1b4095ac5 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Cannot resize image /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lazy-loading 'migration_context' on Instance uuid 4e7369e4-b052-436d-a65a-248742018ee4 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Ensure instance console log exists: /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:31:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.network.neutron [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Updating instance_info_cache with network_info: [{"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Releasing lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.objects.instance [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'migration_context' on Instance uuid f5760c65-a9c0-4997-8db3-04c1b4095ac5 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.network.neutron [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Successfully updated port: 20c1bb2a-0893-42d7-8f6a-f3e96128ed24 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "refresh_cache-4e7369e4-b052-436d-a65a-248742018ee4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquired lock "refresh_cache-4e7369e4-b052-436d-a65a-248742018ee4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.network.neutron [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-c529dd3b-a5ba-4a2f-9642-1f433a942a5f req-c8b8d051-c029-48cf-b1d4-5265304becbc service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Received event network-changed-20c1bb2a-0893-42d7-8f6a-f3e96128ed24 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-c529dd3b-a5ba-4a2f-9642-1f433a942a5f req-c8b8d051-c029-48cf-b1d4-5265304becbc service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Refreshing instance network info cache due to event network-changed-20c1bb2a-0893-42d7-8f6a-f3e96128ed24. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c529dd3b-a5ba-4a2f-9642-1f433a942a5f req-c8b8d051-c029-48cf-b1d4-5265304becbc service nova] Acquiring lock "refresh_cache-4e7369e4-b052-436d-a65a-248742018ee4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.network.neutron [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:31:59 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-9982a1b1-f730-4fc4-a947-f8f4ff9d2060 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Instance shutdown successfully.
Aug 17 18:31:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.514s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:31:59 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Deleted allocation for migration 236dca91-651c-489f-9c85-a636ce006bf0
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.network.neutron [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Updating instance_info_cache with network_info: [{"id": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "address": "fa:16:3e:07:12:4b", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c1bb2a-08", "ovs_interfaceid": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Releasing lock "refresh_cache-4e7369e4-b052-436d-a65a-248742018ee4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Instance network_info: |[{"id": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "address": "fa:16:3e:07:12:4b", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c1bb2a-08", "ovs_interfaceid": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c529dd3b-a5ba-4a2f-9642-1f433a942a5f req-c8b8d051-c029-48cf-b1d4-5265304becbc service nova] Acquired lock "refresh_cache-4e7369e4-b052-436d-a65a-248742018ee4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.network.neutron [req-c529dd3b-a5ba-4a2f-9642-1f433a942a5f req-c8b8d051-c029-48cf-b1d4-5265304becbc service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Refreshing network info cache for port 20c1bb2a-0893-42d7-8f6a-f3e96128ed24 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Start _get_guest_xml network_info=[{"id": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "address": "fa:16:3e:07:12:4b", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c1bb2a-08", "ovs_interfaceid": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:31:59 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:31:59 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:31:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f483772e-9e29-4f31-95b5-f3d49f6b8fb9 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.310s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:31:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-287001520',display_name='tempest-VolumesActionsTest-instance-287001520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-287001520',id=32,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baf2398b53784944bcd6b54c36d1fec8',ramdisk_id='',reservation_id='r-l0r9nuo3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-580827709',owner_user_name='tempest-VolumesActionsTest-580827709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:31:57Z,user_data=None,user_id='92dfb3e7d65a48209708e823cb8f7ff9',uuid=4e7369e4-b052-436d-a65a-248742018ee4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "address": "fa:16:3e:07:12:4b", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c1bb2a-08", "ovs_interfaceid": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Converting VIF {"id": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "address": "fa:16:3e:07:12:4b", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c1bb2a-08", "ovs_interfaceid": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:12:4b,bridge_name='br-int',has_traffic_filtering=True,id=20c1bb2a-0893-42d7-8f6a-f3e96128ed24,network=Network(a9f4937d-de4a-417a-adaf-55d95fe354db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20c1bb2a-08') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e7369e4-b052-436d-a65a-248742018ee4 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:31:59 user nova-compute[72874]:   <uuid>4e7369e4-b052-436d-a65a-248742018ee4</uuid>
Aug 17 18:31:59 user nova-compute[72874]:   <name>instance-00000020</name>
Aug 17 18:31:59 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:31:59 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:31:59 user nova-compute[72874]:   <metadata>
Aug 17 18:31:59 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:31:59 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:31:59 user nova-compute[72874]:       <nova:name>tempest-VolumesActionsTest-instance-287001520</nova:name>
Aug 17 18:31:59 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:31:59</nova:creationTime>
Aug 17 18:31:59 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:31:59 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:31:59 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:31:59 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:31:59 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:31:59 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:31:59 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:31:59 user nova-compute[72874]:       <nova:owner>
Aug 17 18:31:59 user nova-compute[72874]:         <nova:user uuid="92dfb3e7d65a48209708e823cb8f7ff9">tempest-VolumesActionsTest-580827709-project-member</nova:user>
Aug 17 18:31:59 user nova-compute[72874]:         <nova:project uuid="baf2398b53784944bcd6b54c36d1fec8">tempest-VolumesActionsTest-580827709</nova:project>
Aug 17 18:31:59 user nova-compute[72874]:       </nova:owner>
Aug 17 18:31:59 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:31:59 user nova-compute[72874]:       <nova:ports>
Aug 17 18:31:59 user nova-compute[72874]:         <nova:port uuid="20c1bb2a-0893-42d7-8f6a-f3e96128ed24">
Aug 17 18:31:59 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 18:31:59 user nova-compute[72874]:         </nova:port>
Aug 17 18:31:59 user nova-compute[72874]:       </nova:ports>
Aug 17 18:31:59 user nova-compute[72874]:     </nova:instance>
Aug 17 18:31:59 user nova-compute[72874]:   </metadata>
Aug 17 18:31:59 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:31:59 user nova-compute[72874]:     <system>
Aug 17 18:31:59 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:31:59 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:31:59 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:31:59 user nova-compute[72874]:       <entry name="serial">4e7369e4-b052-436d-a65a-248742018ee4</entry>
Aug 17 18:31:59 user nova-compute[72874]:       <entry name="uuid">4e7369e4-b052-436d-a65a-248742018ee4</entry>
Aug 17 18:31:59 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:31:59 user nova-compute[72874]:     </system>
Aug 17 18:31:59 user nova-compute[72874]:   </sysinfo>
Aug 17 18:31:59 user nova-compute[72874]:   <os>
Aug 17 18:31:59 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:31:59 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:31:59 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:31:59 user nova-compute[72874]:   </os>
Aug 17 18:31:59 user nova-compute[72874]:   <features>
Aug 17 18:31:59 user nova-compute[72874]:     <acpi/>
Aug 17 18:31:59 user nova-compute[72874]:     <apic/>
Aug 17 18:31:59 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:31:59 user nova-compute[72874]:   </features>
Aug 17 18:31:59 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:31:59 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:31:59 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:31:59 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:31:59 user nova-compute[72874]:   </clock>
Aug 17 18:31:59 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:31:59 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:31:59 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:31:59 user nova-compute[72874]:   </cpu>
Aug 17 18:31:59 user nova-compute[72874]:   <devices>
Aug 17 18:31:59 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:31:59 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:31:59 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk"/>
Aug 17 18:31:59 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:31:59 user nova-compute[72874]:     </disk>
Aug 17 18:31:59 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:31:59 user nova-compute[72874]:       <mac address="fa:16:3e:07:12:4b"/>
Aug 17 18:31:59 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:31:59 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:31:59 user nova-compute[72874]:       <target dev="tap20c1bb2a-08"/>
Aug 17 18:31:59 user nova-compute[72874]:     </interface>
Aug 17 18:31:59 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:31:59 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/console.log" append="off"/>
Aug 17 18:31:59 user nova-compute[72874]:     </serial>
Aug 17 18:31:59 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:31:59 user nova-compute[72874]:     <video>
Aug 17 18:31:59 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:31:59 user nova-compute[72874]:     </video>
Aug 17 18:31:59 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:31:59 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:31:59 user nova-compute[72874]:     </rng>
Aug 17 18:31:59 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:31:59 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:31:59 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:31:59 user nova-compute[72874]:     </memballoon>
Aug 17 18:31:59 user nova-compute[72874]:   </devices>
Aug 17 18:31:59 user nova-compute[72874]: </domain>
Aug 17 18:31:59 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:31:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-287001520',display_name='tempest-VolumesActionsTest-instance-287001520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-287001520',id=32,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baf2398b53784944bcd6b54c36d1fec8',ramdisk_id='',reservation_id='r-l0r9nuo3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-580827709',owner_user_name='tempest-VolumesActionsTest-580827709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:31:57Z,user_data=None,user_id='92dfb3e7d65a48209708e823cb8f7ff9',uuid=4e7369e4-b052-436d-a65a-248742018ee4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "address": "fa:16:3e:07:12:4b", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c1bb2a-08", "ovs_interfaceid": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Converting VIF {"id": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "address": "fa:16:3e:07:12:4b", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c1bb2a-08", "ovs_interfaceid": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:12:4b,bridge_name='br-int',has_traffic_filtering=True,id=20c1bb2a-0893-42d7-8f6a-f3e96128ed24,network=Network(a9f4937d-de4a-417a-adaf-55d95fe354db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20c1bb2a-08') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG os_vif [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:12:4b,bridge_name='br-int',has_traffic_filtering=True,id=20c1bb2a-0893-42d7-8f6a-f3e96128ed24,network=Network(a9f4937d-de4a-417a-adaf-55d95fe354db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20c1bb2a-08') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20c1bb2a-08, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20c1bb2a-08, col_values=(('external_ids', {'iface-id': '20c1bb2a-0893-42d7-8f6a-f3e96128ed24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:12:4b', 'vm-uuid': '4e7369e4-b052-436d-a65a-248742018ee4'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:31:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:00 user nova-compute[72874]: INFO os_vif [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:12:4b,bridge_name='br-int',has_traffic_filtering=True,id=20c1bb2a-0893-42d7-8f6a-f3e96128ed24,network=Network(a9f4937d-de4a-417a-adaf-55d95fe354db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20c1bb2a-08')
Aug 17 18:32:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:32:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] No VIF found with MAC fa:16:3e:07:12:4b, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:32:00 user nova-compute[72874]: DEBUG nova.network.neutron [req-c529dd3b-a5ba-4a2f-9642-1f433a942a5f req-c8b8d051-c029-48cf-b1d4-5265304becbc service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Updated VIF entry in instance network info cache for port 20c1bb2a-0893-42d7-8f6a-f3e96128ed24. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:32:00 user nova-compute[72874]: DEBUG nova.network.neutron [req-c529dd3b-a5ba-4a2f-9642-1f433a942a5f req-c8b8d051-c029-48cf-b1d4-5265304becbc service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Updating instance_info_cache with network_info: [{"id": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "address": "fa:16:3e:07:12:4b", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c1bb2a-08", "ovs_interfaceid": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:32:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c529dd3b-a5ba-4a2f-9642-1f433a942a5f req-c8b8d051-c029-48cf-b1d4-5265304becbc service nova] Releasing lock "refresh_cache-4e7369e4-b052-436d-a65a-248742018ee4" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:32:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-3a6e0c0e-cc87-4128-92cc-87245f170136 req-1e8d63ac-b8ff-4fb6-8452-86bb34e90dd9 service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-vif-unplugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:32:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3a6e0c0e-cc87-4128-92cc-87245f170136 req-1e8d63ac-b8ff-4fb6-8452-86bb34e90dd9 service nova] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3a6e0c0e-cc87-4128-92cc-87245f170136 req-1e8d63ac-b8ff-4fb6-8452-86bb34e90dd9 service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3a6e0c0e-cc87-4128-92cc-87245f170136 req-1e8d63ac-b8ff-4fb6-8452-86bb34e90dd9 service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-3a6e0c0e-cc87-4128-92cc-87245f170136 req-1e8d63ac-b8ff-4fb6-8452-86bb34e90dd9 service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] No waiting events found dispatching network-vif-unplugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:32:01 user nova-compute[72874]: WARNING nova.compute.manager [req-3a6e0c0e-cc87-4128-92cc-87245f170136 req-1e8d63ac-b8ff-4fb6-8452-86bb34e90dd9 service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received unexpected event network-vif-unplugged-a465b261-54fe-481e-8abe-be2a50aff00b for instance with vm_state active and task_state reboot_started.
Aug 17 18:32:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-3a6e0c0e-cc87-4128-92cc-87245f170136 req-1e8d63ac-b8ff-4fb6-8452-86bb34e90dd9 service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:32:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3a6e0c0e-cc87-4128-92cc-87245f170136 req-1e8d63ac-b8ff-4fb6-8452-86bb34e90dd9 service nova] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3a6e0c0e-cc87-4128-92cc-87245f170136 req-1e8d63ac-b8ff-4fb6-8452-86bb34e90dd9 service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3a6e0c0e-cc87-4128-92cc-87245f170136 req-1e8d63ac-b8ff-4fb6-8452-86bb34e90dd9 service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-3a6e0c0e-cc87-4128-92cc-87245f170136 req-1e8d63ac-b8ff-4fb6-8452-86bb34e90dd9 service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] No waiting events found dispatching network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:32:01 user nova-compute[72874]: WARNING nova.compute.manager [req-3a6e0c0e-cc87-4128-92cc-87245f170136 req-1e8d63ac-b8ff-4fb6-8452-86bb34e90dd9 service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received unexpected event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b for instance with vm_state active and task_state reboot_started.
Aug 17 18:32:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] No waiting events found dispatching network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:32:03 user nova-compute[72874]: WARNING nova.compute.manager [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received unexpected event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b for instance with vm_state active and task_state reboot_started.
Aug 17 18:32:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] No waiting events found dispatching network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:32:03 user nova-compute[72874]: WARNING nova.compute.manager [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received unexpected event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b for instance with vm_state active and task_state reboot_started.
Aug 17 18:32:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Received event network-vif-plugged-20c1bb2a-0893-42d7-8f6a-f3e96128ed24 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] Acquiring lock "4e7369e4-b052-436d-a65a-248742018ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] Lock "4e7369e4-b052-436d-a65a-248742018ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] Lock "4e7369e4-b052-436d-a65a-248742018ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] No waiting events found dispatching network-vif-plugged-20c1bb2a-0893-42d7-8f6a-f3e96128ed24 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:32:03 user nova-compute[72874]: WARNING nova.compute.manager [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Received unexpected event network-vif-plugged-20c1bb2a-0893-42d7-8f6a-f3e96128ed24 for instance with vm_state building and task_state spawning.
Aug 17 18:32:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Received event network-vif-plugged-20c1bb2a-0893-42d7-8f6a-f3e96128ed24 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] Acquiring lock "4e7369e4-b052-436d-a65a-248742018ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] Lock "4e7369e4-b052-436d-a65a-248742018ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] Lock "4e7369e4-b052-436d-a65a-248742018ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] No waiting events found dispatching network-vif-plugged-20c1bb2a-0893-42d7-8f6a-f3e96128ed24 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:32:03 user nova-compute[72874]: WARNING nova.compute.manager [req-d77d8a4c-c869-4d9e-809f-a6d5c0df206c req-406d2b7b-c7ad-4111-aa1b-546df7659d5e service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Received unexpected event network-vif-plugged-20c1bb2a-0893-42d7-8f6a-f3e96128ed24 for instance with vm_state building and task_state spawning.
Aug 17 18:32:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297124.8333263, 4e7369e4-b052-436d-a65a-248742018ee4 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:32:04 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] VM Resumed (Lifecycle Event)
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:32:04 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Instance spawned successfully.
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:32:04 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Instance running successfully.
Aug 17 18:32:04 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-9982a1b1-f730-4fc4-a947-f8f4ff9d2060 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Instance soft rebooted successfully.
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9982a1b1-f730-4fc4-a947-f8f4ff9d2060 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:32:04 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297124.8335187, 4e7369e4-b052-436d-a65a-248742018ee4 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:32:04 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] VM Started (Lifecycle Event)
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:32:04 user nova-compute[72874]: INFO nova.compute.manager [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Took 7.92 seconds to spawn the instance on the hypervisor.
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:32:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9982a1b1-f730-4fc4-a947-f8f4ff9d2060 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.168s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:04 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Removed pending event for 90997e0c-bbbf-493f-92f2-f310489eb6a6 due to event {{(pid=72874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 18:32:04 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297124.838635, 90997e0c-bbbf-493f-92f2-f310489eb6a6 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:32:05 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] VM Resumed (Lifecycle Event)
Aug 17 18:32:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:32:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:32:05 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297124.8392184, 90997e0c-bbbf-493f-92f2-f310489eb6a6 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:32:05 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] VM Started (Lifecycle Event)
Aug 17 18:32:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:32:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:32:05 user nova-compute[72874]: INFO nova.compute.manager [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Took 8.76 seconds to build instance.
Aug 17 18:32:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e07ac6a4-5d43-48c2-8cdb-0ae27787079a tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "4e7369e4-b052-436d-a65a-248742018ee4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.868s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:32:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:32:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:32:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:32:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:20 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:32:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:20 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:32:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:32:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:32:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:32:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:24 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:32:24 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7375MB free_disk=25.098567962646484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2515d301-f1ff-42bd-b067-61713baf519a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 90997e0c-bbbf-493f-92f2-f310489eb6a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance f5760c65-a9c0-4997-8db3-04c1b4095ac5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 38df8d14-531a-42f3-8a4e-c53c1a80185f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 4e7369e4-b052-436d-a65a-248742018ee4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] There are 0 instances to clean {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 18:32:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:26 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:32:26 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:32:26 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:32:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-2515d301-f1ff-42bd-b067-61713baf519a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:32:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-2515d301-f1ff-42bd-b067-61713baf519a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:32:26 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:32:27 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Updating instance_info_cache with network_info: [{"id": "8e92b898-61f1-4540-9618-69298f5be3c4", "address": "fa:16:3e:ad:d2:11", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e92b898-61", "ovs_interfaceid": "8e92b898-61f1-4540-9618-69298f5be3c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:32:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-2515d301-f1ff-42bd-b067-61713baf519a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:32:27 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:32:27 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:32:27 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:32:27 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:32:27 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:32:27 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:32:28 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:32:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:32:28 user nova-compute[72874]: INFO nova.compute.manager [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] instance snapshotting
Aug 17 18:32:28 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Beginning live snapshot process
Aug 17 18:32:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json -f qcow2 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json -f qcow2 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.197s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppzqzmv63/3050744d979d4a9bad6fefdb829a1164.delta 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppzqzmv63/3050744d979d4a9bad6fefdb829a1164.delta 1073741824" returned: 0 in 0.060s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:29 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 18:32:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:32:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:32:30 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 18:32:30 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:32:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppzqzmv63/3050744d979d4a9bad6fefdb829a1164.delta /opt/stack/data/nova/instances/snapshots/tmppzqzmv63/3050744d979d4a9bad6fefdb829a1164 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:32:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:32:31 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:32:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppzqzmv63/3050744d979d4a9bad6fefdb829a1164.delta /opt/stack/data/nova/instances/snapshots/tmppzqzmv63/3050744d979d4a9bad6fefdb829a1164" returned: 0 in 0.565s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:32:31 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Snapshot extracted, beginning image upload
Aug 17 18:32:34 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Snapshot image upload complete
Aug 17 18:32:34 user nova-compute[72874]: INFO nova.compute.manager [None req-7faa4a6c-6c32-4805-8730-ebd6e08f7079 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Took 5.25 seconds to snapshot the instance on the hypervisor.
Aug 17 18:32:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:36 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:32:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:32:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:32:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:32:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:32:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:32:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid b143e572-9116-4dc0-8fc3-ba586b290ddd {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid 9b638f7b-ba47-403f-be22-a65a39ed8438 {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid 2961b0b8-98d0-4ba5-a0fa-b719753589ea {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid 2515d301-f1ff-42bd-b067-61713baf519a {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid f5760c65-a9c0-4997-8db3-04c1b4095ac5 {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid b41da216-4183-404f-8896-58371c3ae61d {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid 90997e0c-bbbf-493f-92f2-f310489eb6a6 {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid 38df8d14-531a-42f3-8a4e-c53c1a80185f {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid 4e7369e4-b052-436d-a65a-248742018ee4 {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "b143e572-9116-4dc0-8fc3-ba586b290ddd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "9b638f7b-ba47-403f-be22-a65a39ed8438" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "2515d301-f1ff-42bd-b067-61713baf519a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "2515d301-f1ff-42bd-b067-61713baf519a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "b41da216-4183-404f-8896-58371c3ae61d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "38df8d14-531a-42f3-8a4e-c53c1a80185f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "4e7369e4-b052-436d-a65a-248742018ee4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "4e7369e4-b052-436d-a65a-248742018ee4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "2515d301-f1ff-42bd-b067-61713baf519a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "b41da216-4183-404f-8896-58371c3ae61d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "4e7369e4-b052-436d-a65a-248742018ee4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:32:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:32:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:32:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:32:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:32:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:32:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:33:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:33:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:33:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:33:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:33:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "2515d301-f1ff-42bd-b067-61713baf519a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "2515d301-f1ff-42bd-b067-61713baf519a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "2515d301-f1ff-42bd-b067-61713baf519a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:17 user nova-compute[72874]: INFO nova.compute.manager [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Terminating instance
Aug 17 18:33:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:33:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:17 user nova-compute[72874]: DEBUG nova.compute.manager [req-1afce545-596b-43f7-8a44-afe2a60c4579 req-4264f20f-561d-464a-b1cd-4cf45f7a38fa service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received event network-vif-unplugged-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1afce545-596b-43f7-8a44-afe2a60c4579 req-4264f20f-561d-464a-b1cd-4cf45f7a38fa service nova] Acquiring lock "2515d301-f1ff-42bd-b067-61713baf519a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1afce545-596b-43f7-8a44-afe2a60c4579 req-4264f20f-561d-464a-b1cd-4cf45f7a38fa service nova] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1afce545-596b-43f7-8a44-afe2a60c4579 req-4264f20f-561d-464a-b1cd-4cf45f7a38fa service nova] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:17 user nova-compute[72874]: DEBUG nova.compute.manager [req-1afce545-596b-43f7-8a44-afe2a60c4579 req-4264f20f-561d-464a-b1cd-4cf45f7a38fa service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] No waiting events found dispatching network-vif-unplugged-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:33:17 user nova-compute[72874]: DEBUG nova.compute.manager [req-1afce545-596b-43f7-8a44-afe2a60c4579 req-4264f20f-561d-464a-b1cd-4cf45f7a38fa service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received event network-vif-unplugged-8e92b898-61f1-4540-9618-69298f5be3c4 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:18 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Instance destroyed successfully.
Aug 17 18:33:18 user nova-compute[72874]: DEBUG nova.objects.instance [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'resources' on Instance uuid 2515d301-f1ff-42bd-b067-61713baf519a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1268676760',display_name='tempest-AttachVolumeNegativeTest-server-1268676760',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1268676760',id=26,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnHHesLvGXMM12XjUp6dTNI8uc0y80uB2Io6RJgJtIXssgJf50GCfnH9f39zgnIQcH5v19Dj9RL9cBYcFbw/bjScbSnmM+8xjIb+AMxrCJ6u+XxvUCojU3ZVPKAZEBNxA==',key_name='tempest-keypair-2054860192',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:28:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d44ed4bf46e4f6bb8d9f9255bfceded',ramdisk_id='',reservation_id='r-v7hnemkc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1092460488',owner_user_name='tempest-AttachVolumeNegativeTest-1092460488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:28:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eba99d36a842ca93af2d82be67dea1',uuid=2515d301-f1ff-42bd-b067-61713baf519a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e92b898-61f1-4540-9618-69298f5be3c4", "address": "fa:16:3e:ad:d2:11", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e92b898-61", "ovs_interfaceid": "8e92b898-61f1-4540-9618-69298f5be3c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converting VIF {"id": "8e92b898-61f1-4540-9618-69298f5be3c4", "address": "fa:16:3e:ad:d2:11", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e92b898-61", "ovs_interfaceid": "8e92b898-61f1-4540-9618-69298f5be3c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:d2:11,bridge_name='br-int',has_traffic_filtering=True,id=8e92b898-61f1-4540-9618-69298f5be3c4,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e92b898-61') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG os_vif [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:d2:11,bridge_name='br-int',has_traffic_filtering=True,id=8e92b898-61f1-4540-9618-69298f5be3c4,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e92b898-61') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e92b898-61, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:33:18 user nova-compute[72874]: INFO os_vif [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:d2:11,bridge_name='br-int',has_traffic_filtering=True,id=8e92b898-61f1-4540-9618-69298f5be3c4,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e92b898-61')
Aug 17 18:33:18 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Deleting instance files /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a_del
Aug 17 18:33:18 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Deletion of /opt/stack/data/nova/instances/2515d301-f1ff-42bd-b067-61713baf519a_del complete
Aug 17 18:33:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:18 user nova-compute[72874]: INFO nova.compute.manager [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 18:33:18 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:33:19 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Took 1.46 seconds to deallocate network for instance.
Aug 17 18:33:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received event network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] Acquiring lock "2515d301-f1ff-42bd-b067-61713baf519a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] No waiting events found dispatching network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:33:19 user nova-compute[72874]: WARNING nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received unexpected event network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 for instance with vm_state active and task_state deleting.
Aug 17 18:33:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received event network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] Acquiring lock "2515d301-f1ff-42bd-b067-61713baf519a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] No waiting events found dispatching network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:33:19 user nova-compute[72874]: WARNING nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received unexpected event network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 for instance with vm_state active and task_state deleting.
Aug 17 18:33:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received event network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] Acquiring lock "2515d301-f1ff-42bd-b067-61713baf519a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] No waiting events found dispatching network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:33:19 user nova-compute[72874]: WARNING nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received unexpected event network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 for instance with vm_state active and task_state deleting.
Aug 17 18:33:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received event network-vif-unplugged-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] Acquiring lock "2515d301-f1ff-42bd-b067-61713baf519a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] No waiting events found dispatching network-vif-unplugged-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received event network-vif-unplugged-8e92b898-61f1-4540-9618-69298f5be3c4 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received event network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] Acquiring lock "2515d301-f1ff-42bd-b067-61713baf519a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] Lock "2515d301-f1ff-42bd-b067-61713baf519a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] No waiting events found dispatching network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:33:19 user nova-compute[72874]: WARNING nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received unexpected event network-vif-plugged-8e92b898-61f1-4540-9618-69298f5be3c4 for instance with vm_state active and task_state deleting.
Aug 17 18:33:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Received event network-vif-deleted-8e92b898-61f1-4540-9618-69298f5be3c4 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:19 user nova-compute[72874]: INFO nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Neutron deleted interface 8e92b898-61f1-4540-9618-69298f5be3c4; detaching it from the instance and deleting it from the info cache
Aug 17 18:33:19 user nova-compute[72874]: DEBUG nova.network.neutron [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG nova.compute.manager [req-98d6a559-da6a-4442-ac9e-74e63b87bef4 req-a05760bf-9525-4215-aaf2-e350402448ba service nova] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Detach interface failed, port_id=8e92b898-61f1-4540-9618-69298f5be3c4, reason: Instance 2515d301-f1ff-42bd-b067-61713baf519a could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:20 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Refreshing inventories for resource provider b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 18:33:20 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Updating ProviderTree inventory for provider b677d836-b01b-4674-8972-53d526f1b5f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 18:33:20 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Updating inventory in ProviderTree for provider b677d836-b01b-4674-8972-53d526f1b5f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 18:33:20 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Refreshing aggregate associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, aggregates: None {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 18:33:20 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Refreshing trait associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, traits: HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 18:33:20 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:33:20 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:33:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.692s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:20 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Deleted allocations for instance 2515d301-f1ff-42bd-b067-61713baf519a
Aug 17 18:33:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ec9d05ad-638c-45d9-8a6f-939ceaf52250 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "2515d301-f1ff-42bd-b067-61713baf519a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.258s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:33:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:33:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:22 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:33:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:33:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:33:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:33:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:25 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:33:25 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:33:25 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7670MB free_disk=25.05779266357422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:33:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:26 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:33:26 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:33:26 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:33:26 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:33:26 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:33:26 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 90997e0c-bbbf-493f-92f2-f310489eb6a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:33:26 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance f5760c65-a9c0-4997-8db3-04c1b4095ac5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:33:26 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 38df8d14-531a-42f3-8a4e-c53c1a80185f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:33:26 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 4e7369e4-b052-436d-a65a-248742018ee4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:33:26 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:33:26 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:33:26 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:33:26 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:33:26 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:33:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.442s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:27 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:33:27 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:33:27 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:33:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:33:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:33:27 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:33:27 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Updating instance_info_cache with network_info: [{"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:33:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-f5760c65-a9c0-4997-8db3-04c1b4095ac5" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:33:27 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:33:27 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:33:27 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:33:27 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:33:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:33:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:33:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:33:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:33:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:29 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:33:33 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297198.1452386, 2515d301-f1ff-42bd-b067-61713baf519a => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:33:33 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] VM Stopped (Lifecycle Event)
Aug 17 18:33:33 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:33:33 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:33:33 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9f87195d-609b-4317-bc28-d2422652e2d8 None None] [instance: 2515d301-f1ff-42bd-b067-61713baf519a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:33:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:33:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:33:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:33:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:33:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:33 user nova-compute[72874]: INFO nova.compute.manager [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Rescuing
Aug 17 18:33:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:33:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquired lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:33:33 user nova-compute[72874]: DEBUG nova.network.neutron [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG nova.network.neutron [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Updating instance_info_cache with network_info: [{"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Releasing lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-b6e700a7-b5c3-4f08-871b-de8a3f32c74c req-d1eb2bbc-5497-4a8f-ad24-0e75b9fe2325 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-unplugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b6e700a7-b5c3-4f08-871b-de8a3f32c74c req-d1eb2bbc-5497-4a8f-ad24-0e75b9fe2325 service nova] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b6e700a7-b5c3-4f08-871b-de8a3f32c74c req-d1eb2bbc-5497-4a8f-ad24-0e75b9fe2325 service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b6e700a7-b5c3-4f08-871b-de8a3f32c74c req-d1eb2bbc-5497-4a8f-ad24-0e75b9fe2325 service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-b6e700a7-b5c3-4f08-871b-de8a3f32c74c req-d1eb2bbc-5497-4a8f-ad24-0e75b9fe2325 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] No waiting events found dispatching network-vif-unplugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:33:34 user nova-compute[72874]: WARNING nova.compute.manager [req-b6e700a7-b5c3-4f08-871b-de8a3f32c74c req-d1eb2bbc-5497-4a8f-ad24-0e75b9fe2325 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received unexpected event network-vif-unplugged-e30432ac-cf52-4ce4-a10a-70700297a63e for instance with vm_state active and task_state rescuing.
Aug 17 18:33:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:34 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: b41da216-4183-404f-8896-58371c3ae61d] Instance destroyed successfully.
Aug 17 18:33:34 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Attempting rescue
Aug 17 18:33:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72874) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Instance directory exists: not creating {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 18:33:34 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Creating image(s)
Aug 17 18:33:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "/opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "/opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "/opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG nova.objects.instance [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'trusted_certs' on Instance uuid b41da216-4183-404f-8896-58371c3ae61d {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.192s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk.rescue {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk.rescue" returned: 0 in 0.054s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.objects.instance [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'migration_context' on Instance uuid b41da216-4183-404f-8896-58371c3ae61d {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Start _get_guest_xml network_info=[{"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "vif_mac": "fa:16:3e:cd:cd:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.objects.instance [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'resources' on Instance uuid b41da216-4183-404f-8896-58371c3ae61d {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.objects.instance [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'numa_topology' on Instance uuid b41da216-4183-404f-8896-58371c3ae61d {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:33:35 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:33:35 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.objects.instance [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'vcpu_model' on Instance uuid b41da216-4183-404f-8896-58371c3ae61d {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-674035551',display_name='tempest-ServerRescueNegativeTestJSON-server-674035551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-674035551',id=28,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:28:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6287735c21fb4b43b3cbd9e0d742b0ec',ramdisk_id='',reservation_id='r-5o49sjrl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-717723449',owner_user_name='tempest-ServerRescueNegativeTestJSON-717723449-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:28:56Z,user_data=None,user_id='3143ae598e814e359466d90e74f9b00c',uuid=b41da216-4183-404f-8896-58371c3ae61d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "vif_mac": "fa:16:3e:cd:cd:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converting VIF {"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "vif_mac": "fa:16:3e:cd:cd:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cd:aa,bridge_name='br-int',has_traffic_filtering=True,id=e30432ac-cf52-4ce4-a10a-70700297a63e,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30432ac-cf') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.objects.instance [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'pci_devices' on Instance uuid b41da216-4183-404f-8896-58371c3ae61d {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:33:35 user nova-compute[72874]:   <uuid>b41da216-4183-404f-8896-58371c3ae61d</uuid>
Aug 17 18:33:35 user nova-compute[72874]:   <name>instance-0000001c</name>
Aug 17 18:33:35 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:33:35 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:33:35 user nova-compute[72874]:   <metadata>
Aug 17 18:33:35 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:33:35 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:33:35 user nova-compute[72874]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-674035551</nova:name>
Aug 17 18:33:35 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:33:35</nova:creationTime>
Aug 17 18:33:35 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:33:35 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:33:35 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:33:35 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:33:35 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:33:35 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:33:35 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:33:35 user nova-compute[72874]:       <nova:owner>
Aug 17 18:33:35 user nova-compute[72874]:         <nova:user uuid="3143ae598e814e359466d90e74f9b00c">tempest-ServerRescueNegativeTestJSON-717723449-project-member</nova:user>
Aug 17 18:33:35 user nova-compute[72874]:         <nova:project uuid="6287735c21fb4b43b3cbd9e0d742b0ec">tempest-ServerRescueNegativeTestJSON-717723449</nova:project>
Aug 17 18:33:35 user nova-compute[72874]:       </nova:owner>
Aug 17 18:33:35 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:33:35 user nova-compute[72874]:       <nova:ports>
Aug 17 18:33:35 user nova-compute[72874]:         <nova:port uuid="e30432ac-cf52-4ce4-a10a-70700297a63e">
Aug 17 18:33:35 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 18:33:35 user nova-compute[72874]:         </nova:port>
Aug 17 18:33:35 user nova-compute[72874]:       </nova:ports>
Aug 17 18:33:35 user nova-compute[72874]:     </nova:instance>
Aug 17 18:33:35 user nova-compute[72874]:   </metadata>
Aug 17 18:33:35 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:33:35 user nova-compute[72874]:     <system>
Aug 17 18:33:35 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:33:35 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:33:35 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:33:35 user nova-compute[72874]:       <entry name="serial">b41da216-4183-404f-8896-58371c3ae61d</entry>
Aug 17 18:33:35 user nova-compute[72874]:       <entry name="uuid">b41da216-4183-404f-8896-58371c3ae61d</entry>
Aug 17 18:33:35 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:33:35 user nova-compute[72874]:     </system>
Aug 17 18:33:35 user nova-compute[72874]:   </sysinfo>
Aug 17 18:33:35 user nova-compute[72874]:   <os>
Aug 17 18:33:35 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:33:35 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:33:35 user nova-compute[72874]:   </os>
Aug 17 18:33:35 user nova-compute[72874]:   <features>
Aug 17 18:33:35 user nova-compute[72874]:     <acpi/>
Aug 17 18:33:35 user nova-compute[72874]:     <apic/>
Aug 17 18:33:35 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:33:35 user nova-compute[72874]:   </features>
Aug 17 18:33:35 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:33:35 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:33:35 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:33:35 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:33:35 user nova-compute[72874]:   </clock>
Aug 17 18:33:35 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:33:35 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:33:35 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:33:35 user nova-compute[72874]:   </cpu>
Aug 17 18:33:35 user nova-compute[72874]:   <devices>
Aug 17 18:33:35 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:33:35 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:33:35 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk.rescue"/>
Aug 17 18:33:35 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:33:35 user nova-compute[72874]:     </disk>
Aug 17 18:33:35 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:33:35 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:33:35 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk"/>
Aug 17 18:33:35 user nova-compute[72874]:       <target dev="vdb" bus="virtio"/>
Aug 17 18:33:35 user nova-compute[72874]:     </disk>
Aug 17 18:33:35 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:33:35 user nova-compute[72874]:       <mac address="fa:16:3e:cd:cd:aa"/>
Aug 17 18:33:35 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:33:35 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:33:35 user nova-compute[72874]:       <target dev="tape30432ac-cf"/>
Aug 17 18:33:35 user nova-compute[72874]:     </interface>
Aug 17 18:33:35 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:33:35 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/console.log" append="off"/>
Aug 17 18:33:35 user nova-compute[72874]:     </serial>
Aug 17 18:33:35 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:33:35 user nova-compute[72874]:     <video>
Aug 17 18:33:35 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:33:35 user nova-compute[72874]:     </video>
Aug 17 18:33:35 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:33:35 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:33:35 user nova-compute[72874]:     </rng>
Aug 17 18:33:35 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:33:35 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:33:35 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:33:35 user nova-compute[72874]:     </memballoon>
Aug 17 18:33:35 user nova-compute[72874]:   </devices>
Aug 17 18:33:35 user nova-compute[72874]: </domain>
Aug 17 18:33:35 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:33:35 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: b41da216-4183-404f-8896-58371c3ae61d] Instance destroyed successfully.
Aug 17 18:33:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:33:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No VIF found with MAC fa:16:3e:cd:cd:aa, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:33:36 user nova-compute[72874]: INFO nova.compute.claims [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Claim successful on node user
Aug 17 18:33:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] No waiting events found dispatching network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:33:36 user nova-compute[72874]: WARNING nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received unexpected event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e for instance with vm_state active and task_state rescuing.
Aug 17 18:33:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] No waiting events found dispatching network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:33:36 user nova-compute[72874]: WARNING nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received unexpected event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e for instance with vm_state active and task_state rescuing.
Aug 17 18:33:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] No waiting events found dispatching network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:33:36 user nova-compute[72874]: WARNING nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received unexpected event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e for instance with vm_state active and task_state rescuing.
Aug 17 18:33:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-unplugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] No waiting events found dispatching network-vif-unplugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:33:36 user nova-compute[72874]: WARNING nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received unexpected event network-vif-unplugged-e30432ac-cf52-4ce4-a10a-70700297a63e for instance with vm_state active and task_state rescuing.
Aug 17 18:33:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] No waiting events found dispatching network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:33:36 user nova-compute[72874]: WARNING nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received unexpected event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e for instance with vm_state active and task_state rescuing.
Aug 17 18:33:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] No waiting events found dispatching network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:33:36 user nova-compute[72874]: WARNING nova.compute.manager [req-30abcdfd-3b13-4210-bcba-54fd3f619f27 req-0a8cc4f9-39eb-4a68-8cec-3b8d4377888e service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received unexpected event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e for instance with vm_state active and task_state rescuing.
Aug 17 18:33:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:37 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:33:37 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:33:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:33:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:33:37 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:33:37 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:33:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:33:37 user nova-compute[72874]: INFO nova.virt.block_device [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Booting with volume-backed-image 7fe37517-c232-4d7a-939d-c3edde21bc31 at /dev/vda
Aug 17 18:33:37 user nova-compute[72874]: DEBUG nova.policy [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd13289795c8b4991a9cf6bb2880ad6ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a550f3591d1347bf8b9fb4d3e90b8aad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:33:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:38 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Successfully created port: d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:33:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Removed pending event for b41da216-4183-404f-8896-58371c3ae61d due to event {{(pid=72874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 18:33:38 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297218.8973947, b41da216-4183-404f-8896-58371c3ae61d => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:33:38 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] VM Resumed (Lifecycle Event)
Aug 17 18:33:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-15c97413-9176-407a-9a0a-a43fb3dfd0c5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:33:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:33:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:33:38 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 18:33:38 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297218.898665, b41da216-4183-404f-8896-58371c3ae61d => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:33:38 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] VM Started (Lifecycle Event)
Aug 17 18:33:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:33:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-bafe86df-9c2e-4e88-83fc-152a025b0c41 req-eb66c795-677a-4acf-bd7d-93f33b9a3316 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bafe86df-9c2e-4e88-83fc-152a025b0c41 req-eb66c795-677a-4acf-bd7d-93f33b9a3316 service nova] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bafe86df-9c2e-4e88-83fc-152a025b0c41 req-eb66c795-677a-4acf-bd7d-93f33b9a3316 service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bafe86df-9c2e-4e88-83fc-152a025b0c41 req-eb66c795-677a-4acf-bd7d-93f33b9a3316 service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-bafe86df-9c2e-4e88-83fc-152a025b0c41 req-eb66c795-677a-4acf-bd7d-93f33b9a3316 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] No waiting events found dispatching network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:33:38 user nova-compute[72874]: WARNING nova.compute.manager [req-bafe86df-9c2e-4e88-83fc-152a025b0c41 req-eb66c795-677a-4acf-bd7d-93f33b9a3316 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received unexpected event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e for instance with vm_state active and task_state rescuing.
Aug 17 18:33:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:33:39 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Successfully updated port: d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:33:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "refresh_cache-1bf20bb4-44a7-463d-bf0d-3ba449399b2c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:33:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquired lock "refresh_cache-1bf20bb4-44a7-463d-bf0d-3ba449399b2c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:33:39 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:33:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-923f33ce-0748-42c7-9735-2fadd6215468 req-661eeb27-137d-44b5-a722-486dd2646a2e service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received event network-changed-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-923f33ce-0748-42c7-9735-2fadd6215468 req-661eeb27-137d-44b5-a722-486dd2646a2e service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Refreshing instance network info cache due to event network-changed-d701e5dd-9a42-44c9-8ca1-c645f382220a. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:33:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-923f33ce-0748-42c7-9735-2fadd6215468 req-661eeb27-137d-44b5-a722-486dd2646a2e service nova] Acquiring lock "refresh_cache-1bf20bb4-44a7-463d-bf0d-3ba449399b2c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:33:39 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:33:39 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Updating instance_info_cache with network_info: [{"id": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "address": "fa:16:3e:f3:05:5e", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd701e5dd-9a", "ovs_interfaceid": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:33:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Releasing lock "refresh_cache-1bf20bb4-44a7-463d-bf0d-3ba449399b2c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:33:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Instance network_info: |[{"id": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "address": "fa:16:3e:f3:05:5e", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd701e5dd-9a", "ovs_interfaceid": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:33:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-923f33ce-0748-42c7-9735-2fadd6215468 req-661eeb27-137d-44b5-a722-486dd2646a2e service nova] Acquired lock "refresh_cache-1bf20bb4-44a7-463d-bf0d-3ba449399b2c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:33:39 user nova-compute[72874]: DEBUG nova.network.neutron [req-923f33ce-0748-42c7-9735-2fadd6215468 req-661eeb27-137d-44b5-a722-486dd2646a2e service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Refreshing network info cache for port d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:33:39 user nova-compute[72874]: DEBUG nova.network.neutron [req-923f33ce-0748-42c7-9735-2fadd6215468 req-661eeb27-137d-44b5-a722-486dd2646a2e service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Updated VIF entry in instance network info cache for port d701e5dd-9a42-44c9-8ca1-c645f382220a. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:33:39 user nova-compute[72874]: DEBUG nova.network.neutron [req-923f33ce-0748-42c7-9735-2fadd6215468 req-661eeb27-137d-44b5-a722-486dd2646a2e service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Updating instance_info_cache with network_info: [{"id": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "address": "fa:16:3e:f3:05:5e", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd701e5dd-9a", "ovs_interfaceid": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:33:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-923f33ce-0748-42c7-9735-2fadd6215468 req-661eeb27-137d-44b5-a722-486dd2646a2e service nova] Releasing lock "refresh_cache-1bf20bb4-44a7-463d-bf0d-3ba449399b2c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:33:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "4e7369e4-b052-436d-a65a-248742018ee4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "4e7369e4-b052-436d-a65a-248742018ee4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "4e7369e4-b052-436d-a65a-248742018ee4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "4e7369e4-b052-436d-a65a-248742018ee4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "4e7369e4-b052-436d-a65a-248742018ee4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:47 user nova-compute[72874]: INFO nova.compute.manager [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Terminating instance
Aug 17 18:33:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG nova.compute.manager [req-e1ade3bc-a938-45ca-b723-3ef4265af826 req-d181c186-cc30-44cc-ac31-10435ea9c5fb service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Received event network-vif-unplugged-20c1bb2a-0893-42d7-8f6a-f3e96128ed24 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e1ade3bc-a938-45ca-b723-3ef4265af826 req-d181c186-cc30-44cc-ac31-10435ea9c5fb service nova] Acquiring lock "4e7369e4-b052-436d-a65a-248742018ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e1ade3bc-a938-45ca-b723-3ef4265af826 req-d181c186-cc30-44cc-ac31-10435ea9c5fb service nova] Lock "4e7369e4-b052-436d-a65a-248742018ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e1ade3bc-a938-45ca-b723-3ef4265af826 req-d181c186-cc30-44cc-ac31-10435ea9c5fb service nova] Lock "4e7369e4-b052-436d-a65a-248742018ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG nova.compute.manager [req-e1ade3bc-a938-45ca-b723-3ef4265af826 req-d181c186-cc30-44cc-ac31-10435ea9c5fb service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] No waiting events found dispatching network-vif-unplugged-20c1bb2a-0893-42d7-8f6a-f3e96128ed24 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG nova.compute.manager [req-e1ade3bc-a938-45ca-b723-3ef4265af826 req-d181c186-cc30-44cc-ac31-10435ea9c5fb service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Received event network-vif-unplugged-20c1bb2a-0893-42d7-8f6a-f3e96128ed24 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:33:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Instance destroyed successfully.
Aug 17 18:33:47 user nova-compute[72874]: DEBUG nova.objects.instance [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lazy-loading 'resources' on Instance uuid 4e7369e4-b052-436d-a65a-248742018ee4 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:31:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-287001520',display_name='tempest-VolumesActionsTest-instance-287001520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-287001520',id=32,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:32:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='baf2398b53784944bcd6b54c36d1fec8',ramdisk_id='',reservation_id='r-l0r9nuo3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-580827709',owner_user_name='tempest-VolumesActionsTest-580827709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:32:05Z,user_data=None,user_id='92dfb3e7d65a48209708e823cb8f7ff9',uuid=4e7369e4-b052-436d-a65a-248742018ee4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "address": "fa:16:3e:07:12:4b", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c1bb2a-08", "ovs_interfaceid": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Converting VIF {"id": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "address": "fa:16:3e:07:12:4b", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20c1bb2a-08", "ovs_interfaceid": "20c1bb2a-0893-42d7-8f6a-f3e96128ed24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:12:4b,bridge_name='br-int',has_traffic_filtering=True,id=20c1bb2a-0893-42d7-8f6a-f3e96128ed24,network=Network(a9f4937d-de4a-417a-adaf-55d95fe354db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20c1bb2a-08') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG os_vif [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:12:4b,bridge_name='br-int',has_traffic_filtering=True,id=20c1bb2a-0893-42d7-8f6a-f3e96128ed24,network=Network(a9f4937d-de4a-417a-adaf-55d95fe354db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20c1bb2a-08') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20c1bb2a-08, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:47 user nova-compute[72874]: INFO os_vif [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:12:4b,bridge_name='br-int',has_traffic_filtering=True,id=20c1bb2a-0893-42d7-8f6a-f3e96128ed24,network=Network(a9f4937d-de4a-417a-adaf-55d95fe354db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20c1bb2a-08')
Aug 17 18:33:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Deleting instance files /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4_del
Aug 17 18:33:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Deletion of /opt/stack/data/nova/instances/4e7369e4-b052-436d-a65a-248742018ee4_del complete
Aug 17 18:33:47 user nova-compute[72874]: INFO nova.compute.manager [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 17 18:33:47 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:33:47 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-392e065c-ee2c-451c-bcc6-824bc458104d req-a1d8c71a-7383-4bdb-9fe7-32f3d571ce5f service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-changed-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-392e065c-ee2c-451c-bcc6-824bc458104d req-a1d8c71a-7383-4bdb-9fe7-32f3d571ce5f service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Refreshing instance network info cache due to event network-changed-a465b261-54fe-481e-8abe-be2a50aff00b. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-392e065c-ee2c-451c-bcc6-824bc458104d req-a1d8c71a-7383-4bdb-9fe7-32f3d571ce5f service nova] Acquiring lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-392e065c-ee2c-451c-bcc6-824bc458104d req-a1d8c71a-7383-4bdb-9fe7-32f3d571ce5f service nova] Acquired lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-392e065c-ee2c-451c-bcc6-824bc458104d req-a1d8c71a-7383-4bdb-9fe7-32f3d571ce5f service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Refreshing network info cache for port a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG os_brick.utils [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[556d8f90-b6fa-423a-815e-0949eb9e4eb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1616b97f-f3b7-4ceb-b9c7-62339d33e799]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab5fb34-6a18-480b-a656-235ec1ed7641]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[508c8895-51b8-40a0-bf53-5937c0d190bd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:33:48 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db40d95-d645-45f0-9b25-895a8f9ca9a1]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG os_brick.utils [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Updating existing volume attachment record: 64bb709f-1771-4634-99f3-950461b66b47 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:33:48 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Took 0.87 seconds to deallocate network for instance.
Aug 17 18:33:48 user nova-compute[72874]: INFO nova.compute.manager [None req-5aaee659-bc16-41a0-bc63-fa608865d062 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Get console output
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-392e065c-ee2c-451c-bcc6-824bc458104d req-a1d8c71a-7383-4bdb-9fe7-32f3d571ce5f service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Updated VIF entry in instance network info cache for port a465b261-54fe-481e-8abe-be2a50aff00b. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-392e065c-ee2c-451c-bcc6-824bc458104d req-a1d8c71a-7383-4bdb-9fe7-32f3d571ce5f service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Updating instance_info_cache with network_info: [{"id": "a465b261-54fe-481e-8abe-be2a50aff00b", "address": "fa:16:3e:dc:cb:80", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa465b261-54", "ovs_interfaceid": "a465b261-54fe-481e-8abe-be2a50aff00b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-392e065c-ee2c-451c-bcc6-824bc458104d req-a1d8c71a-7383-4bdb-9fe7-32f3d571ce5f service nova] Releasing lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:33:48 user nova-compute[72874]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 17 18:33:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-615f85b8-4ca0-4f67-b062-331edb045c59 req-20d308e8-8204-42ad-9431-d07827c859ee service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-changed-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-615f85b8-4ca0-4f67-b062-331edb045c59 req-20d308e8-8204-42ad-9431-d07827c859ee service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Refreshing instance network info cache due to event network-changed-a465b261-54fe-481e-8abe-be2a50aff00b. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-615f85b8-4ca0-4f67-b062-331edb045c59 req-20d308e8-8204-42ad-9431-d07827c859ee service nova] Acquiring lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-615f85b8-4ca0-4f67-b062-331edb045c59 req-20d308e8-8204-42ad-9431-d07827c859ee service nova] Acquired lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:33:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-615f85b8-4ca0-4f67-b062-331edb045c59 req-20d308e8-8204-42ad-9431-d07827c859ee service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Refreshing network info cache for port a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.443s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:49 user nova-compute[72874]: INFO nova.compute.manager [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Detaching volume d8d6b216-e692-48af-9f7f-aab43b9e4500
Aug 17 18:33:49 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Deleted allocations for instance 4e7369e4-b052-436d-a65a-248742018ee4
Aug 17 18:33:49 user nova-compute[72874]: INFO nova.virt.block_device [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Attempting to driver detach volume d8d6b216-e692-48af-9f7f-aab43b9e4500 from mountpoint /dev/vdb
Aug 17 18:33:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Attempting to detach device vdb from instance 90997e0c-bbbf-493f-92f2-f310489eb6a6 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:33:49 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:33:49 user nova-compute[72874]:   <source dev="/dev/sdd"/>
Aug 17 18:33:49 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:33:49 user nova-compute[72874]:   <serial>d8d6b216-e692-48af-9f7f-aab43b9e4500</serial>
Aug 17 18:33:49 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:33:49 user nova-compute[72874]: </disk>
Aug 17 18:33:49 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:33:49 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Successfully detached device vdb from instance 90997e0c-bbbf-493f-92f2-f310489eb6a6 from the persistent domain config.
Aug 17 18:33:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 90997e0c-bbbf-493f-92f2-f310489eb6a6 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:33:49 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:33:49 user nova-compute[72874]:   <source dev="/dev/sdd"/>
Aug 17 18:33:49 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:33:49 user nova-compute[72874]:   <serial>d8d6b216-e692-48af-9f7f-aab43b9e4500</serial>
Aug 17 18:33:49 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:33:49 user nova-compute[72874]: </disk>
Aug 17 18:33:49 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-007e9ade-4169-4da4-99cc-0af1a1e96013 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "4e7369e4-b052-436d-a65a-248742018ee4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.261s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG nova.network.neutron [req-615f85b8-4ca0-4f67-b062-331edb045c59 req-20d308e8-8204-42ad-9431-d07827c859ee service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Updated VIF entry in instance network info cache for port a465b261-54fe-481e-8abe-be2a50aff00b. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG nova.network.neutron [req-615f85b8-4ca0-4f67-b062-331edb045c59 req-20d308e8-8204-42ad-9431-d07827c859ee service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Updating instance_info_cache with network_info: [{"id": "a465b261-54fe-481e-8abe-be2a50aff00b", "address": "fa:16:3e:dc:cb:80", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa465b261-54", "ovs_interfaceid": "a465b261-54fe-481e-8abe-be2a50aff00b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-5e640f57-8226-4cd1-b736-0353faa24a72 req-073530a3-4845-42df-ae2a-de8e9d651545 service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Received event network-vif-plugged-20c1bb2a-0893-42d7-8f6a-f3e96128ed24 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5e640f57-8226-4cd1-b736-0353faa24a72 req-073530a3-4845-42df-ae2a-de8e9d651545 service nova] Acquiring lock "4e7369e4-b052-436d-a65a-248742018ee4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5e640f57-8226-4cd1-b736-0353faa24a72 req-073530a3-4845-42df-ae2a-de8e9d651545 service nova] Lock "4e7369e4-b052-436d-a65a-248742018ee4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5e640f57-8226-4cd1-b736-0353faa24a72 req-073530a3-4845-42df-ae2a-de8e9d651545 service nova] Lock "4e7369e4-b052-436d-a65a-248742018ee4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-5e640f57-8226-4cd1-b736-0353faa24a72 req-073530a3-4845-42df-ae2a-de8e9d651545 service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] No waiting events found dispatching network-vif-plugged-20c1bb2a-0893-42d7-8f6a-f3e96128ed24 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:33:49 user nova-compute[72874]: WARNING nova.compute.manager [req-5e640f57-8226-4cd1-b736-0353faa24a72 req-073530a3-4845-42df-ae2a-de8e9d651545 service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Received unexpected event network-vif-plugged-20c1bb2a-0893-42d7-8f6a-f3e96128ed24 for instance with vm_state deleted and task_state None.
Aug 17 18:33:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-5e640f57-8226-4cd1-b736-0353faa24a72 req-073530a3-4845-42df-ae2a-de8e9d651545 service nova] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Received event network-vif-deleted-20c1bb2a-0893-42d7-8f6a-f3e96128ed24 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-615f85b8-4ca0-4f67-b062-331edb045c59 req-20d308e8-8204-42ad-9431-d07827c859ee service nova] Releasing lock "refresh_cache-90997e0c-bbbf-493f-92f2-f310489eb6a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692297229.7419903, 90997e0c-bbbf-493f-92f2-f310489eb6a6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 90997e0c-bbbf-493f-92f2-f310489eb6a6 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:33:49 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Successfully detached device vdb from instance 90997e0c-bbbf-493f-92f2-f310489eb6a6 from the live domain config.
Aug 17 18:33:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HVEJOahu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:33:49 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:33:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4655e816-72b9-43ee-b794-8fd5a2b32de9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa37ec2a-59c9-4e8f-8a5d-0d5709bfce18]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:33:49 user nova-compute[72874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:33:49 user nova-compute[72874]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 (non-flash)
Aug 17 18:33:49 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:33:49 user nova-compute[72874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:33:49 user nova-compute[72874]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 (non-flash)
Aug 17 18:33:49 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a074ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500'): ({'sdd'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Removing single pathed devices sdd {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf59cfc-dbbf-4b51-98f2-7eb4c5eabaa9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ca8d79-4987-4da3-a27c-ecb9040df880]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Flushing IO for device /dev/sdd {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac70bbf7-5e65-4ca7-ba07-389873ef4076]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[60173168-3141-4de0-8e16-9dacd8c8f97a]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad890a84-bfd1-4e70-9e83-806925c2b19f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:33:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8af0ee-f9a2-43ff-96b8-9817b999fc27]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500, portal: 172.16.0.220,3260]
Aug 17 18:33:50 user nova-compute[72874]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500, portal: 172.16.0.220,3260] successful.
Aug 17 18:33:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:33:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8d6b216-e692-48af-9f7f-aab43b9e4500 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[819f6207-b701-4b87-bd84-4725ae18666e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:33:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:33:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] <== disconnect_volume: return (280ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:33:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:33:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:50 user nova-compute[72874]: DEBUG nova.objects.instance [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lazy-loading 'flavor' on Instance uuid 90997e0c-bbbf-493f-92f2-f310489eb6a6 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:33:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d20a1393-e3e1-4e22-a300-06c191522caa tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.710s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:33:59 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Creating image(s)
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Ensure instance console log exists: /opt/stack/data/nova/instances/1bf20bb4-44a7-463d-bf0d-3ba449399b2c/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Start _get_guest_xml network_info=[{"id": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "address": "fa:16:3e:f3:05:5e", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd701e5dd-9a", "ovs_interfaceid": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSgCdeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1bf20bb4-44a7-463d-bf0d-3ba449399b2c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef557e2d-85da-403e-ae95-b86bead13920', 'serial': 'ef557e2d-85da-403e-ae95-b86bead13920'}, 'delete_on_termination': False, 'attachment_id': '64bb709f-1771-4634-99f3-950461b66b47', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:33:59 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:33:59 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSgCdeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:33:59 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:33:59 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:33:59 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bf2cef-cd93-469f-875d-a082a728a464]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:33:59 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[87be5ce4-a50e-4127-a792-adf62f08a16f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920] added
Aug 17 18:33:59 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c9965f-e28a-47ab-9a42-56fc0791ddd5]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[41299e25-3ba0-45cc-ae38-d3afbeca8fe6]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BSgCdeQP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BSgCdeQP" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ea74bd-386b-430c-89ca-9e40f56b42eb]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BSgCdeQP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f12b9b-b79e-4096-848f-40166c06eb26]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f9f297-188f-49da-bdc6-d3b8b35a00d3]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:33:59 user nova-compute[72874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:33:59 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:33:59 user nova-compute[72874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:33:59 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae6c853-61e7-4900-81b2-e7414400de66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920, portal: 172.16.0.220,3260]
Aug 17 18:33:59 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920, portal: 172.16.0.220,3260] successful.
Aug 17 18:33:59 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d664bc-b5f1-481c-8c17-1be05bc30a92]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a87f02-0833-4b18-9343-8ee3c07a9193]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:33:59 user nova-compute[72874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:33:59 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:33:59 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:33:59 user nova-compute[72874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:33:59 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:33:59 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e5c4f3-4a65-492c-9d5d-92999d0616ba]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:33:59 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSgCdeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26135613133326139', 'path': '/dev/sdd'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135613133326139', 'path': '/dev/sdd'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1074554763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1074554763',id=33,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a550f3591d1347bf8b9fb4d3e90b8aad',ramdisk_id='',reservation_id='r-wa0950yp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-68498997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:33:37Z,user_data=None,user_id='d13289795c8b4991a9cf6bb2880ad6ef',uuid=1bf20bb4-44a7-463d-bf0d-3ba449399b2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "address": "fa:16:3e:f3:05:5e", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd701e5dd-9a", "ovs_interfaceid": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converting VIF {"id": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "address": "fa:16:3e:f3:05:5e", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd701e5dd-9a", "ovs_interfaceid": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:05:5e,bridge_name='br-int',has_traffic_filtering=True,id=d701e5dd-9a42-44c9-8ca1-c645f382220a,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd701e5dd-9a') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG nova.objects.instance [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bf20bb4-44a7-463d-bf0d-3ba449399b2c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:34:00 user nova-compute[72874]:   <uuid>1bf20bb4-44a7-463d-bf0d-3ba449399b2c</uuid>
Aug 17 18:34:00 user nova-compute[72874]:   <name>instance-00000021</name>
Aug 17 18:34:00 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:34:00 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:34:00 user nova-compute[72874]:   <metadata>
Aug 17 18:34:00 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:34:00 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:34:00 user nova-compute[72874]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1074554763</nova:name>
Aug 17 18:34:00 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:33:59</nova:creationTime>
Aug 17 18:34:00 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:34:00 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:34:00 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:34:00 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:34:00 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:34:00 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:34:00 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:34:00 user nova-compute[72874]:       <nova:owner>
Aug 17 18:34:00 user nova-compute[72874]:         <nova:user uuid="d13289795c8b4991a9cf6bb2880ad6ef">tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member</nova:user>
Aug 17 18:34:00 user nova-compute[72874]:         <nova:project uuid="a550f3591d1347bf8b9fb4d3e90b8aad">tempest-ServerBootFromVolumeStableRescueTest-68498997</nova:project>
Aug 17 18:34:00 user nova-compute[72874]:       </nova:owner>
Aug 17 18:34:00 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:34:00 user nova-compute[72874]:       <nova:ports>
Aug 17 18:34:00 user nova-compute[72874]:         <nova:port uuid="d701e5dd-9a42-44c9-8ca1-c645f382220a">
Aug 17 18:34:00 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 18:34:00 user nova-compute[72874]:         </nova:port>
Aug 17 18:34:00 user nova-compute[72874]:       </nova:ports>
Aug 17 18:34:00 user nova-compute[72874]:     </nova:instance>
Aug 17 18:34:00 user nova-compute[72874]:   </metadata>
Aug 17 18:34:00 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:34:00 user nova-compute[72874]:     <system>
Aug 17 18:34:00 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:34:00 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:34:00 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:34:00 user nova-compute[72874]:       <entry name="serial">1bf20bb4-44a7-463d-bf0d-3ba449399b2c</entry>
Aug 17 18:34:00 user nova-compute[72874]:       <entry name="uuid">1bf20bb4-44a7-463d-bf0d-3ba449399b2c</entry>
Aug 17 18:34:00 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:34:00 user nova-compute[72874]:     </system>
Aug 17 18:34:00 user nova-compute[72874]:   </sysinfo>
Aug 17 18:34:00 user nova-compute[72874]:   <os>
Aug 17 18:34:00 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:34:00 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:34:00 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:34:00 user nova-compute[72874]:   </os>
Aug 17 18:34:00 user nova-compute[72874]:   <features>
Aug 17 18:34:00 user nova-compute[72874]:     <acpi/>
Aug 17 18:34:00 user nova-compute[72874]:     <apic/>
Aug 17 18:34:00 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:34:00 user nova-compute[72874]:   </features>
Aug 17 18:34:00 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:34:00 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:34:00 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:34:00 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:34:00 user nova-compute[72874]:   </clock>
Aug 17 18:34:00 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:34:00 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:34:00 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:34:00 user nova-compute[72874]:   </cpu>
Aug 17 18:34:00 user nova-compute[72874]:   <devices>
Aug 17 18:34:00 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:34:00 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:34:00 user nova-compute[72874]:       <source dev="/dev/sdd"/>
Aug 17 18:34:00 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:34:00 user nova-compute[72874]:       <serial>ef557e2d-85da-403e-ae95-b86bead13920</serial>
Aug 17 18:34:00 user nova-compute[72874]:     </disk>
Aug 17 18:34:00 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:34:00 user nova-compute[72874]:       <mac address="fa:16:3e:f3:05:5e"/>
Aug 17 18:34:00 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:34:00 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:34:00 user nova-compute[72874]:       <target dev="tapd701e5dd-9a"/>
Aug 17 18:34:00 user nova-compute[72874]:     </interface>
Aug 17 18:34:00 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:34:00 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/1bf20bb4-44a7-463d-bf0d-3ba449399b2c/console.log" append="off"/>
Aug 17 18:34:00 user nova-compute[72874]:     </serial>
Aug 17 18:34:00 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:34:00 user nova-compute[72874]:     <video>
Aug 17 18:34:00 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:34:00 user nova-compute[72874]:     </video>
Aug 17 18:34:00 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:34:00 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:34:00 user nova-compute[72874]:     </rng>
Aug 17 18:34:00 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:34:00 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:34:00 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:34:00 user nova-compute[72874]:     </memballoon>
Aug 17 18:34:00 user nova-compute[72874]:   </devices>
Aug 17 18:34:00 user nova-compute[72874]: </domain>
Aug 17 18:34:00 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1074554763',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1074554763',id=33,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a550f3591d1347bf8b9fb4d3e90b8aad',ramdisk_id='',reservation_id='r-wa0950yp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-68498997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:33:37Z,user_data=None,user_id='d13289795c8b4991a9cf6bb2880ad6ef',uuid=1bf20bb4-44a7-463d-bf0d-3ba449399b2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "address": "fa:16:3e:f3:05:5e", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd701e5dd-9a", "ovs_interfaceid": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converting VIF {"id": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "address": "fa:16:3e:f3:05:5e", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd701e5dd-9a", "ovs_interfaceid": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:05:5e,bridge_name='br-int',has_traffic_filtering=True,id=d701e5dd-9a42-44c9-8ca1-c645f382220a,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd701e5dd-9a') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG os_vif [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:05:5e,bridge_name='br-int',has_traffic_filtering=True,id=d701e5dd-9a42-44c9-8ca1-c645f382220a,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd701e5dd-9a') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd701e5dd-9a, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd701e5dd-9a, col_values=(('external_ids', {'iface-id': 'd701e5dd-9a42-44c9-8ca1-c645f382220a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:05:5e', 'vm-uuid': '1bf20bb4-44a7-463d-bf0d-3ba449399b2c'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:00 user nova-compute[72874]: INFO os_vif [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:05:5e,bridge_name='br-int',has_traffic_filtering=True,id=d701e5dd-9a42-44c9-8ca1-c645f382220a,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd701e5dd-9a')
Aug 17 18:34:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] No VIF found with MAC fa:16:3e:f3:05:5e, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:34:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-fca2a53d-0d85-4c59-9899-34b378abc288 req-390375f3-95c5-4116-8683-12c5fc0d29fc service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fca2a53d-0d85-4c59-9899-34b378abc288 req-390375f3-95c5-4116-8683-12c5fc0d29fc service nova] Acquiring lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fca2a53d-0d85-4c59-9899-34b378abc288 req-390375f3-95c5-4116-8683-12c5fc0d29fc service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fca2a53d-0d85-4c59-9899-34b378abc288 req-390375f3-95c5-4116-8683-12c5fc0d29fc service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-fca2a53d-0d85-4c59-9899-34b378abc288 req-390375f3-95c5-4116-8683-12c5fc0d29fc service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] No waiting events found dispatching network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:34:01 user nova-compute[72874]: WARNING nova.compute.manager [req-fca2a53d-0d85-4c59-9899-34b378abc288 req-390375f3-95c5-4116-8683-12c5fc0d29fc service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received unexpected event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a for instance with vm_state building and task_state spawning.
Aug 17 18:34:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:02 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297227.7042227, 4e7369e4-b052-436d-a65a-248742018ee4 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:34:02 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] VM Stopped (Lifecycle Event)
Aug 17 18:34:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-32569b6e-d67e-4208-ba99-5c74cdf5be70 None None] [instance: 4e7369e4-b052-436d-a65a-248742018ee4] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297243.774827, 1bf20bb4-44a7-463d-bf0d-3ba449399b2c => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:34:03 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] VM Resumed (Lifecycle Event)
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:34:03 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Instance spawned successfully.
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:03 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297243.7778714, 1bf20bb4-44a7-463d-bf0d-3ba449399b2c => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:34:03 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] VM Started (Lifecycle Event)
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:34:03 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:34:03 user nova-compute[72874]: INFO nova.compute.manager [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Took 4.88 seconds to spawn the instance on the hypervisor.
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-c80f9a61-3380-4ca5-b00a-ae8af059e832 req-7c208afd-5d03-490f-a77b-7f64ef4f9a41 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c80f9a61-3380-4ca5-b00a-ae8af059e832 req-7c208afd-5d03-490f-a77b-7f64ef4f9a41 service nova] Acquiring lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c80f9a61-3380-4ca5-b00a-ae8af059e832 req-7c208afd-5d03-490f-a77b-7f64ef4f9a41 service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c80f9a61-3380-4ca5-b00a-ae8af059e832 req-7c208afd-5d03-490f-a77b-7f64ef4f9a41 service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-c80f9a61-3380-4ca5-b00a-ae8af059e832 req-7c208afd-5d03-490f-a77b-7f64ef4f9a41 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] No waiting events found dispatching network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:34:03 user nova-compute[72874]: WARNING nova.compute.manager [req-c80f9a61-3380-4ca5-b00a-ae8af059e832 req-7c208afd-5d03-490f-a77b-7f64ef4f9a41 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received unexpected event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a for instance with vm_state building and task_state spawning.
Aug 17 18:34:03 user nova-compute[72874]: INFO nova.compute.manager [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Took 27.21 seconds to build instance.
Aug 17 18:34:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2511f17f-d7c9-4e39-8fb1-fda5c646052a tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.349s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "dd54e88a-91b7-439c-9d69-7812dacc3932" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:34:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:11 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:34:11 user nova-compute[72874]: INFO nova.compute.claims [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Claim successful on node user
Aug 17 18:34:11 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:34:11 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:34:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.419s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:34:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:34:11 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:34:11 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:34:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG nova.policy [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '37eba99d36a842ca93af2d82be67dea1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d44ed4bf46e4f6bb8d9f9255bfceded', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:34:12 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Creating image(s)
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "/opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "/opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.180s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk 1073741824" returned: 0 in 0.051s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.194s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Successfully created port: 5f197504-5f21-4940-84a4-d0116f895319 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Cannot resize image /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'migration_context' on Instance uuid dd54e88a-91b7-439c-9d69-7812dacc3932 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Ensure instance console log exists: /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:13 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Successfully updated port: 5f197504-5f21-4940-84a4-d0116f895319 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:34:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "refresh_cache-dd54e88a-91b7-439c-9d69-7812dacc3932" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:34:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquired lock "refresh_cache-dd54e88a-91b7-439c-9d69-7812dacc3932" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:34:13 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:34:13 user nova-compute[72874]: DEBUG nova.compute.manager [req-03ad80c6-c556-4eb2-915c-9e2d73bfde85 req-b354fb54-9baf-44d2-9e6a-8eeeca966f0c service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Received event network-changed-5f197504-5f21-4940-84a4-d0116f895319 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:13 user nova-compute[72874]: DEBUG nova.compute.manager [req-03ad80c6-c556-4eb2-915c-9e2d73bfde85 req-b354fb54-9baf-44d2-9e6a-8eeeca966f0c service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Refreshing instance network info cache due to event network-changed-5f197504-5f21-4940-84a4-d0116f895319. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:34:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-03ad80c6-c556-4eb2-915c-9e2d73bfde85 req-b354fb54-9baf-44d2-9e6a-8eeeca966f0c service nova] Acquiring lock "refresh_cache-dd54e88a-91b7-439c-9d69-7812dacc3932" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:34:13 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Updating instance_info_cache with network_info: [{"id": "5f197504-5f21-4940-84a4-d0116f895319", "address": "fa:16:3e:e8:39:6c", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f197504-5f", "ovs_interfaceid": "5f197504-5f21-4940-84a4-d0116f895319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Releasing lock "refresh_cache-dd54e88a-91b7-439c-9d69-7812dacc3932" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Instance network_info: |[{"id": "5f197504-5f21-4940-84a4-d0116f895319", "address": "fa:16:3e:e8:39:6c", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f197504-5f", "ovs_interfaceid": "5f197504-5f21-4940-84a4-d0116f895319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-03ad80c6-c556-4eb2-915c-9e2d73bfde85 req-b354fb54-9baf-44d2-9e6a-8eeeca966f0c service nova] Acquired lock "refresh_cache-dd54e88a-91b7-439c-9d69-7812dacc3932" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.network.neutron [req-03ad80c6-c556-4eb2-915c-9e2d73bfde85 req-b354fb54-9baf-44d2-9e6a-8eeeca966f0c service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Refreshing network info cache for port 5f197504-5f21-4940-84a4-d0116f895319 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Start _get_guest_xml network_info=[{"id": "5f197504-5f21-4940-84a4-d0116f895319", "address": "fa:16:3e:e8:39:6c", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f197504-5f", "ovs_interfaceid": "5f197504-5f21-4940-84a4-d0116f895319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:34:14 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:34:14 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-477220644',display_name='tempest-AttachVolumeNegativeTest-server-477220644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-477220644',id=34,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnj2YznEcxCKBbM2e2LGaYwcleJIOFX1jLo0GqXJ7Hoq+E5F6UKTOFT+NCnUwYYStxUwtPwLTWDKWNW8dUoCC+q74lNLGCZxCI/Zdis+iaazEPymwdIJ7XBsDYcwpQcQw==',key_name='tempest-keypair-1143954971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d44ed4bf46e4f6bb8d9f9255bfceded',ramdisk_id='',reservation_id='r-ncs1qdcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1092460488',owner_user_name='tempest-AttachVolumeNegativeTest-1092460488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eba99d36a842ca93af2d82be67dea1',uuid=dd54e88a-91b7-439c-9d69-7812dacc3932,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f197504-5f21-4940-84a4-d0116f895319", "address": "fa:16:3e:e8:39:6c", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f197504-5f", "ovs_interfaceid": "5f197504-5f21-4940-84a4-d0116f895319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converting VIF {"id": "5f197504-5f21-4940-84a4-d0116f895319", "address": "fa:16:3e:e8:39:6c", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f197504-5f", "ovs_interfaceid": "5f197504-5f21-4940-84a4-d0116f895319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:39:6c,bridge_name='br-int',has_traffic_filtering=True,id=5f197504-5f21-4940-84a4-d0116f895319,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f197504-5f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'pci_devices' on Instance uuid dd54e88a-91b7-439c-9d69-7812dacc3932 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:34:14 user nova-compute[72874]:   <uuid>dd54e88a-91b7-439c-9d69-7812dacc3932</uuid>
Aug 17 18:34:14 user nova-compute[72874]:   <name>instance-00000022</name>
Aug 17 18:34:14 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:34:14 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:34:14 user nova-compute[72874]:   <metadata>
Aug 17 18:34:14 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:34:14 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:34:14 user nova-compute[72874]:       <nova:name>tempest-AttachVolumeNegativeTest-server-477220644</nova:name>
Aug 17 18:34:14 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:34:14</nova:creationTime>
Aug 17 18:34:14 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:34:14 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:34:14 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:34:14 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:34:14 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:34:14 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:34:14 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:34:14 user nova-compute[72874]:       <nova:owner>
Aug 17 18:34:14 user nova-compute[72874]:         <nova:user uuid="37eba99d36a842ca93af2d82be67dea1">tempest-AttachVolumeNegativeTest-1092460488-project-member</nova:user>
Aug 17 18:34:14 user nova-compute[72874]:         <nova:project uuid="9d44ed4bf46e4f6bb8d9f9255bfceded">tempest-AttachVolumeNegativeTest-1092460488</nova:project>
Aug 17 18:34:14 user nova-compute[72874]:       </nova:owner>
Aug 17 18:34:14 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:34:14 user nova-compute[72874]:       <nova:ports>
Aug 17 18:34:14 user nova-compute[72874]:         <nova:port uuid="5f197504-5f21-4940-84a4-d0116f895319">
Aug 17 18:34:14 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 18:34:14 user nova-compute[72874]:         </nova:port>
Aug 17 18:34:14 user nova-compute[72874]:       </nova:ports>
Aug 17 18:34:14 user nova-compute[72874]:     </nova:instance>
Aug 17 18:34:14 user nova-compute[72874]:   </metadata>
Aug 17 18:34:14 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:34:14 user nova-compute[72874]:     <system>
Aug 17 18:34:14 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:34:14 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:34:14 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:34:14 user nova-compute[72874]:       <entry name="serial">dd54e88a-91b7-439c-9d69-7812dacc3932</entry>
Aug 17 18:34:14 user nova-compute[72874]:       <entry name="uuid">dd54e88a-91b7-439c-9d69-7812dacc3932</entry>
Aug 17 18:34:14 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:34:14 user nova-compute[72874]:     </system>
Aug 17 18:34:14 user nova-compute[72874]:   </sysinfo>
Aug 17 18:34:14 user nova-compute[72874]:   <os>
Aug 17 18:34:14 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:34:14 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:34:14 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:34:14 user nova-compute[72874]:   </os>
Aug 17 18:34:14 user nova-compute[72874]:   <features>
Aug 17 18:34:14 user nova-compute[72874]:     <acpi/>
Aug 17 18:34:14 user nova-compute[72874]:     <apic/>
Aug 17 18:34:14 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:34:14 user nova-compute[72874]:   </features>
Aug 17 18:34:14 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:34:14 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:34:14 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:34:14 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:34:14 user nova-compute[72874]:   </clock>
Aug 17 18:34:14 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:34:14 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:34:14 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:34:14 user nova-compute[72874]:   </cpu>
Aug 17 18:34:14 user nova-compute[72874]:   <devices>
Aug 17 18:34:14 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:34:14 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:34:14 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk"/>
Aug 17 18:34:14 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:34:14 user nova-compute[72874]:     </disk>
Aug 17 18:34:14 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:34:14 user nova-compute[72874]:       <mac address="fa:16:3e:e8:39:6c"/>
Aug 17 18:34:14 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:34:14 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:34:14 user nova-compute[72874]:       <target dev="tap5f197504-5f"/>
Aug 17 18:34:14 user nova-compute[72874]:     </interface>
Aug 17 18:34:14 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:34:14 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/console.log" append="off"/>
Aug 17 18:34:14 user nova-compute[72874]:     </serial>
Aug 17 18:34:14 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:34:14 user nova-compute[72874]:     <video>
Aug 17 18:34:14 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:34:14 user nova-compute[72874]:     </video>
Aug 17 18:34:14 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:34:14 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:34:14 user nova-compute[72874]:     </rng>
Aug 17 18:34:14 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:34:14 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:34:14 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:34:14 user nova-compute[72874]:     </memballoon>
Aug 17 18:34:14 user nova-compute[72874]:   </devices>
Aug 17 18:34:14 user nova-compute[72874]: </domain>
Aug 17 18:34:14 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-477220644',display_name='tempest-AttachVolumeNegativeTest-server-477220644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-477220644',id=34,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnj2YznEcxCKBbM2e2LGaYwcleJIOFX1jLo0GqXJ7Hoq+E5F6UKTOFT+NCnUwYYStxUwtPwLTWDKWNW8dUoCC+q74lNLGCZxCI/Zdis+iaazEPymwdIJ7XBsDYcwpQcQw==',key_name='tempest-keypair-1143954971',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d44ed4bf46e4f6bb8d9f9255bfceded',ramdisk_id='',reservation_id='r-ncs1qdcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1092460488',owner_user_name='tempest-AttachVolumeNegativeTest-1092460488-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:34:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eba99d36a842ca93af2d82be67dea1',uuid=dd54e88a-91b7-439c-9d69-7812dacc3932,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f197504-5f21-4940-84a4-d0116f895319", "address": "fa:16:3e:e8:39:6c", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f197504-5f", "ovs_interfaceid": "5f197504-5f21-4940-84a4-d0116f895319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converting VIF {"id": "5f197504-5f21-4940-84a4-d0116f895319", "address": "fa:16:3e:e8:39:6c", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f197504-5f", "ovs_interfaceid": "5f197504-5f21-4940-84a4-d0116f895319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:39:6c,bridge_name='br-int',has_traffic_filtering=True,id=5f197504-5f21-4940-84a4-d0116f895319,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f197504-5f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG os_vif [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:39:6c,bridge_name='br-int',has_traffic_filtering=True,id=5f197504-5f21-4940-84a4-d0116f895319,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f197504-5f') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f197504-5f, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5f197504-5f, col_values=(('external_ids', {'iface-id': '5f197504-5f21-4940-84a4-d0116f895319', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:39:6c', 'vm-uuid': 'dd54e88a-91b7-439c-9d69-7812dacc3932'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:14 user nova-compute[72874]: INFO os_vif [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:39:6c,bridge_name='br-int',has_traffic_filtering=True,id=5f197504-5f21-4940-84a4-d0116f895319,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f197504-5f')
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] No VIF found with MAC fa:16:3e:e8:39:6c, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.network.neutron [req-03ad80c6-c556-4eb2-915c-9e2d73bfde85 req-b354fb54-9baf-44d2-9e6a-8eeeca966f0c service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Updated VIF entry in instance network info cache for port 5f197504-5f21-4940-84a4-d0116f895319. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG nova.network.neutron [req-03ad80c6-c556-4eb2-915c-9e2d73bfde85 req-b354fb54-9baf-44d2-9e6a-8eeeca966f0c service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Updating instance_info_cache with network_info: [{"id": "5f197504-5f21-4940-84a4-d0116f895319", "address": "fa:16:3e:e8:39:6c", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f197504-5f", "ovs_interfaceid": "5f197504-5f21-4940-84a4-d0116f895319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:34:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-03ad80c6-c556-4eb2-915c-9e2d73bfde85 req-b354fb54-9baf-44d2-9e6a-8eeeca966f0c service nova] Releasing lock "refresh_cache-dd54e88a-91b7-439c-9d69-7812dacc3932" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:34:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:16 user nova-compute[72874]: DEBUG nova.compute.manager [req-bd25d898-2ba4-4f48-9dd9-38d65fe208c2 req-0cba87fa-0d6c-4242-a3a0-8f4cb46f972a service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Received event network-vif-plugged-5f197504-5f21-4940-84a4-d0116f895319 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bd25d898-2ba4-4f48-9dd9-38d65fe208c2 req-0cba87fa-0d6c-4242-a3a0-8f4cb46f972a service nova] Acquiring lock "dd54e88a-91b7-439c-9d69-7812dacc3932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bd25d898-2ba4-4f48-9dd9-38d65fe208c2 req-0cba87fa-0d6c-4242-a3a0-8f4cb46f972a service nova] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bd25d898-2ba4-4f48-9dd9-38d65fe208c2 req-0cba87fa-0d6c-4242-a3a0-8f4cb46f972a service nova] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:16 user nova-compute[72874]: DEBUG nova.compute.manager [req-bd25d898-2ba4-4f48-9dd9-38d65fe208c2 req-0cba87fa-0d6c-4242-a3a0-8f4cb46f972a service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] No waiting events found dispatching network-vif-plugged-5f197504-5f21-4940-84a4-d0116f895319 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:34:16 user nova-compute[72874]: WARNING nova.compute.manager [req-bd25d898-2ba4-4f48-9dd9-38d65fe208c2 req-0cba87fa-0d6c-4242-a3a0-8f4cb46f972a service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Received unexpected event network-vif-plugged-5f197504-5f21-4940-84a4-d0116f895319 for instance with vm_state building and task_state spawning.
Aug 17 18:34:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:17 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297257.824558, dd54e88a-91b7-439c-9d69-7812dacc3932 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:34:17 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] VM Resumed (Lifecycle Event)
Aug 17 18:34:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:34:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:34:17 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Instance spawned successfully.
Aug 17 18:34:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:34:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:34:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:34:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:17 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:34:17 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297257.8261232, dd54e88a-91b7-439c-9d69-7812dacc3932 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:34:17 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] VM Started (Lifecycle Event)
Aug 17 18:34:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:34:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:34:17 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:34:17 user nova-compute[72874]: INFO nova.compute.manager [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Took 5.84 seconds to spawn the instance on the hypervisor.
Aug 17 18:34:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:34:18 user nova-compute[72874]: INFO nova.compute.manager [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Took 6.57 seconds to build instance.
Aug 17 18:34:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b985096f-b551-449e-b69e-cce6f4ecd4f4 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.676s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:18 user nova-compute[72874]: DEBUG nova.compute.manager [req-d8658a88-905d-4893-9d9e-2cdc1c3195d5 req-a745fda5-2744-4c07-8532-5e82e6150e3b service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Received event network-vif-plugged-5f197504-5f21-4940-84a4-d0116f895319 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d8658a88-905d-4893-9d9e-2cdc1c3195d5 req-a745fda5-2744-4c07-8532-5e82e6150e3b service nova] Acquiring lock "dd54e88a-91b7-439c-9d69-7812dacc3932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d8658a88-905d-4893-9d9e-2cdc1c3195d5 req-a745fda5-2744-4c07-8532-5e82e6150e3b service nova] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d8658a88-905d-4893-9d9e-2cdc1c3195d5 req-a745fda5-2744-4c07-8532-5e82e6150e3b service nova] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:18 user nova-compute[72874]: DEBUG nova.compute.manager [req-d8658a88-905d-4893-9d9e-2cdc1c3195d5 req-a745fda5-2744-4c07-8532-5e82e6150e3b service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] No waiting events found dispatching network-vif-plugged-5f197504-5f21-4940-84a4-d0116f895319 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:34:18 user nova-compute[72874]: WARNING nova.compute.manager [req-d8658a88-905d-4893-9d9e-2cdc1c3195d5 req-a745fda5-2744-4c07-8532-5e82e6150e3b service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Received unexpected event network-vif-plugged-5f197504-5f21-4940-84a4-d0116f895319 for instance with vm_state active and task_state None.
Aug 17 18:34:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:34:23 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:34:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:23 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:34:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:34:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:34:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:34:27 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:34:27 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:34:27 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7616MB free_disk=25.071983337402344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 90997e0c-bbbf-493f-92f2-f310489eb6a6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance f5760c65-a9c0-4997-8db3-04c1b4095ac5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 38df8d14-531a-42f3-8a4e-c53c1a80185f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 1bf20bb4-44a7-463d-bf0d-3ba449399b2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance dd54e88a-91b7-439c-9d69-7812dacc3932 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:34:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.399s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:28 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:34:28 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:34:28 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:34:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:34:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:34:28 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:34:29 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Updating instance_info_cache with network_info: [{"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:34:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:34:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:34:29 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:34:29 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:34:29 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:34:29 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:34:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:30 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:34:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:34 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:34:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:34:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "66cc888a-561d-4ce2-b07a-2cde7206be8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "66cc888a-561d-4ce2-b07a-2cde7206be8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:34:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:38 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:34:38 user nova-compute[72874]: INFO nova.compute.claims [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Claim successful on node user
Aug 17 18:34:39 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG nova.network.neutron [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:34:39 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:34:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG nova.policy [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '92dfb3e7d65a48209708e823cb8f7ff9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'baf2398b53784944bcd6b54c36d1fec8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:34:39 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Creating image(s)
Aug 17 18:34:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "/opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "/opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "/opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.192s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk 1073741824" returned: 0 in 0.054s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG nova.network.neutron [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Successfully created port: 534f68a0-b15f-4b75-94aa-445b580e4246 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.221s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:34:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Cannot resize image /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG nova.objects.instance [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lazy-loading 'migration_context' on Instance uuid 66cc888a-561d-4ce2-b07a-2cde7206be8b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Ensure instance console log exists: /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG nova.network.neutron [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Successfully updated port: 534f68a0-b15f-4b75-94aa-445b580e4246 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "refresh_cache-66cc888a-561d-4ce2-b07a-2cde7206be8b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquired lock "refresh_cache-66cc888a-561d-4ce2-b07a-2cde7206be8b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG nova.network.neutron [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG nova.compute.manager [req-77e06f41-61cc-4e3d-811d-b9de9fa7c919 req-9385e46a-f6b4-4fab-874a-7e79b6c61ed5 service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Received event network-changed-534f68a0-b15f-4b75-94aa-445b580e4246 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG nova.compute.manager [req-77e06f41-61cc-4e3d-811d-b9de9fa7c919 req-9385e46a-f6b4-4fab-874a-7e79b6c61ed5 service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Refreshing instance network info cache due to event network-changed-534f68a0-b15f-4b75-94aa-445b580e4246. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-77e06f41-61cc-4e3d-811d-b9de9fa7c919 req-9385e46a-f6b4-4fab-874a-7e79b6c61ed5 service nova] Acquiring lock "refresh_cache-66cc888a-561d-4ce2-b07a-2cde7206be8b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:34:40 user nova-compute[72874]: DEBUG nova.network.neutron [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.network.neutron [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Updating instance_info_cache with network_info: [{"id": "534f68a0-b15f-4b75-94aa-445b580e4246", "address": "fa:16:3e:eb:00:a8", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534f68a0-b1", "ovs_interfaceid": "534f68a0-b15f-4b75-94aa-445b580e4246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Releasing lock "refresh_cache-66cc888a-561d-4ce2-b07a-2cde7206be8b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Instance network_info: |[{"id": "534f68a0-b15f-4b75-94aa-445b580e4246", "address": "fa:16:3e:eb:00:a8", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534f68a0-b1", "ovs_interfaceid": "534f68a0-b15f-4b75-94aa-445b580e4246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-77e06f41-61cc-4e3d-811d-b9de9fa7c919 req-9385e46a-f6b4-4fab-874a-7e79b6c61ed5 service nova] Acquired lock "refresh_cache-66cc888a-561d-4ce2-b07a-2cde7206be8b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.network.neutron [req-77e06f41-61cc-4e3d-811d-b9de9fa7c919 req-9385e46a-f6b4-4fab-874a-7e79b6c61ed5 service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Refreshing network info cache for port 534f68a0-b15f-4b75-94aa-445b580e4246 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Start _get_guest_xml network_info=[{"id": "534f68a0-b15f-4b75-94aa-445b580e4246", "address": "fa:16:3e:eb:00:a8", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534f68a0-b1", "ovs_interfaceid": "534f68a0-b15f-4b75-94aa-445b580e4246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:34:41 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:34:41 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-297624000',display_name='tempest-VolumesActionsTest-instance-297624000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-297624000',id=35,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baf2398b53784944bcd6b54c36d1fec8',ramdisk_id='',reservation_id='r-gbvzmykc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-580827709',owner_user_name='tempest-VolumesActionsTest-580827709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:34:39Z,user_data=None,user_id='92dfb3e7d65a48209708e823cb8f7ff9',uuid=66cc888a-561d-4ce2-b07a-2cde7206be8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "534f68a0-b15f-4b75-94aa-445b580e4246", "address": "fa:16:3e:eb:00:a8", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534f68a0-b1", "ovs_interfaceid": "534f68a0-b15f-4b75-94aa-445b580e4246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Converting VIF {"id": "534f68a0-b15f-4b75-94aa-445b580e4246", "address": "fa:16:3e:eb:00:a8", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534f68a0-b1", "ovs_interfaceid": "534f68a0-b15f-4b75-94aa-445b580e4246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:00:a8,bridge_name='br-int',has_traffic_filtering=True,id=534f68a0-b15f-4b75-94aa-445b580e4246,network=Network(a9f4937d-de4a-417a-adaf-55d95fe354db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534f68a0-b1') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.objects.instance [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lazy-loading 'pci_devices' on Instance uuid 66cc888a-561d-4ce2-b07a-2cde7206be8b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:34:41 user nova-compute[72874]:   <uuid>66cc888a-561d-4ce2-b07a-2cde7206be8b</uuid>
Aug 17 18:34:41 user nova-compute[72874]:   <name>instance-00000023</name>
Aug 17 18:34:41 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:34:41 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:34:41 user nova-compute[72874]:   <metadata>
Aug 17 18:34:41 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:34:41 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:34:41 user nova-compute[72874]:       <nova:name>tempest-VolumesActionsTest-instance-297624000</nova:name>
Aug 17 18:34:41 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:34:41</nova:creationTime>
Aug 17 18:34:41 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:34:41 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:34:41 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:34:41 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:34:41 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:34:41 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:34:41 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:34:41 user nova-compute[72874]:       <nova:owner>
Aug 17 18:34:41 user nova-compute[72874]:         <nova:user uuid="92dfb3e7d65a48209708e823cb8f7ff9">tempest-VolumesActionsTest-580827709-project-member</nova:user>
Aug 17 18:34:41 user nova-compute[72874]:         <nova:project uuid="baf2398b53784944bcd6b54c36d1fec8">tempest-VolumesActionsTest-580827709</nova:project>
Aug 17 18:34:41 user nova-compute[72874]:       </nova:owner>
Aug 17 18:34:41 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:34:41 user nova-compute[72874]:       <nova:ports>
Aug 17 18:34:41 user nova-compute[72874]:         <nova:port uuid="534f68a0-b15f-4b75-94aa-445b580e4246">
Aug 17 18:34:41 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 18:34:41 user nova-compute[72874]:         </nova:port>
Aug 17 18:34:41 user nova-compute[72874]:       </nova:ports>
Aug 17 18:34:41 user nova-compute[72874]:     </nova:instance>
Aug 17 18:34:41 user nova-compute[72874]:   </metadata>
Aug 17 18:34:41 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:34:41 user nova-compute[72874]:     <system>
Aug 17 18:34:41 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:34:41 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:34:41 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:34:41 user nova-compute[72874]:       <entry name="serial">66cc888a-561d-4ce2-b07a-2cde7206be8b</entry>
Aug 17 18:34:41 user nova-compute[72874]:       <entry name="uuid">66cc888a-561d-4ce2-b07a-2cde7206be8b</entry>
Aug 17 18:34:41 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:34:41 user nova-compute[72874]:     </system>
Aug 17 18:34:41 user nova-compute[72874]:   </sysinfo>
Aug 17 18:34:41 user nova-compute[72874]:   <os>
Aug 17 18:34:41 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:34:41 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:34:41 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:34:41 user nova-compute[72874]:   </os>
Aug 17 18:34:41 user nova-compute[72874]:   <features>
Aug 17 18:34:41 user nova-compute[72874]:     <acpi/>
Aug 17 18:34:41 user nova-compute[72874]:     <apic/>
Aug 17 18:34:41 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:34:41 user nova-compute[72874]:   </features>
Aug 17 18:34:41 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:34:41 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:34:41 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:34:41 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:34:41 user nova-compute[72874]:   </clock>
Aug 17 18:34:41 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:34:41 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:34:41 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:34:41 user nova-compute[72874]:   </cpu>
Aug 17 18:34:41 user nova-compute[72874]:   <devices>
Aug 17 18:34:41 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:34:41 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:34:41 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk"/>
Aug 17 18:34:41 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:34:41 user nova-compute[72874]:     </disk>
Aug 17 18:34:41 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:34:41 user nova-compute[72874]:       <mac address="fa:16:3e:eb:00:a8"/>
Aug 17 18:34:41 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:34:41 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:34:41 user nova-compute[72874]:       <target dev="tap534f68a0-b1"/>
Aug 17 18:34:41 user nova-compute[72874]:     </interface>
Aug 17 18:34:41 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:34:41 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/console.log" append="off"/>
Aug 17 18:34:41 user nova-compute[72874]:     </serial>
Aug 17 18:34:41 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:34:41 user nova-compute[72874]:     <video>
Aug 17 18:34:41 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:34:41 user nova-compute[72874]:     </video>
Aug 17 18:34:41 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:34:41 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:34:41 user nova-compute[72874]:     </rng>
Aug 17 18:34:41 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:34:41 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:34:41 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:34:41 user nova-compute[72874]:     </memballoon>
Aug 17 18:34:41 user nova-compute[72874]:   </devices>
Aug 17 18:34:41 user nova-compute[72874]: </domain>
Aug 17 18:34:41 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-297624000',display_name='tempest-VolumesActionsTest-instance-297624000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-297624000',id=35,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='baf2398b53784944bcd6b54c36d1fec8',ramdisk_id='',reservation_id='r-gbvzmykc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-580827709',owner_user_name='tempest-VolumesActionsTest-580827709-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:34:39Z,user_data=None,user_id='92dfb3e7d65a48209708e823cb8f7ff9',uuid=66cc888a-561d-4ce2-b07a-2cde7206be8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "534f68a0-b15f-4b75-94aa-445b580e4246", "address": "fa:16:3e:eb:00:a8", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534f68a0-b1", "ovs_interfaceid": "534f68a0-b15f-4b75-94aa-445b580e4246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Converting VIF {"id": "534f68a0-b15f-4b75-94aa-445b580e4246", "address": "fa:16:3e:eb:00:a8", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534f68a0-b1", "ovs_interfaceid": "534f68a0-b15f-4b75-94aa-445b580e4246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:00:a8,bridge_name='br-int',has_traffic_filtering=True,id=534f68a0-b15f-4b75-94aa-445b580e4246,network=Network(a9f4937d-de4a-417a-adaf-55d95fe354db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534f68a0-b1') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG os_vif [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:00:a8,bridge_name='br-int',has_traffic_filtering=True,id=534f68a0-b15f-4b75-94aa-445b580e4246,network=Network(a9f4937d-de4a-417a-adaf-55d95fe354db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534f68a0-b1') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap534f68a0-b1, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap534f68a0-b1, col_values=(('external_ids', {'iface-id': '534f68a0-b15f-4b75-94aa-445b580e4246', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:00:a8', 'vm-uuid': '66cc888a-561d-4ce2-b07a-2cde7206be8b'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:41 user nova-compute[72874]: INFO os_vif [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:00:a8,bridge_name='br-int',has_traffic_filtering=True,id=534f68a0-b15f-4b75-94aa-445b580e4246,network=Network(a9f4937d-de4a-417a-adaf-55d95fe354db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534f68a0-b1')
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] No VIF found with MAC fa:16:3e:eb:00:a8, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.network.neutron [req-77e06f41-61cc-4e3d-811d-b9de9fa7c919 req-9385e46a-f6b4-4fab-874a-7e79b6c61ed5 service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Updated VIF entry in instance network info cache for port 534f68a0-b15f-4b75-94aa-445b580e4246. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG nova.network.neutron [req-77e06f41-61cc-4e3d-811d-b9de9fa7c919 req-9385e46a-f6b4-4fab-874a-7e79b6c61ed5 service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Updating instance_info_cache with network_info: [{"id": "534f68a0-b15f-4b75-94aa-445b580e4246", "address": "fa:16:3e:eb:00:a8", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534f68a0-b1", "ovs_interfaceid": "534f68a0-b15f-4b75-94aa-445b580e4246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:34:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-77e06f41-61cc-4e3d-811d-b9de9fa7c919 req-9385e46a-f6b4-4fab-874a-7e79b6c61ed5 service nova] Releasing lock "refresh_cache-66cc888a-561d-4ce2-b07a-2cde7206be8b" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:34:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-dc1be45e-0f1e-4408-a378-d7f8d7e58360 req-b7ea87d2-6942-495f-afa4-c27947389b7b service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Received event network-vif-plugged-534f68a0-b15f-4b75-94aa-445b580e4246 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-dc1be45e-0f1e-4408-a378-d7f8d7e58360 req-b7ea87d2-6942-495f-afa4-c27947389b7b service nova] Acquiring lock "66cc888a-561d-4ce2-b07a-2cde7206be8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-dc1be45e-0f1e-4408-a378-d7f8d7e58360 req-b7ea87d2-6942-495f-afa4-c27947389b7b service nova] Lock "66cc888a-561d-4ce2-b07a-2cde7206be8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-dc1be45e-0f1e-4408-a378-d7f8d7e58360 req-b7ea87d2-6942-495f-afa4-c27947389b7b service nova] Lock "66cc888a-561d-4ce2-b07a-2cde7206be8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-dc1be45e-0f1e-4408-a378-d7f8d7e58360 req-b7ea87d2-6942-495f-afa4-c27947389b7b service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] No waiting events found dispatching network-vif-plugged-534f68a0-b15f-4b75-94aa-445b580e4246 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:34:42 user nova-compute[72874]: WARNING nova.compute.manager [req-dc1be45e-0f1e-4408-a378-d7f8d7e58360 req-b7ea87d2-6942-495f-afa4-c27947389b7b service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Received unexpected event network-vif-plugged-534f68a0-b15f-4b75-94aa-445b580e4246 for instance with vm_state building and task_state spawning.
Aug 17 18:34:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297284.5730405, 66cc888a-561d-4ce2-b07a-2cde7206be8b => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:34:44 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] VM Resumed (Lifecycle Event)
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:34:44 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Instance spawned successfully.
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:34:44 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297284.5743856, 66cc888a-561d-4ce2-b07a-2cde7206be8b => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:34:44 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] VM Started (Lifecycle Event)
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:34:44 user nova-compute[72874]: INFO nova.compute.manager [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Took 5.40 seconds to spawn the instance on the hypervisor.
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:34:44 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:34:44 user nova-compute[72874]: INFO nova.compute.manager [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Took 6.13 seconds to build instance.
Aug 17 18:34:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-19d1f6b4-e345-4af7-85cb-f6a5def6f20d tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "66cc888a-561d-4ce2-b07a-2cde7206be8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.225s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-2de388d9-f083-45bf-b68d-0a8ab8b9abf5 req-934def4a-c431-45d1-bd43-a878ab4163b2 service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Received event network-vif-plugged-534f68a0-b15f-4b75-94aa-445b580e4246 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2de388d9-f083-45bf-b68d-0a8ab8b9abf5 req-934def4a-c431-45d1-bd43-a878ab4163b2 service nova] Acquiring lock "66cc888a-561d-4ce2-b07a-2cde7206be8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2de388d9-f083-45bf-b68d-0a8ab8b9abf5 req-934def4a-c431-45d1-bd43-a878ab4163b2 service nova] Lock "66cc888a-561d-4ce2-b07a-2cde7206be8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2de388d9-f083-45bf-b68d-0a8ab8b9abf5 req-934def4a-c431-45d1-bd43-a878ab4163b2 service nova] Lock "66cc888a-561d-4ce2-b07a-2cde7206be8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-2de388d9-f083-45bf-b68d-0a8ab8b9abf5 req-934def4a-c431-45d1-bd43-a878ab4163b2 service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] No waiting events found dispatching network-vif-plugged-534f68a0-b15f-4b75-94aa-445b580e4246 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:34:44 user nova-compute[72874]: WARNING nova.compute.manager [req-2de388d9-f083-45bf-b68d-0a8ab8b9abf5 req-934def4a-c431-45d1-bd43-a878ab4163b2 service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Received unexpected event network-vif-plugged-534f68a0-b15f-4b75-94aa-445b580e4246 for instance with vm_state active and task_state None.
Aug 17 18:34:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:47 user nova-compute[72874]: INFO nova.compute.manager [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Terminating instance
Aug 17 18:34:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG nova.compute.manager [req-afef168c-1259-4d32-a0f8-79d9a1ee184a req-67b3e5e7-7dae-43a2-9c84-00c3ff3a068e service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-vif-unplugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-afef168c-1259-4d32-a0f8-79d9a1ee184a req-67b3e5e7-7dae-43a2-9c84-00c3ff3a068e service nova] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-afef168c-1259-4d32-a0f8-79d9a1ee184a req-67b3e5e7-7dae-43a2-9c84-00c3ff3a068e service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-afef168c-1259-4d32-a0f8-79d9a1ee184a req-67b3e5e7-7dae-43a2-9c84-00c3ff3a068e service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG nova.compute.manager [req-afef168c-1259-4d32-a0f8-79d9a1ee184a req-67b3e5e7-7dae-43a2-9c84-00c3ff3a068e service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] No waiting events found dispatching network-vif-unplugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG nova.compute.manager [req-afef168c-1259-4d32-a0f8-79d9a1ee184a req-67b3e5e7-7dae-43a2-9c84-00c3ff3a068e service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-vif-unplugged-a465b261-54fe-481e-8abe-be2a50aff00b for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Instance destroyed successfully.
Aug 17 18:34:47 user nova-compute[72874]: DEBUG nova.objects.instance [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lazy-loading 'resources' on Instance uuid 90997e0c-bbbf-493f-92f2-f310489eb6a6 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:29:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1517624274',display_name='tempest-TestMinimumBasicScenario-server-1517624274',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1517624274',id=30,image_ref='76e2554a-dfc0-4883-8db1-6a736b39683e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAJgXAXJrsdODoCScIeFKJM20OxQNMEHARGD6Uoo/WKYQgVWYAcHD/WdQf+g25/3X9GmPX7Du4ew2H9jq6c+EZaJ+AsXskJoacnjEbuuIPEjHNbYbuTohmyFH1GJ2ITXFg==',key_name='tempest-TestMinimumBasicScenario-878940498',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:29:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a608a48fc27947bcbbc84e5c078cea4c',ramdisk_id='',reservation_id='r-d1zu4ypc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='76e2554a-dfc0-4883-8db1-6a736b39683e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1549406810',owner_user_name='tempest-TestMinimumBasicScenario-1549406810-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:32:05Z,user_data=None,user_id='576a655170bb4dc3b1c45cb9bbfe5ae7',uuid=90997e0c-bbbf-493f-92f2-f310489eb6a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a465b261-54fe-481e-8abe-be2a50aff00b", "address": "fa:16:3e:dc:cb:80", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa465b261-54", "ovs_interfaceid": "a465b261-54fe-481e-8abe-be2a50aff00b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Converting VIF {"id": "a465b261-54fe-481e-8abe-be2a50aff00b", "address": "fa:16:3e:dc:cb:80", "network": {"id": "6badf08e-0db0-44c7-a8e8-1825dc05ee9f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1007902701-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a608a48fc27947bcbbc84e5c078cea4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa465b261-54", "ovs_interfaceid": "a465b261-54fe-481e-8abe-be2a50aff00b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dc:cb:80,bridge_name='br-int',has_traffic_filtering=True,id=a465b261-54fe-481e-8abe-be2a50aff00b,network=Network(6badf08e-0db0-44c7-a8e8-1825dc05ee9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa465b261-54') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG os_vif [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:cb:80,bridge_name='br-int',has_traffic_filtering=True,id=a465b261-54fe-481e-8abe-be2a50aff00b,network=Network(6badf08e-0db0-44c7-a8e8-1825dc05ee9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa465b261-54') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa465b261-54, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:47 user nova-compute[72874]: INFO os_vif [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dc:cb:80,bridge_name='br-int',has_traffic_filtering=True,id=a465b261-54fe-481e-8abe-be2a50aff00b,network=Network(6badf08e-0db0-44c7-a8e8-1825dc05ee9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa465b261-54')
Aug 17 18:34:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Deleting instance files /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6_del
Aug 17 18:34:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Deletion of /opt/stack/data/nova/instances/90997e0c-bbbf-493f-92f2-f310489eb6a6_del complete
Aug 17 18:34:48 user nova-compute[72874]: INFO nova.compute.manager [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 17 18:34:48 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:34:48 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:34:48 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:34:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:34:49 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Took 1.29 seconds to deallocate network for instance.
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:49 user nova-compute[72874]: INFO nova.compute.manager [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Terminating instance
Aug 17 18:34:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] No waiting events found dispatching network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:34:49 user nova-compute[72874]: WARNING nova.compute.manager [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received unexpected event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b for instance with vm_state deleted and task_state None.
Aug 17 18:34:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] No waiting events found dispatching network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:34:49 user nova-compute[72874]: WARNING nova.compute.manager [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received unexpected event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b for instance with vm_state deleted and task_state None.
Aug 17 18:34:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] No waiting events found dispatching network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:34:49 user nova-compute[72874]: WARNING nova.compute.manager [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received unexpected event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b for instance with vm_state deleted and task_state None.
Aug 17 18:34:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] Acquiring lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] No waiting events found dispatching network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:34:49 user nova-compute[72874]: WARNING nova.compute.manager [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received unexpected event network-vif-plugged-a465b261-54fe-481e-8abe-be2a50aff00b for instance with vm_state deleted and task_state None.
Aug 17 18:34:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-7c84be71-29b7-4e8e-9a9f-48d6d9b55d38 req-3ca1d87a-aa90-40ed-80c6-26135b07f3dc service nova] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Received event network-vif-deleted-a465b261-54fe-481e-8abe-be2a50aff00b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-9050872e-4160-4725-8f90-68808e14d60d req-bce14ebf-eaf7-4531-9509-c027c950a5b3 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received event network-vif-unplugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9050872e-4160-4725-8f90-68808e14d60d req-bce14ebf-eaf7-4531-9509-c027c950a5b3 service nova] Acquiring lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9050872e-4160-4725-8f90-68808e14d60d req-bce14ebf-eaf7-4531-9509-c027c950a5b3 service nova] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9050872e-4160-4725-8f90-68808e14d60d req-bce14ebf-eaf7-4531-9509-c027c950a5b3 service nova] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-9050872e-4160-4725-8f90-68808e14d60d req-bce14ebf-eaf7-4531-9509-c027c950a5b3 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] No waiting events found dispatching network-vif-unplugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-9050872e-4160-4725-8f90-68808e14d60d req-bce14ebf-eaf7-4531-9509-c027c950a5b3 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received event network-vif-unplugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.424s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:49 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Deleted allocations for instance 90997e0c-bbbf-493f-92f2-f310489eb6a6
Aug 17 18:34:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2239ac0d-81a9-4d64-90eb-00b9cddfc327 tempest-TestMinimumBasicScenario-1549406810 tempest-TestMinimumBasicScenario-1549406810-project-member] Lock "90997e0c-bbbf-493f-92f2-f310489eb6a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.899s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:50 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Instance destroyed successfully.
Aug 17 18:34:50 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'resources' on Instance uuid f5760c65-a9c0-4997-8db3-04c1b4095ac5 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-557325771',display_name='tempest-ServerActionsTestOtherA-server-557325771',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-557325771',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFP6ue+/z3wt8xhCWBOe29hsvUkf+UOWUkfgnV2VGRCWOmbw8F+9gEiC1B84s9ElkFdDnqMgWD7dJiORZ3oQy2cYRrKsSD3Z6YMcgGnOy3TRveU5TvjItrEcSVSb9w9jg==',key_name='tempest-keypair-1711897531',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:30:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4aa04d3ed68a4542b32e2efeca25222a',ramdisk_id='',reservation_id='r-z37qv7n7',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1332351935',owner_user_name='tempest-ServerActionsTestOtherA-1332351935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:32:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaaa47a37543427eaa1712d29c419dd9',uuid=f5760c65-a9c0-4997-8db3-04c1b4095ac5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converting VIF {"id": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "address": "fa:16:3e:ed:73:e1", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccb2518-ba", "ovs_interfaceid": "5ccb2518-ba24-4885-a6c1-fd247bb0482c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:73:e1,bridge_name='br-int',has_traffic_filtering=True,id=5ccb2518-ba24-4885-a6c1-fd247bb0482c,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccb2518-ba') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_vif [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:73:e1,bridge_name='br-int',has_traffic_filtering=True,id=5ccb2518-ba24-4885-a6c1-fd247bb0482c,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccb2518-ba') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ccb2518-ba, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:34:50 user nova-compute[72874]: INFO os_vif [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:73:e1,bridge_name='br-int',has_traffic_filtering=True,id=5ccb2518-ba24-4885-a6c1-fd247bb0482c,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccb2518-ba')
Aug 17 18:34:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXlYknCb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:34:50 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6aa9f97-1f7f-4c58-8677-ab12caced380]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf0050e-1a54-4473-b574-8bf9c3f74ce5]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:34:50 user nova-compute[72874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:34:50 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:34:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:34:50 user nova-compute[72874]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 (non-flash)
Aug 17 18:34:50 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:34:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a074e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9'): ({'sdc'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Removing single pathed devices sdc {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43dfec0-5951-4463-ac3b-d6cf6396e5cf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2734a80-d626-4988-b4b8-7b44bc0bce32]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Flushing IO for device /dev/sdc {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3bdd03-9ad8-4461-845c-ac2036e8b6c8]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.064s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbad4268-47d4-47cd-9132-da38ecbe1b34]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed33aa87-45f6-43f1-9b4a-657c98945c10]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93ff3d5-36fa-4c39-a7fd-fefd9dad6bf8]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9, portal: 172.16.0.220,3260]
Aug 17 18:34:50 user nova-compute[72874]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9, portal: 172.16.0.220,3260] successful.
Aug 17 18:34:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:02a3029d-0c4b-4212-b644-c28603954db9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0371fb71-ab42-48d1-95d3-0994dc901a13]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] <== disconnect_volume: return (299ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:34:50 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Deleting instance files /opt/stack/data/nova/instances/f5760c65-a9c0-4997-8db3-04c1b4095ac5_del
Aug 17 18:34:50 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Deletion of /opt/stack/data/nova/instances/f5760c65-a9c0-4997-8db3-04c1b4095ac5_del complete
Aug 17 18:34:50 user nova-compute[72874]: INFO nova.compute.manager [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Took 1.26 seconds to destroy the instance on the hypervisor.
Aug 17 18:34:50 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:34:50 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:34:51 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:34:51 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Took 0.87 seconds to deallocate network for instance.
Aug 17 18:34:51 user nova-compute[72874]: DEBUG nova.compute.manager [req-019e3d1f-6d6d-4308-9893-43c78fdae37f req-a76fcc80-2a4f-40f6-ad52-e4919ff3fab9 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received event network-vif-deleted-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:51 user nova-compute[72874]: INFO nova.compute.manager [req-019e3d1f-6d6d-4308-9893-43c78fdae37f req-a76fcc80-2a4f-40f6-ad52-e4919ff3fab9 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Neutron deleted interface 5ccb2518-ba24-4885-a6c1-fd247bb0482c; detaching it from the instance and deleting it from the info cache
Aug 17 18:34:51 user nova-compute[72874]: DEBUG nova.network.neutron [req-019e3d1f-6d6d-4308-9893-43c78fdae37f req-a76fcc80-2a4f-40f6-ad52-e4919ff3fab9 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:34:51 user nova-compute[72874]: DEBUG nova.compute.manager [req-019e3d1f-6d6d-4308-9893-43c78fdae37f req-a76fcc80-2a4f-40f6-ad52-e4919ff3fab9 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Detach interface failed, port_id=5ccb2518-ba24-4885-a6c1-fd247bb0482c, reason: Instance f5760c65-a9c0-4997-8db3-04c1b4095ac5 could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:34:51 user nova-compute[72874]: DEBUG nova.compute.manager [req-510fe8ba-b49f-42fe-97f2-0becbd363eb6 req-082b4a16-55b3-45a6-8d30-00574d52b667 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received event network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:34:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-510fe8ba-b49f-42fe-97f2-0becbd363eb6 req-082b4a16-55b3-45a6-8d30-00574d52b667 service nova] Acquiring lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-510fe8ba-b49f-42fe-97f2-0becbd363eb6 req-082b4a16-55b3-45a6-8d30-00574d52b667 service nova] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-510fe8ba-b49f-42fe-97f2-0becbd363eb6 req-082b4a16-55b3-45a6-8d30-00574d52b667 service nova] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:51 user nova-compute[72874]: DEBUG nova.compute.manager [req-510fe8ba-b49f-42fe-97f2-0becbd363eb6 req-082b4a16-55b3-45a6-8d30-00574d52b667 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] No waiting events found dispatching network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:34:51 user nova-compute[72874]: WARNING nova.compute.manager [req-510fe8ba-b49f-42fe-97f2-0becbd363eb6 req-082b4a16-55b3-45a6-8d30-00574d52b667 service nova] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Received unexpected event network-vif-plugged-5ccb2518-ba24-4885-a6c1-fd247bb0482c for instance with vm_state active and task_state deleting.
Aug 17 18:34:52 user nova-compute[72874]: INFO nova.compute.manager [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Took 0.78 seconds to detach 1 volumes for instance.
Aug 17 18:34:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Deleting volume: 02a3029d-0c4b-4212-b644-c28603954db9 {{(pid=72874) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 18:34:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:34:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:34:52 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:34:52 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:34:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:52 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Deleted allocations for instance f5760c65-a9c0-4997-8db3-04c1b4095ac5
Aug 17 18:34:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e0ac472a-7aa4-4727-9329-0b45d5c892c4 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "f5760c65-a9c0-4997-8db3-04c1b4095ac5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.508s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:34:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:02 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297287.9091644, 90997e0c-bbbf-493f-92f2-f310489eb6a6 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:35:02 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] VM Stopped (Lifecycle Event)
Aug 17 18:35:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-8ec8a0e7-bd9b-4734-8d6b-fa7510fc47f7 None None] [instance: 90997e0c-bbbf-493f-92f2-f310489eb6a6] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:35:05 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297290.3853962, f5760c65-a9c0-4997-8db3-04c1b4095ac5 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:35:05 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] VM Stopped (Lifecycle Event)
Aug 17 18:35:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-199a2b8a-427d-49b0-8dfd-ab8b29ccbec2 None None] [instance: f5760c65-a9c0-4997-8db3-04c1b4095ac5] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:35:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:22 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:35:24 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:35:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:24 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:35:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:24 user nova-compute[72874]: INFO nova.compute.manager [None req-62944574-3d45-4563-b34e-5dbb994a1f0b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Unrescuing
Aug 17 18:35:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-62944574-3d45-4563-b34e-5dbb994a1f0b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:35:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-62944574-3d45-4563-b34e-5dbb994a1f0b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquired lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:35:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-62944574-3d45-4563-b34e-5dbb994a1f0b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:35:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG nova.network.neutron [None req-62944574-3d45-4563-b34e-5dbb994a1f0b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Updating instance_info_cache with network_info: [{"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-62944574-3d45-4563-b34e-5dbb994a1f0b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Releasing lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG nova.objects.instance [None req-62944574-3d45-4563-b34e-5dbb994a1f0b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'flavor' on Instance uuid b41da216-4183-404f-8896-58371c3ae61d {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:25 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: b41da216-4183-404f-8896-58371c3ae61d] Instance destroyed successfully.
Aug 17 18:35:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-f4afa2c6-b78d-4112-bf7c-947f7e58b0ce req-d0232c3d-c65d-44d0-9076-3e29ac14b8b0 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-unplugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f4afa2c6-b78d-4112-bf7c-947f7e58b0ce req-d0232c3d-c65d-44d0-9076-3e29ac14b8b0 service nova] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f4afa2c6-b78d-4112-bf7c-947f7e58b0ce req-d0232c3d-c65d-44d0-9076-3e29ac14b8b0 service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f4afa2c6-b78d-4112-bf7c-947f7e58b0ce req-d0232c3d-c65d-44d0-9076-3e29ac14b8b0 service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-f4afa2c6-b78d-4112-bf7c-947f7e58b0ce req-d0232c3d-c65d-44d0-9076-3e29ac14b8b0 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] No waiting events found dispatching network-vif-unplugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:35:25 user nova-compute[72874]: WARNING nova.compute.manager [req-f4afa2c6-b78d-4112-bf7c-947f7e58b0ce req-d0232c3d-c65d-44d0-9076-3e29ac14b8b0 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received unexpected event network-vif-unplugged-e30432ac-cf52-4ce4-a10a-70700297a63e for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:35:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:35:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:27 user nova-compute[72874]: INFO nova.compute.manager [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Rescuing
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "refresh_cache-1bf20bb4-44a7-463d-bf0d-3ba449399b2c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquired lock "refresh_cache-1bf20bb4-44a7-463d-bf0d-3ba449399b2c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG nova.network.neutron [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG nova.network.neutron [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Updating instance_info_cache with network_info: [{"id": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "address": "fa:16:3e:f3:05:5e", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd701e5dd-9a", "ovs_interfaceid": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] No waiting events found dispatching network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:35:27 user nova-compute[72874]: WARNING nova.compute.manager [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received unexpected event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:35:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] No waiting events found dispatching network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:35:27 user nova-compute[72874]: WARNING nova.compute.manager [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received unexpected event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:35:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] No waiting events found dispatching network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:35:27 user nova-compute[72874]: WARNING nova.compute.manager [req-3a9ca96e-8bdc-42ad-8691-05e21df0cdb9 req-7de41f96-fc7b-4dc9-b59c-f5066bbe8355 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received unexpected event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Releasing lock "refresh_cache-1bf20bb4-44a7-463d-bf0d-3ba449399b2c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Removed pending event for b41da216-4183-404f-8896-58371c3ae61d due to event {{(pid=72874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297329.2675304, b41da216-4183-404f-8896-58371c3ae61d => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:35:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] VM Resumed (Lifecycle Event)
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-62944574-3d45-4563-b34e-5dbb994a1f0b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:35:29 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:35:29 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7713MB free_disk=25.042007446289062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:35:29 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Instance destroyed successfully.
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:35:29 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Attempting a stable device rescue
Aug 17 18:35:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297329.268923, b41da216-4183-404f-8896-58371c3ae61d => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:35:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] VM Started (Lifecycle Event)
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72874) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Instance directory exists: not creating {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 18:35:29 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Creating image(s)
Aug 17 18:35:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "/opt/stack/data/nova/instances/1bf20bb4-44a7-463d-bf0d-3ba449399b2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "/opt/stack/data/nova/instances/1bf20bb4-44a7-463d-bf0d-3ba449399b2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "/opt/stack/data/nova/instances/1bf20bb4-44a7-463d-bf0d-3ba449399b2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.objects.instance [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1bf20bb4-44a7-463d-bf0d-3ba449399b2c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b143e572-9116-4dc0-8fc3-ba586b290ddd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 38df8d14-531a-42f3-8a4e-c53c1a80185f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 1bf20bb4-44a7-463d-bf0d-3ba449399b2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance dd54e88a-91b7-439c-9d69-7812dacc3932 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 66cc888a-561d-4ce2-b07a-2cde7206be8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:35:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:35:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc.part --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:30 user nova-compute[72874]: DEBUG nova.compute.manager [req-ccbf3ebf-de7f-44a0-b0a2-855fc6b5ff55 req-29688b05-7fe0-4d55-81b9-21299d99254e service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received event network-vif-unplugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:35:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ccbf3ebf-de7f-44a0-b0a2-855fc6b5ff55 req-29688b05-7fe0-4d55-81b9-21299d99254e service nova] Acquiring lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ccbf3ebf-de7f-44a0-b0a2-855fc6b5ff55 req-29688b05-7fe0-4d55-81b9-21299d99254e service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ccbf3ebf-de7f-44a0-b0a2-855fc6b5ff55 req-29688b05-7fe0-4d55-81b9-21299d99254e service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:30 user nova-compute[72874]: DEBUG nova.compute.manager [req-ccbf3ebf-de7f-44a0-b0a2-855fc6b5ff55 req-29688b05-7fe0-4d55-81b9-21299d99254e service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] No waiting events found dispatching network-vif-unplugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:35:30 user nova-compute[72874]: WARNING nova.compute.manager [req-ccbf3ebf-de7f-44a0-b0a2-855fc6b5ff55 req-29688b05-7fe0-4d55-81b9-21299d99254e service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received unexpected event network-vif-unplugged-d701e5dd-9a42-44c9-8ca1-c645f382220a for instance with vm_state active and task_state rescuing.
Aug 17 18:35:30 user nova-compute[72874]: DEBUG nova.compute.manager [req-ccbf3ebf-de7f-44a0-b0a2-855fc6b5ff55 req-29688b05-7fe0-4d55-81b9-21299d99254e service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:35:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ccbf3ebf-de7f-44a0-b0a2-855fc6b5ff55 req-29688b05-7fe0-4d55-81b9-21299d99254e service nova] Acquiring lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ccbf3ebf-de7f-44a0-b0a2-855fc6b5ff55 req-29688b05-7fe0-4d55-81b9-21299d99254e service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ccbf3ebf-de7f-44a0-b0a2-855fc6b5ff55 req-29688b05-7fe0-4d55-81b9-21299d99254e service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:30 user nova-compute[72874]: DEBUG nova.compute.manager [req-ccbf3ebf-de7f-44a0-b0a2-855fc6b5ff55 req-29688b05-7fe0-4d55-81b9-21299d99254e service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] No waiting events found dispatching network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:35:30 user nova-compute[72874]: WARNING nova.compute.manager [req-ccbf3ebf-de7f-44a0-b0a2-855fc6b5ff55 req-29688b05-7fe0-4d55-81b9-21299d99254e service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received unexpected event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a for instance with vm_state active and task_state rescuing.
Aug 17 18:35:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:35:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc.part --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:30 user nova-compute[72874]: DEBUG nova.virt.images [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] d1d6664c-b243-409e-af96-68e8cdf81355 was qcow2, converting to raw {{(pid=72874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 18:35:30 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:35:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc.part /opt/stack/data/nova/instances/_base/1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc.converted {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc.part /opt/stack/data/nova/instances/_base/1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc.converted" returned: 0 in 0.291s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc.converted --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.687s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.742s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc,backing_fmt=raw /opt/stack/data/nova/instances/1bf20bb4-44a7-463d-bf0d-3ba449399b2c/disk.rescue {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc,backing_fmt=raw /opt/stack/data/nova/instances/1bf20bb4-44a7-463d-bf0d-3ba449399b2c/disk.rescue" returned: 0 in 0.096s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.objects.instance [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'migration_context' on Instance uuid 1bf20bb4-44a7-463d-bf0d-3ba449399b2c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Start _get_guest_xml network_info=[{"id": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "address": "fa:16:3e:f3:05:5e", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "vif_mac": "fa:16:3e:f3:05:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd701e5dd-9a", "ovs_interfaceid": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd1d6664c-b243-409e-af96-68e8cdf81355', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSgCdeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '1bf20bb4-44a7-463d-bf0d-3ba449399b2c', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef557e2d-85da-403e-ae95-b86bead13920', 'serial': 'ef557e2d-85da-403e-ae95-b86bead13920'}, 'delete_on_termination': False, 'attachment_id': '64bb709f-1771-4634-99f3-950461b66b47', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.objects.instance [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'resources' on Instance uuid 1bf20bb4-44a7-463d-bf0d-3ba449399b2c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.objects.instance [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'numa_topology' on Instance uuid 1bf20bb4-44a7-463d-bf0d-3ba449399b2c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:35:31 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:35:31 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.objects.instance [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1bf20bb4-44a7-463d-bf0d-3ba449399b2c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSgCdeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:35:31 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:35:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:35:31 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:35:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:35:31 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3fec27-5bdc-4662-9542-94004f8ee2db]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = BSgCdeQP\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 18:35:31 user nova-compute[72874]: node.name = iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920
Aug 17 18:35:31 user nova-compute[72874]: node.tpgt = -1
Aug 17 18:35:31 user nova-compute[72874]: node.startup = automatic
Aug 17 18:35:31 user nova-compute[72874]: node.leading_login = No
Aug 17 18:35:31 user nova-compute[72874]: iface.iscsi_ifacename = default
Aug 17 18:35:31 user nova-compute[72874]: iface.net_ifacename = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.ipaddress = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.prefix_len = 0
Aug 17 18:35:31 user nova-compute[72874]: iface.hwaddress = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.transport_name = tcp
Aug 17 18:35:31 user nova-compute[72874]: iface.initiatorname = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.state = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.vlan_id = 0
Aug 17 18:35:31 user nova-compute[72874]: iface.vlan_priority = 0
Aug 17 18:35:31 user nova-compute[72874]: iface.vlan_state = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.iface_num = 0
Aug 17 18:35:31 user nova-compute[72874]: iface.mtu = 0
Aug 17 18:35:31 user nova-compute[72874]: iface.port = 0
Aug 17 18:35:31 user nova-compute[72874]: iface.bootproto = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.subnet_mask = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.gateway = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.dhcp_alt_client_id = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.dhcp_dns = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.dhcp_learn_iqn = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.dhcp_vendor_id_state = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.dhcp_vendor_id = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.dhcp_slp_da = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.fragmentation = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.gratuitous_arp = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.incoming_forwarding = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.tos_state = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.tos = 0
Aug 17 18:35:31 user nova-compute[72874]: iface.ttl = 0
Aug 17 18:35:31 user nova-compute[72874]: iface.delayed_ack = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.tcp_nagle = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.tcp_wsf_state = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.tcp_wsf = 0
Aug 17 18:35:31 user nova-compute[72874]: iface.tcp_timer_scale = 0
Aug 17 18:35:31 user nova-compute[72874]: iface.tcp_timestamp = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.redirect = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.def_task_mgmt_timeout = 0
Aug 17 18:35:31 user nova-compute[72874]: iface.header_digest = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.data_digest = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.immediate_data = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.initial_r2t = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.data_seq_inorder = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.data_pdu_inorder = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.erl = 0
Aug 17 18:35:31 user nova-compute[72874]: iface.max_receive_data_len = 0
Aug 17 18:35:31 user nova-compute[72874]: iface.first_burst_len = 0
Aug 17 18:35:31 user nova-compute[72874]: iface.max_outstanding_r2t = 0
Aug 17 18:35:31 user nova-compute[72874]: iface.max_burst_len = 0
Aug 17 18:35:31 user nova-compute[72874]: iface.chap_auth = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.bidi_chap = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.strict_login_compliance = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.discovery_auth = <empty>
Aug 17 18:35:31 user nova-compute[72874]: iface.discovery_logout = <empty>
Aug 17 18:35:31 user nova-compute[72874]: node.discovery_address = <empty>
Aug 17 18:35:31 user nova-compute[72874]: node.discovery_port = 0
Aug 17 18:35:31 user nova-compute[72874]: node.discovery_type = static
Aug 17 18:35:31 user nova-compute[72874]: node.session.initial_cmdsn = 0
Aug 17 18:35:31 user nova-compute[72874]: node.session.initial_login_retry_max = 8
Aug 17 18:35:31 user nova-compute[72874]: node.session.xmit_thread_priority = -20
Aug 17 18:35:31 user nova-compute[72874]: node.session.cmds_max = 128
Aug 17 18:35:31 user nova-compute[72874]: node.session.queue_depth = 32
Aug 17 18:35:31 user nova-compute[72874]: node.session.nr_sessions = 1
Aug 17 18:35:31 user nova-compute[72874]: node.session.auth.authmethod = CHAP
Aug 17 18:35:31 user nova-compute[72874]: node.session.auth.username = BSgCdeQP
Aug 17 18:35:31 user nova-compute[72874]: node.session.auth.password = ***
Aug 17 18:35:31 user nova-compute[72874]: node.session.auth.username_in = <empty>
Aug 17 18:35:31 user nova-compute[72874]: node.session.auth.password_in = <empty>
Aug 17 18:35:31 user nova-compute[72874]: node.session.auth.chap_algs = MD5
Aug 17 18:35:31 user nova-compute[72874]: node.session.timeo.replacement_timeout = 120
Aug 17 18:35:31 user nova-compute[72874]: node.session.err_timeo.abort_timeout = 15
Aug 17 18:35:31 user nova-compute[72874]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 18:35:31 user nova-compute[72874]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 18:35:31 user nova-compute[72874]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 18:35:31 user nova-compute[72874]: node.session.iscsi.FastAbort = Yes
Aug 17 18:35:31 user nova-compute[72874]: node.session.iscsi.InitialR2T = No
Aug 17 18:35:31 user nova-compute[72874]: node.session.iscsi.ImmediateData = Yes
Aug 17 18:35:31 user nova-compute[72874]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 18:35:31 user nova-compute[72874]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 18:35:31 user nova-compute[72874]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 18:35:31 user nova-compute[72874]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 18:35:31 user nova-compute[72874]: node.session.iscsi.MaxConnections = 1
Aug 17 18:35:31 user nova-compute[72874]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 18:35:31 user nova-compute[72874]: node.session.iscsi.ERL = 0
Aug 17 18:35:31 user nova-compute[72874]: node.session.scan = manual
Aug 17 18:35:31 user nova-compute[72874]: node.session.reopen_max = 0
Aug 17 18:35:31 user nova-compute[72874]: node.conn[0].address = 172.16.0.220
Aug 17 18:35:31 user nova-compute[72874]: node.conn[0].port = 3260
Aug 17 18:35:31 user nova-compute[72874]: node.conn[0].startup = manual
Aug 17 18:35:31 user nova-compute[72874]: node.conn[0].tcp.window_size = 524288
Aug 17 18:35:31 user nova-compute[72874]: node.conn[0].tcp.type_of_service = 0
Aug 17 18:35:31 user nova-compute[72874]: node.conn[0].timeo.logout_timeout = 15
Aug 17 18:35:31 user nova-compute[72874]: node.conn[0].timeo.login_timeout = 15
Aug 17 18:35:31 user nova-compute[72874]: node.conn[0].timeo.auth_timeout = 45
Aug 17 18:35:31 user nova-compute[72874]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 18:35:31 user nova-compute[72874]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 18:35:31 user nova-compute[72874]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 18:35:31 user nova-compute[72874]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 18:35:31 user nova-compute[72874]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 18:35:31 user nova-compute[72874]: node.conn[0].iscsi.DataDigest = None
Aug 17 18:35:31 user nova-compute[72874]: node.conn[0].iscsi.IFMarker = No
Aug 17 18:35:31 user nova-compute[72874]: node.conn[0].iscsi.OFMarker = No
Aug 17 18:35:31 user nova-compute[72874]: # END RECORD
Aug 17 18:35:31 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7953e3-ebd1-4701-b945-0a7e2fee994c]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f2ec70-f5ea-4cdb-928c-5c28d5da09c6]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BSgCdeQP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BSgCdeQP" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3342e0f1-40d2-4202-b596-cf31c87cd4c5]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BSgCdeQP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0044778-7f1d-4c6e-b996-5d93ee6f62bc]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8968a8af-37ca-4377-ab89-7591b3068bb7]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:35:31 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:35:31 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:35:31 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:35:31 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.144s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] HCTL ('35', '0', '0', 0) found on session 37 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:35:31 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3694f5bd-2d15-42ae-8fb8-4263cc3f1d0d]: (4, ('0 0 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Searching for a device in session 37 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSgCdeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.168s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] <== connect_volume: return (170ms) {'type': 'block', 'scsi_wwn': '26135613133326139', 'path': '/dev/sdd'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135613133326139', 'path': '/dev/sdd'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1074554763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1074554763',id=33,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:34:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a550f3591d1347bf8b9fb4d3e90b8aad',ramdisk_id='',reservation_id='r-wa0950yp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-68498997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:34:04Z,user_data=None,user_id='d13289795c8b4991a9cf6bb2880ad6ef',uuid=1bf20bb4-44a7-463d-bf0d-3ba449399b2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "address": "fa:16:3e:f3:05:5e", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "vif_mac": "fa:16:3e:f3:05:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd701e5dd-9a", "ovs_interfaceid": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converting VIF {"id": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "address": "fa:16:3e:f3:05:5e", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "vif_mac": "fa:16:3e:f3:05:5e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd701e5dd-9a", "ovs_interfaceid": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:05:5e,bridge_name='br-int',has_traffic_filtering=True,id=d701e5dd-9a42-44c9-8ca1-c645f382220a,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd701e5dd-9a') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG nova.objects.instance [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'pci_devices' on Instance uuid 1bf20bb4-44a7-463d-bf0d-3ba449399b2c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:35:32 user nova-compute[72874]:   <uuid>1bf20bb4-44a7-463d-bf0d-3ba449399b2c</uuid>
Aug 17 18:35:32 user nova-compute[72874]:   <name>instance-00000021</name>
Aug 17 18:35:32 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:35:32 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:35:32 user nova-compute[72874]:   <metadata>
Aug 17 18:35:32 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:35:32 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:35:32 user nova-compute[72874]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1074554763</nova:name>
Aug 17 18:35:32 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:35:31</nova:creationTime>
Aug 17 18:35:32 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:35:32 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:35:32 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:35:32 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:35:32 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:35:32 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:35:32 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:35:32 user nova-compute[72874]:       <nova:owner>
Aug 17 18:35:32 user nova-compute[72874]:         <nova:user uuid="d13289795c8b4991a9cf6bb2880ad6ef">tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member</nova:user>
Aug 17 18:35:32 user nova-compute[72874]:         <nova:project uuid="a550f3591d1347bf8b9fb4d3e90b8aad">tempest-ServerBootFromVolumeStableRescueTest-68498997</nova:project>
Aug 17 18:35:32 user nova-compute[72874]:       </nova:owner>
Aug 17 18:35:32 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:35:32 user nova-compute[72874]:       <nova:ports>
Aug 17 18:35:32 user nova-compute[72874]:         <nova:port uuid="d701e5dd-9a42-44c9-8ca1-c645f382220a">
Aug 17 18:35:32 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 18:35:32 user nova-compute[72874]:         </nova:port>
Aug 17 18:35:32 user nova-compute[72874]:       </nova:ports>
Aug 17 18:35:32 user nova-compute[72874]:     </nova:instance>
Aug 17 18:35:32 user nova-compute[72874]:   </metadata>
Aug 17 18:35:32 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:35:32 user nova-compute[72874]:     <system>
Aug 17 18:35:32 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:35:32 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:35:32 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:35:32 user nova-compute[72874]:       <entry name="serial">1bf20bb4-44a7-463d-bf0d-3ba449399b2c</entry>
Aug 17 18:35:32 user nova-compute[72874]:       <entry name="uuid">1bf20bb4-44a7-463d-bf0d-3ba449399b2c</entry>
Aug 17 18:35:32 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:35:32 user nova-compute[72874]:     </system>
Aug 17 18:35:32 user nova-compute[72874]:   </sysinfo>
Aug 17 18:35:32 user nova-compute[72874]:   <os>
Aug 17 18:35:32 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:35:32 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:35:32 user nova-compute[72874]:   </os>
Aug 17 18:35:32 user nova-compute[72874]:   <features>
Aug 17 18:35:32 user nova-compute[72874]:     <acpi/>
Aug 17 18:35:32 user nova-compute[72874]:     <apic/>
Aug 17 18:35:32 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:35:32 user nova-compute[72874]:   </features>
Aug 17 18:35:32 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:35:32 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:35:32 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:35:32 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:35:32 user nova-compute[72874]:   </clock>
Aug 17 18:35:32 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:35:32 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:35:32 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:35:32 user nova-compute[72874]:   </cpu>
Aug 17 18:35:32 user nova-compute[72874]:   <devices>
Aug 17 18:35:32 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:35:32 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:35:32 user nova-compute[72874]:       <source dev="/dev/sdd"/>
Aug 17 18:35:32 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:35:32 user nova-compute[72874]:       <serial>ef557e2d-85da-403e-ae95-b86bead13920</serial>
Aug 17 18:35:32 user nova-compute[72874]:     </disk>
Aug 17 18:35:32 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:35:32 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:35:32 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/1bf20bb4-44a7-463d-bf0d-3ba449399b2c/disk.rescue"/>
Aug 17 18:35:32 user nova-compute[72874]:       <target dev="vdb" bus="virtio"/>
Aug 17 18:35:32 user nova-compute[72874]:       <boot order="1"/>
Aug 17 18:35:32 user nova-compute[72874]:     </disk>
Aug 17 18:35:32 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:35:32 user nova-compute[72874]:       <mac address="fa:16:3e:f3:05:5e"/>
Aug 17 18:35:32 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:35:32 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:35:32 user nova-compute[72874]:       <target dev="tapd701e5dd-9a"/>
Aug 17 18:35:32 user nova-compute[72874]:     </interface>
Aug 17 18:35:32 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:35:32 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/1bf20bb4-44a7-463d-bf0d-3ba449399b2c/console.log" append="off"/>
Aug 17 18:35:32 user nova-compute[72874]:     </serial>
Aug 17 18:35:32 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:35:32 user nova-compute[72874]:     <video>
Aug 17 18:35:32 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:35:32 user nova-compute[72874]:     </video>
Aug 17 18:35:32 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:35:32 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:35:32 user nova-compute[72874]:     </rng>
Aug 17 18:35:32 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:35:32 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:35:32 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:35:32 user nova-compute[72874]:     </memballoon>
Aug 17 18:35:32 user nova-compute[72874]:   </devices>
Aug 17 18:35:32 user nova-compute[72874]: </domain>
Aug 17 18:35:32 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:35:32 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Instance destroyed successfully.
Aug 17 18:35:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] No VIF found with MAC fa:16:3e:f3:05:5e, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Updating instance_info_cache with network_info: [{"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:35:32 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:35:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-93f8d23a-be64-4b55-9e41-b26705c0acf5 req-8288a6a6-2051-4f51-ac9e-db4c4afe5319 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:35:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-93f8d23a-be64-4b55-9e41-b26705c0acf5 req-8288a6a6-2051-4f51-ac9e-db4c4afe5319 service nova] Acquiring lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-93f8d23a-be64-4b55-9e41-b26705c0acf5 req-8288a6a6-2051-4f51-ac9e-db4c4afe5319 service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-93f8d23a-be64-4b55-9e41-b26705c0acf5 req-8288a6a6-2051-4f51-ac9e-db4c4afe5319 service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-93f8d23a-be64-4b55-9e41-b26705c0acf5 req-8288a6a6-2051-4f51-ac9e-db4c4afe5319 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] No waiting events found dispatching network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:35:33 user nova-compute[72874]: WARNING nova.compute.manager [req-93f8d23a-be64-4b55-9e41-b26705c0acf5 req-8288a6a6-2051-4f51-ac9e-db4c4afe5319 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received unexpected event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a for instance with vm_state active and task_state rescuing.
Aug 17 18:35:35 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:35:35 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:35:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Removed pending event for 1bf20bb4-44a7-463d-bf0d-3ba449399b2c due to event {{(pid=72874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 18:35:35 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297335.6877215, 1bf20bb4-44a7-463d-bf0d-3ba449399b2c => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:35:35 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] VM Resumed (Lifecycle Event)
Aug 17 18:35:35 user nova-compute[72874]: DEBUG nova.compute.manager [None req-38d092f6-c9ec-4f83-b49d-4e0506fd1b46 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:35:35 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:35:35 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:35:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-c01ecc17-8175-4c7d-9f01-e2d0a3350443 req-bc41d883-43b8-4a5e-8e4f-b41c973b2498 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:35:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c01ecc17-8175-4c7d-9f01-e2d0a3350443 req-bc41d883-43b8-4a5e-8e4f-b41c973b2498 service nova] Acquiring lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c01ecc17-8175-4c7d-9f01-e2d0a3350443 req-bc41d883-43b8-4a5e-8e4f-b41c973b2498 service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c01ecc17-8175-4c7d-9f01-e2d0a3350443 req-bc41d883-43b8-4a5e-8e4f-b41c973b2498 service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-c01ecc17-8175-4c7d-9f01-e2d0a3350443 req-bc41d883-43b8-4a5e-8e4f-b41c973b2498 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] No waiting events found dispatching network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:35:35 user nova-compute[72874]: WARNING nova.compute.manager [req-c01ecc17-8175-4c7d-9f01-e2d0a3350443 req-bc41d883-43b8-4a5e-8e4f-b41c973b2498 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received unexpected event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a for instance with vm_state active and task_state rescuing.
Aug 17 18:35:35 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 18:35:35 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297335.6890888, 1bf20bb4-44a7-463d-bf0d-3ba449399b2c => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:35:35 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] VM Started (Lifecycle Event)
Aug 17 18:35:35 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:35:35 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:35:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:35:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "b143e572-9116-4dc0-8fc3-ba586b290ddd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "b143e572-9116-4dc0-8fc3-ba586b290ddd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:47 user nova-compute[72874]: INFO nova.compute.manager [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Terminating instance
Aug 17 18:35:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:35:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-cb015d68-7a83-435b-a4fd-80c24438d114 req-c7534b3d-dde7-4b5d-81f2-9a3afaedcbc4 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Received event network-vif-unplugged-17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:35:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cb015d68-7a83-435b-a4fd-80c24438d114 req-c7534b3d-dde7-4b5d-81f2-9a3afaedcbc4 service nova] Acquiring lock "b143e572-9116-4dc0-8fc3-ba586b290ddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cb015d68-7a83-435b-a4fd-80c24438d114 req-c7534b3d-dde7-4b5d-81f2-9a3afaedcbc4 service nova] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cb015d68-7a83-435b-a4fd-80c24438d114 req-c7534b3d-dde7-4b5d-81f2-9a3afaedcbc4 service nova] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-cb015d68-7a83-435b-a4fd-80c24438d114 req-c7534b3d-dde7-4b5d-81f2-9a3afaedcbc4 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] No waiting events found dispatching network-vif-unplugged-17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:35:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-cb015d68-7a83-435b-a4fd-80c24438d114 req-c7534b3d-dde7-4b5d-81f2-9a3afaedcbc4 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Received event network-vif-unplugged-17265426-d5a6-4028-8c1c-2f84dfa2ac21 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:35:48 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Instance destroyed successfully.
Aug 17 18:35:48 user nova-compute[72874]: DEBUG nova.objects.instance [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lazy-loading 'resources' on Instance uuid b143e572-9116-4dc0-8fc3-ba586b290ddd {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:35:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1169162450',display_name='tempest-ServerActionsTestOtherA-server-1169162450',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1169162450',id=4,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJFP6ue+/z3wt8xhCWBOe29hsvUkf+UOWUkfgnV2VGRCWOmbw8F+9gEiC1B84s9ElkFdDnqMgWD7dJiORZ3oQy2cYRrKsSD3Z6YMcgGnOy3TRveU5TvjItrEcSVSb9w9jg==',key_name='tempest-keypair-1711897531',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:16:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4aa04d3ed68a4542b32e2efeca25222a',ramdisk_id='',reservation_id='r-3fp9w07k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1332351935',owner_user_name='tempest-ServerActionsTestOtherA-1332351935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:16:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aaaa47a37543427eaa1712d29c419dd9',uuid=b143e572-9116-4dc0-8fc3-ba586b290ddd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "address": "fa:16:3e:3a:30:bb", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17265426-d5", "ovs_interfaceid": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:35:48 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converting VIF {"id": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "address": "fa:16:3e:3a:30:bb", "network": {"id": "7767ce1c-375f-4b83-8bc7-10cd13842a29", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1111083406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4aa04d3ed68a4542b32e2efeca25222a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17265426-d5", "ovs_interfaceid": "17265426-d5a6-4028-8c1c-2f84dfa2ac21", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:35:48 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:30:bb,bridge_name='br-int',has_traffic_filtering=True,id=17265426-d5a6-4028-8c1c-2f84dfa2ac21,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17265426-d5') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:35:48 user nova-compute[72874]: DEBUG os_vif [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:30:bb,bridge_name='br-int',has_traffic_filtering=True,id=17265426-d5a6-4028-8c1c-2f84dfa2ac21,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17265426-d5') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:35:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17265426-d5, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:35:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:35:48 user nova-compute[72874]: INFO os_vif [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:30:bb,bridge_name='br-int',has_traffic_filtering=True,id=17265426-d5a6-4028-8c1c-2f84dfa2ac21,network=Network(7767ce1c-375f-4b83-8bc7-10cd13842a29),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17265426-d5')
Aug 17 18:35:48 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Deleting instance files /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd_del
Aug 17 18:35:48 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Deletion of /opt/stack/data/nova/instances/b143e572-9116-4dc0-8fc3-ba586b290ddd_del complete
Aug 17 18:35:48 user nova-compute[72874]: INFO nova.compute.manager [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Took 0.71 seconds to destroy the instance on the hypervisor.
Aug 17 18:35:48 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:35:48 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:35:48 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:35:49 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:35:49 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Took 0.96 seconds to deallocate network for instance.
Aug 17 18:35:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-3df24ca0-eaab-45fc-8df2-4787b6efcf89 req-3b09ec2b-5f6e-4034-83d6-eef3fb302b1b service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Received event network-vif-deleted-17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:35:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:49 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:35:49 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:35:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.283s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:49 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Deleted allocations for instance b143e572-9116-4dc0-8fc3-ba586b290ddd
Aug 17 18:35:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bf840404-a678-4e5e-8eb6-ed14866115e5 tempest-ServerActionsTestOtherA-1332351935 tempest-ServerActionsTestOtherA-1332351935-project-member] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.143s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-a95cd53d-d5b1-475b-9356-0e316deeff21 req-181fb5e8-3bcd-4637-b3ee-6df30be4ac81 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Received event network-vif-plugged-17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:35:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a95cd53d-d5b1-475b-9356-0e316deeff21 req-181fb5e8-3bcd-4637-b3ee-6df30be4ac81 service nova] Acquiring lock "b143e572-9116-4dc0-8fc3-ba586b290ddd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:35:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a95cd53d-d5b1-475b-9356-0e316deeff21 req-181fb5e8-3bcd-4637-b3ee-6df30be4ac81 service nova] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:35:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a95cd53d-d5b1-475b-9356-0e316deeff21 req-181fb5e8-3bcd-4637-b3ee-6df30be4ac81 service nova] Lock "b143e572-9116-4dc0-8fc3-ba586b290ddd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:35:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-a95cd53d-d5b1-475b-9356-0e316deeff21 req-181fb5e8-3bcd-4637-b3ee-6df30be4ac81 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] No waiting events found dispatching network-vif-plugged-17265426-d5a6-4028-8c1c-2f84dfa2ac21 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:35:50 user nova-compute[72874]: WARNING nova.compute.manager [req-a95cd53d-d5b1-475b-9356-0e316deeff21 req-181fb5e8-3bcd-4637-b3ee-6df30be4ac81 service nova] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Received unexpected event network-vif-plugged-17265426-d5a6-4028-8c1c-2f84dfa2ac21 for instance with vm_state deleted and task_state None.
Aug 17 18:35:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:35:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-70a0a90b-6845-4224-b9a7-5e7afd8e62ce req-621793d0-e7cc-4219-84ca-5358179dbfe4 service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Received event network-changed-5f197504-5f21-4940-84a4-d0116f895319 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:36:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-70a0a90b-6845-4224-b9a7-5e7afd8e62ce req-621793d0-e7cc-4219-84ca-5358179dbfe4 service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Refreshing instance network info cache due to event network-changed-5f197504-5f21-4940-84a4-d0116f895319. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:36:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-70a0a90b-6845-4224-b9a7-5e7afd8e62ce req-621793d0-e7cc-4219-84ca-5358179dbfe4 service nova] Acquiring lock "refresh_cache-dd54e88a-91b7-439c-9d69-7812dacc3932" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:36:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-70a0a90b-6845-4224-b9a7-5e7afd8e62ce req-621793d0-e7cc-4219-84ca-5358179dbfe4 service nova] Acquired lock "refresh_cache-dd54e88a-91b7-439c-9d69-7812dacc3932" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:36:02 user nova-compute[72874]: DEBUG nova.network.neutron [req-70a0a90b-6845-4224-b9a7-5e7afd8e62ce req-621793d0-e7cc-4219-84ca-5358179dbfe4 service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Refreshing network info cache for port 5f197504-5f21-4940-84a4-d0116f895319 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:36:03 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297348.3371534, b143e572-9116-4dc0-8fc3-ba586b290ddd => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:36:03 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] VM Stopped (Lifecycle Event)
Aug 17 18:36:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-df8dc6b6-4adf-4753-a408-e7033c704468 None None] [instance: b143e572-9116-4dc0-8fc3-ba586b290ddd] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:36:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:03 user nova-compute[72874]: DEBUG nova.network.neutron [req-70a0a90b-6845-4224-b9a7-5e7afd8e62ce req-621793d0-e7cc-4219-84ca-5358179dbfe4 service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Updated VIF entry in instance network info cache for port 5f197504-5f21-4940-84a4-d0116f895319. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:36:03 user nova-compute[72874]: DEBUG nova.network.neutron [req-70a0a90b-6845-4224-b9a7-5e7afd8e62ce req-621793d0-e7cc-4219-84ca-5358179dbfe4 service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Updating instance_info_cache with network_info: [{"id": "5f197504-5f21-4940-84a4-d0116f895319", "address": "fa:16:3e:e8:39:6c", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f197504-5f", "ovs_interfaceid": "5f197504-5f21-4940-84a4-d0116f895319", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:36:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-70a0a90b-6845-4224-b9a7-5e7afd8e62ce req-621793d0-e7cc-4219-84ca-5358179dbfe4 service nova] Releasing lock "refresh_cache-dd54e88a-91b7-439c-9d69-7812dacc3932" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:36:04 user nova-compute[72874]: INFO nova.compute.claims [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Claim successful on node user
Aug 17 18:36:04 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.347s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:36:04 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:36:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG nova.policy [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bd31113bd5164578811f839d549dfd58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70d802b863c04d0195c73e6ec1889c8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:36:04 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Creating image(s)
Aug 17 18:36:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "/opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "/opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "/opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk 1073741824" returned: 0 in 0.052s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Cannot resize image /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG nova.objects.instance [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lazy-loading 'migration_context' on Instance uuid 939268df-3817-4cdf-b7a3-4a936a6e8ec9 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Ensure instance console log exists: /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:05 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Successfully created port: c16a8e4a-00bf-436f-a021-98297ac4e14a {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:36:06 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Successfully updated port: c16a8e4a-00bf-436f-a021-98297ac4e14a {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:36:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "refresh_cache-939268df-3817-4cdf-b7a3-4a936a6e8ec9" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:36:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquired lock "refresh_cache-939268df-3817-4cdf-b7a3-4a936a6e8ec9" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:36:06 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:36:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-eac39085-c824-4b4d-a7e5-e22d5c574a89 req-71bdd5b6-85f9-4c67-b462-a4a5e0cafb54 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Received event network-changed-c16a8e4a-00bf-436f-a021-98297ac4e14a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:36:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-eac39085-c824-4b4d-a7e5-e22d5c574a89 req-71bdd5b6-85f9-4c67-b462-a4a5e0cafb54 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Refreshing instance network info cache due to event network-changed-c16a8e4a-00bf-436f-a021-98297ac4e14a. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:36:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eac39085-c824-4b4d-a7e5-e22d5c574a89 req-71bdd5b6-85f9-4c67-b462-a4a5e0cafb54 service nova] Acquiring lock "refresh_cache-939268df-3817-4cdf-b7a3-4a936a6e8ec9" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:36:06 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:36:06 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Updating instance_info_cache with network_info: [{"id": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "address": "fa:16:3e:e5:42:31", "network": {"id": "6fe94371-138a-464d-89fd-9c9f9ebaaecd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-826475339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d802b863c04d0195c73e6ec1889c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16a8e4a-00", "ovs_interfaceid": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:36:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Releasing lock "refresh_cache-939268df-3817-4cdf-b7a3-4a936a6e8ec9" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:36:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Instance network_info: |[{"id": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "address": "fa:16:3e:e5:42:31", "network": {"id": "6fe94371-138a-464d-89fd-9c9f9ebaaecd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-826475339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d802b863c04d0195c73e6ec1889c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16a8e4a-00", "ovs_interfaceid": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:36:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eac39085-c824-4b4d-a7e5-e22d5c574a89 req-71bdd5b6-85f9-4c67-b462-a4a5e0cafb54 service nova] Acquired lock "refresh_cache-939268df-3817-4cdf-b7a3-4a936a6e8ec9" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:36:06 user nova-compute[72874]: DEBUG nova.network.neutron [req-eac39085-c824-4b4d-a7e5-e22d5c574a89 req-71bdd5b6-85f9-4c67-b462-a4a5e0cafb54 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Refreshing network info cache for port c16a8e4a-00bf-436f-a021-98297ac4e14a {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:36:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Start _get_guest_xml network_info=[{"id": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "address": "fa:16:3e:e5:42:31", "network": {"id": "6fe94371-138a-464d-89fd-9c9f9ebaaecd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-826475339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d802b863c04d0195c73e6ec1889c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16a8e4a-00", "ovs_interfaceid": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:36:06 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:36:06 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:36:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-331170581',display_name='tempest-TestServerVolumeAttachmentScenario-server-331170581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-331170581',id=36,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOY15x83Fv+Mg812YWUFkwpmPG7571+/OVK4LQecRJNVMpRXujdaDtiTPYWHvi5m/Rq2S9GLg4mTdTB7wjDE2DQQtCPGXAuhuzqfNK282QmZLA0t5+oJx/EoPFgrNT+A2Q==',key_name='tempest-keypair-1074304418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d802b863c04d0195c73e6ec1889c8f',ramdisk_id='',reservation_id='r-opr2i1zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1089325841',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1089325841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:36:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd31113bd5164578811f839d549dfd58',uuid=939268df-3817-4cdf-b7a3-4a936a6e8ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "address": "fa:16:3e:e5:42:31", "network": {"id": "6fe94371-138a-464d-89fd-9c9f9ebaaecd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-826475339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d802b863c04d0195c73e6ec1889c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16a8e4a-00", "ovs_interfaceid": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Converting VIF {"id": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "address": "fa:16:3e:e5:42:31", "network": {"id": "6fe94371-138a-464d-89fd-9c9f9ebaaecd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-826475339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d802b863c04d0195c73e6ec1889c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16a8e4a-00", "ovs_interfaceid": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:42:31,bridge_name='br-int',has_traffic_filtering=True,id=c16a8e4a-00bf-436f-a021-98297ac4e14a,network=Network(6fe94371-138a-464d-89fd-9c9f9ebaaecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16a8e4a-00') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.objects.instance [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lazy-loading 'pci_devices' on Instance uuid 939268df-3817-4cdf-b7a3-4a936a6e8ec9 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "dd54e88a-91b7-439c-9d69-7812dacc3932" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:36:07 user nova-compute[72874]:   <uuid>939268df-3817-4cdf-b7a3-4a936a6e8ec9</uuid>
Aug 17 18:36:07 user nova-compute[72874]:   <name>instance-00000024</name>
Aug 17 18:36:07 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:36:07 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:36:07 user nova-compute[72874]:   <metadata>
Aug 17 18:36:07 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:36:07 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:36:07 user nova-compute[72874]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-331170581</nova:name>
Aug 17 18:36:07 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:36:06</nova:creationTime>
Aug 17 18:36:07 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:36:07 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:36:07 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:36:07 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:36:07 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:36:07 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:36:07 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:36:07 user nova-compute[72874]:       <nova:owner>
Aug 17 18:36:07 user nova-compute[72874]:         <nova:user uuid="bd31113bd5164578811f839d549dfd58">tempest-TestServerVolumeAttachmentScenario-1089325841-project-member</nova:user>
Aug 17 18:36:07 user nova-compute[72874]:         <nova:project uuid="70d802b863c04d0195c73e6ec1889c8f">tempest-TestServerVolumeAttachmentScenario-1089325841</nova:project>
Aug 17 18:36:07 user nova-compute[72874]:       </nova:owner>
Aug 17 18:36:07 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:36:07 user nova-compute[72874]:       <nova:ports>
Aug 17 18:36:07 user nova-compute[72874]:         <nova:port uuid="c16a8e4a-00bf-436f-a021-98297ac4e14a">
Aug 17 18:36:07 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 18:36:07 user nova-compute[72874]:         </nova:port>
Aug 17 18:36:07 user nova-compute[72874]:       </nova:ports>
Aug 17 18:36:07 user nova-compute[72874]:     </nova:instance>
Aug 17 18:36:07 user nova-compute[72874]:   </metadata>
Aug 17 18:36:07 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:36:07 user nova-compute[72874]:     <system>
Aug 17 18:36:07 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:36:07 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:36:07 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:36:07 user nova-compute[72874]:       <entry name="serial">939268df-3817-4cdf-b7a3-4a936a6e8ec9</entry>
Aug 17 18:36:07 user nova-compute[72874]:       <entry name="uuid">939268df-3817-4cdf-b7a3-4a936a6e8ec9</entry>
Aug 17 18:36:07 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:36:07 user nova-compute[72874]:     </system>
Aug 17 18:36:07 user nova-compute[72874]:   </sysinfo>
Aug 17 18:36:07 user nova-compute[72874]:   <os>
Aug 17 18:36:07 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:36:07 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:36:07 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:36:07 user nova-compute[72874]:   </os>
Aug 17 18:36:07 user nova-compute[72874]:   <features>
Aug 17 18:36:07 user nova-compute[72874]:     <acpi/>
Aug 17 18:36:07 user nova-compute[72874]:     <apic/>
Aug 17 18:36:07 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:36:07 user nova-compute[72874]:   </features>
Aug 17 18:36:07 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:36:07 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:36:07 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:36:07 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:36:07 user nova-compute[72874]:   </clock>
Aug 17 18:36:07 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:36:07 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:36:07 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:36:07 user nova-compute[72874]:   </cpu>
Aug 17 18:36:07 user nova-compute[72874]:   <devices>
Aug 17 18:36:07 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:36:07 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:36:07 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk"/>
Aug 17 18:36:07 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:36:07 user nova-compute[72874]:     </disk>
Aug 17 18:36:07 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:36:07 user nova-compute[72874]:       <mac address="fa:16:3e:e5:42:31"/>
Aug 17 18:36:07 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:36:07 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:36:07 user nova-compute[72874]:       <target dev="tapc16a8e4a-00"/>
Aug 17 18:36:07 user nova-compute[72874]:     </interface>
Aug 17 18:36:07 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:36:07 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/console.log" append="off"/>
Aug 17 18:36:07 user nova-compute[72874]:     </serial>
Aug 17 18:36:07 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:36:07 user nova-compute[72874]:     <video>
Aug 17 18:36:07 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:36:07 user nova-compute[72874]:     </video>
Aug 17 18:36:07 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:36:07 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:36:07 user nova-compute[72874]:     </rng>
Aug 17 18:36:07 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:36:07 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:36:07 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:36:07 user nova-compute[72874]:     </memballoon>
Aug 17 18:36:07 user nova-compute[72874]:   </devices>
Aug 17 18:36:07 user nova-compute[72874]: </domain>
Aug 17 18:36:07 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:36:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-331170581',display_name='tempest-TestServerVolumeAttachmentScenario-server-331170581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-331170581',id=36,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOY15x83Fv+Mg812YWUFkwpmPG7571+/OVK4LQecRJNVMpRXujdaDtiTPYWHvi5m/Rq2S9GLg4mTdTB7wjDE2DQQtCPGXAuhuzqfNK282QmZLA0t5+oJx/EoPFgrNT+A2Q==',key_name='tempest-keypair-1074304418',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='70d802b863c04d0195c73e6ec1889c8f',ramdisk_id='',reservation_id='r-opr2i1zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1089325841',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1089325841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:36:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd31113bd5164578811f839d549dfd58',uuid=939268df-3817-4cdf-b7a3-4a936a6e8ec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "address": "fa:16:3e:e5:42:31", "network": {"id": "6fe94371-138a-464d-89fd-9c9f9ebaaecd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-826475339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d802b863c04d0195c73e6ec1889c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16a8e4a-00", "ovs_interfaceid": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Converting VIF {"id": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "address": "fa:16:3e:e5:42:31", "network": {"id": "6fe94371-138a-464d-89fd-9c9f9ebaaecd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-826475339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d802b863c04d0195c73e6ec1889c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16a8e4a-00", "ovs_interfaceid": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:42:31,bridge_name='br-int',has_traffic_filtering=True,id=c16a8e4a-00bf-436f-a021-98297ac4e14a,network=Network(6fe94371-138a-464d-89fd-9c9f9ebaaecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16a8e4a-00') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG os_vif [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:42:31,bridge_name='br-int',has_traffic_filtering=True,id=c16a8e4a-00bf-436f-a021-98297ac4e14a,network=Network(6fe94371-138a-464d-89fd-9c9f9ebaaecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16a8e4a-00') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.objects.instance [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'flavor' on Instance uuid dd54e88a-91b7-439c-9d69-7812dacc3932 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc16a8e4a-00, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc16a8e4a-00, col_values=(('external_ids', {'iface-id': 'c16a8e4a-00bf-436f-a021-98297ac4e14a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:42:31', 'vm-uuid': '939268df-3817-4cdf-b7a3-4a936a6e8ec9'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:07 user nova-compute[72874]: INFO os_vif [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:42:31,bridge_name='br-int',has_traffic_filtering=True,id=c16a8e4a-00bf-436f-a021-98297ac4e14a,network=Network(6fe94371-138a-464d-89fd-9c9f9ebaaecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16a8e4a-00')
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] No VIF found with MAC fa:16:3e:e5:42:31, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "dd54e88a-91b7-439c-9d69-7812dacc3932" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:07 user nova-compute[72874]: INFO nova.compute.manager [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Attaching volume 747b0b10-934d-4121-995a-fc1b8c787493 to /dev/vdb
Aug 17 18:36:07 user nova-compute[72874]: DEBUG os_brick.utils [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a413527-c34a-4f0f-82d1-5be2c2e2916b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd3d9d1-1573-4b33-8236-e18fcf4ed40d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.network.neutron [req-eac39085-c824-4b4d-a7e5-e22d5c574a89 req-71bdd5b6-85f9-4c67-b462-a4a5e0cafb54 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Updated VIF entry in instance network info cache for port c16a8e4a-00bf-436f-a021-98297ac4e14a. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.network.neutron [req-eac39085-c824-4b4d-a7e5-e22d5c574a89 req-71bdd5b6-85f9-4c67-b462-a4a5e0cafb54 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Updating instance_info_cache with network_info: [{"id": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "address": "fa:16:3e:e5:42:31", "network": {"id": "6fe94371-138a-464d-89fd-9c9f9ebaaecd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-826475339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d802b863c04d0195c73e6ec1889c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16a8e4a-00", "ovs_interfaceid": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e6a57b-d63b-4301-b775-dd9e549cf2fb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41c7cd3-cadf-47a2-b6bd-7bd1b53faf5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-eac39085-c824-4b4d-a7e5-e22d5c574a89 req-71bdd5b6-85f9-4c67-b462-a4a5e0cafb54 service nova] Releasing lock "refresh_cache-939268df-3817-4cdf-b7a3-4a936a6e8ec9" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:36:07 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:36:07 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[66542c9e-d0ea-489d-9e77-3cb3374b51ed]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG os_brick.utils [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:36:07 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Updating existing volume attachment record: 9cf953ae-1fcd-4fe3-b218-4f8ab1f5d54c {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:36:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:08 user nova-compute[72874]: DEBUG nova.compute.manager [req-5c63316e-2900-47f4-b090-457a46ab8c0d req-15dc19b7-87d3-438a-9afa-cdd82d22cf93 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Received event network-vif-plugged-c16a8e4a-00bf-436f-a021-98297ac4e14a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:36:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5c63316e-2900-47f4-b090-457a46ab8c0d req-15dc19b7-87d3-438a-9afa-cdd82d22cf93 service nova] Acquiring lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5c63316e-2900-47f4-b090-457a46ab8c0d req-15dc19b7-87d3-438a-9afa-cdd82d22cf93 service nova] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5c63316e-2900-47f4-b090-457a46ab8c0d req-15dc19b7-87d3-438a-9afa-cdd82d22cf93 service nova] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:08 user nova-compute[72874]: DEBUG nova.compute.manager [req-5c63316e-2900-47f4-b090-457a46ab8c0d req-15dc19b7-87d3-438a-9afa-cdd82d22cf93 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] No waiting events found dispatching network-vif-plugged-c16a8e4a-00bf-436f-a021-98297ac4e14a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:36:08 user nova-compute[72874]: WARNING nova.compute.manager [req-5c63316e-2900-47f4-b090-457a46ab8c0d req-15dc19b7-87d3-438a-9afa-cdd82d22cf93 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Received unexpected event network-vif-plugged-c16a8e4a-00bf-436f-a021-98297ac4e14a for instance with vm_state building and task_state spawning.
Aug 17 18:36:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297370.479931, 939268df-3817-4cdf-b7a3-4a936a6e8ec9 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:36:10 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] VM Resumed (Lifecycle Event)
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:36:10 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Instance spawned successfully.
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:36:10 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297370.4805083, 939268df-3817-4cdf-b7a3-4a936a6e8ec9 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:36:10 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] VM Started (Lifecycle Event)
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:36:10 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:36:10 user nova-compute[72874]: INFO nova.compute.manager [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-cd01d0e5-1c20-4c37-8f65-32442ab7039b req-16eb1e60-193b-4f66-ba02-1210af2ac326 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Received event network-vif-plugged-c16a8e4a-00bf-436f-a021-98297ac4e14a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:36:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cd01d0e5-1c20-4c37-8f65-32442ab7039b req-16eb1e60-193b-4f66-ba02-1210af2ac326 service nova] Acquiring lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cd01d0e5-1c20-4c37-8f65-32442ab7039b req-16eb1e60-193b-4f66-ba02-1210af2ac326 service nova] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cd01d0e5-1c20-4c37-8f65-32442ab7039b req-16eb1e60-193b-4f66-ba02-1210af2ac326 service nova] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-cd01d0e5-1c20-4c37-8f65-32442ab7039b req-16eb1e60-193b-4f66-ba02-1210af2ac326 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] No waiting events found dispatching network-vif-plugged-c16a8e4a-00bf-436f-a021-98297ac4e14a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:36:10 user nova-compute[72874]: WARNING nova.compute.manager [req-cd01d0e5-1c20-4c37-8f65-32442ab7039b req-16eb1e60-193b-4f66-ba02-1210af2ac326 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Received unexpected event network-vif-plugged-c16a8e4a-00bf-436f-a021-98297ac4e14a for instance with vm_state building and task_state spawning.
Aug 17 18:36:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:10 user nova-compute[72874]: INFO nova.compute.manager [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Took 6.32 seconds to build instance.
Aug 17 18:36:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ce4b8d4a-6a39-4703-9f8c-0c27a539c12e tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.415s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'riqzdAhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:36:18 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:36:18 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:36:18 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f73f920-84cc-4f2c-9baf-8b4b98b15860]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:36:18 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2f238a-9a47-404f-a3d2-e043e8bf4008]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493] added
Aug 17 18:36:18 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[72285e8d-4f2d-44ee-878e-3fa332cc7834]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19729f4-d0aa-496d-8afa-491fb586678f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v riqzdAhT {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v riqzdAhT" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[242e3668-23e1-4f47-b426-e063bcff7c6e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'riqzdAhT'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d3f967-ebfa-4061-8890-01e61e4ce1d5]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e30aac4-3fa5-44bb-9614-4bff68a15fb2]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:36:18 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:36:18 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:36:18 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:36:18 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[67865733-d24d-4b0b-aa05-fa0b1f292a96]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493, portal: 172.16.0.220,3260]
Aug 17 18:36:18 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493, portal: 172.16.0.220,3260] successful.
Aug 17 18:36:18 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[65002564-ce51-4475-882a-82258b9aa51c]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e1ce4a-24e2-4441-9e42-9c2a6faf10d2]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:36:18 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:36:18 user nova-compute[72874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 (non-flash)
Aug 17 18:36:18 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:36:18 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:36:18 user nova-compute[72874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 (non-flash)
Aug 17 18:36:18 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[238fea38-3753-48ac-b886-7c9e3c540673]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:36:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'riqzdAhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:36:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:36:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23162613739616261', 'path': '/dev/sdc'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:36:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162613739616261', 'path': '/dev/sdc'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:36:19 user nova-compute[72874]: DEBUG nova.objects.instance [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'flavor' on Instance uuid dd54e88a-91b7-439c-9d69-7812dacc3932 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:36:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:36:19 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:36:19 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:36:19 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:36:19 user nova-compute[72874]:   <serial>747b0b10-934d-4121-995a-fc1b8c787493</serial>
Aug 17 18:36:19 user nova-compute[72874]: </disk>
Aug 17 18:36:19 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:36:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:36:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:36:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] No VIF found with MAC fa:16:3e:e8:39:6c, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:36:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0500b0f1-d5cb-4769-85e9-d3ef3dea47bd tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.127s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "dd54e88a-91b7-439c-9d69-7812dacc3932" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:21 user nova-compute[72874]: INFO nova.compute.manager [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Detaching volume 747b0b10-934d-4121-995a-fc1b8c787493
Aug 17 18:36:21 user nova-compute[72874]: INFO nova.virt.block_device [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Attempting to driver detach volume 747b0b10-934d-4121-995a-fc1b8c787493 from mountpoint /dev/vdb
Aug 17 18:36:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Attempting to detach device vdb from instance dd54e88a-91b7-439c-9d69-7812dacc3932 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:36:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:36:21 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:36:21 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:36:21 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:36:21 user nova-compute[72874]:   <serial>747b0b10-934d-4121-995a-fc1b8c787493</serial>
Aug 17 18:36:21 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:36:21 user nova-compute[72874]: </disk>
Aug 17 18:36:21 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:36:21 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Successfully detached device vdb from instance dd54e88a-91b7-439c-9d69-7812dacc3932 from the persistent domain config.
Aug 17 18:36:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd54e88a-91b7-439c-9d69-7812dacc3932 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:36:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:36:21 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:36:21 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:36:21 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:36:21 user nova-compute[72874]:   <serial>747b0b10-934d-4121-995a-fc1b8c787493</serial>
Aug 17 18:36:21 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:36:21 user nova-compute[72874]: </disk>
Aug 17 18:36:21 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692297382.2947083, dd54e88a-91b7-439c-9d69-7812dacc3932 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd54e88a-91b7-439c-9d69-7812dacc3932 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:36:22 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Successfully detached device vdb from instance dd54e88a-91b7-439c-9d69-7812dacc3932 from the live domain config.
Aug 17 18:36:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'riqzdAhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:36:22 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c2b32c-62f1-4e0f-8a76-3ebb32387281]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[39feea52-771c-44c3-953a-5c41b34734ed]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:36:22 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:36:22 user nova-compute[72874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 (non-flash)
Aug 17 18:36:22 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:36:22 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:36:22 user nova-compute[72874]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 (non-flash)
Aug 17 18:36:22 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a05e88b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493'): ({'sdc'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Removing single pathed devices sdc {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f55cb3-b07f-4e32-af71-eb03ea350e1f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2dcd0e2-9b0f-4aac-8951-e9e5ad871335]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Flushing IO for device /dev/sdc {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[70733935-568c-40de-9814-76dff785808d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[94eb77e1-a7b9-4cc5-a1d1-332761fb8234]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8c7d2f-4abb-4598-b553-96f45e29df60]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ca4622-ef43-4835-bdc1-8685da28b3cc]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493, portal: 172.16.0.220,3260]
Aug 17 18:36:22 user nova-compute[72874]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493, portal: 172.16.0.220,3260] successful.
Aug 17 18:36:22 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:747b0b10-934d-4121-995a-fc1b8c787493 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.143s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ca5ddc-092b-4144-96c5-e8ed226bc7f7]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] <== disconnect_volume: return (400ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:36:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:36:23 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:36:23 user nova-compute[72874]: DEBUG nova.objects.instance [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'flavor' on Instance uuid dd54e88a-91b7-439c-9d69-7812dacc3932 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:36:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-6d429624-6738-4c00-ae31-ffb5b8ac8efb tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.029s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:36:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:25 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:36:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:36:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:36:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf20bb4-44a7-463d-bf0d-3ba449399b2c/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf20bb4-44a7-463d-bf0d-3ba449399b2c/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf20bb4-44a7-463d-bf0d-3ba449399b2c/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1bf20bb4-44a7-463d-bf0d-3ba449399b2c/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:29 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:36:29 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7540MB free_disk=24.974788665771484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 38df8d14-531a-42f3-8a4e-c53c1a80185f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 1bf20bb4-44a7-463d-bf0d-3ba449399b2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance dd54e88a-91b7-439c-9d69-7812dacc3932 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 66cc888a-561d-4ce2-b07a-2cde7206be8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 939268df-3817-4cdf-b7a3-4a936a6e8ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "66cc888a-561d-4ce2-b07a-2cde7206be8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "66cc888a-561d-4ce2-b07a-2cde7206be8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "66cc888a-561d-4ce2-b07a-2cde7206be8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "66cc888a-561d-4ce2-b07a-2cde7206be8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "66cc888a-561d-4ce2-b07a-2cde7206be8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Terminating instance
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.477s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-6fab1735-edb9-466a-8c7b-686a35c1f393 req-09406d7e-7b9d-4ef2-b34b-a222049558b9 service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Received event network-vif-unplugged-534f68a0-b15f-4b75-94aa-445b580e4246 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6fab1735-edb9-466a-8c7b-686a35c1f393 req-09406d7e-7b9d-4ef2-b34b-a222049558b9 service nova] Acquiring lock "66cc888a-561d-4ce2-b07a-2cde7206be8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6fab1735-edb9-466a-8c7b-686a35c1f393 req-09406d7e-7b9d-4ef2-b34b-a222049558b9 service nova] Lock "66cc888a-561d-4ce2-b07a-2cde7206be8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6fab1735-edb9-466a-8c7b-686a35c1f393 req-09406d7e-7b9d-4ef2-b34b-a222049558b9 service nova] Lock "66cc888a-561d-4ce2-b07a-2cde7206be8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-6fab1735-edb9-466a-8c7b-686a35c1f393 req-09406d7e-7b9d-4ef2-b34b-a222049558b9 service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] No waiting events found dispatching network-vif-unplugged-534f68a0-b15f-4b75-94aa-445b580e4246 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:36:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-6fab1735-edb9-466a-8c7b-686a35c1f393 req-09406d7e-7b9d-4ef2-b34b-a222049558b9 service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Received event network-vif-unplugged-534f68a0-b15f-4b75-94aa-445b580e4246 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:36:30 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Instance destroyed successfully.
Aug 17 18:36:30 user nova-compute[72874]: DEBUG nova.objects.instance [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lazy-loading 'resources' on Instance uuid 66cc888a-561d-4ce2-b07a-2cde7206be8b {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:34:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-297624000',display_name='tempest-VolumesActionsTest-instance-297624000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-297624000',id=35,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:34:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='baf2398b53784944bcd6b54c36d1fec8',ramdisk_id='',reservation_id='r-gbvzmykc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-580827709',owner_user_name='tempest-VolumesActionsTest-580827709-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:34:45Z,user_data=None,user_id='92dfb3e7d65a48209708e823cb8f7ff9',uuid=66cc888a-561d-4ce2-b07a-2cde7206be8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "534f68a0-b15f-4b75-94aa-445b580e4246", "address": "fa:16:3e:eb:00:a8", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534f68a0-b1", "ovs_interfaceid": "534f68a0-b15f-4b75-94aa-445b580e4246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Converting VIF {"id": "534f68a0-b15f-4b75-94aa-445b580e4246", "address": "fa:16:3e:eb:00:a8", "network": {"id": "a9f4937d-de4a-417a-adaf-55d95fe354db", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1957788803-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "baf2398b53784944bcd6b54c36d1fec8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap534f68a0-b1", "ovs_interfaceid": "534f68a0-b15f-4b75-94aa-445b580e4246", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:00:a8,bridge_name='br-int',has_traffic_filtering=True,id=534f68a0-b15f-4b75-94aa-445b580e4246,network=Network(a9f4937d-de4a-417a-adaf-55d95fe354db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534f68a0-b1') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG os_vif [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:00:a8,bridge_name='br-int',has_traffic_filtering=True,id=534f68a0-b15f-4b75-94aa-445b580e4246,network=Network(a9f4937d-de4a-417a-adaf-55d95fe354db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534f68a0-b1') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap534f68a0-b1, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:36:30 user nova-compute[72874]: INFO os_vif [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:00:a8,bridge_name='br-int',has_traffic_filtering=True,id=534f68a0-b15f-4b75-94aa-445b580e4246,network=Network(a9f4937d-de4a-417a-adaf-55d95fe354db),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap534f68a0-b1')
Aug 17 18:36:30 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Deleting instance files /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b_del
Aug 17 18:36:30 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Deletion of /opt/stack/data/nova/instances/66cc888a-561d-4ce2-b07a-2cde7206be8b_del complete
Aug 17 18:36:30 user nova-compute[72874]: INFO nova.compute.manager [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 17 18:36:30 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Skipping network cache update for instance because it is being deleted. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid 9b638f7b-ba47-403f-be22-a65a39ed8438 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:36:30 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Took 0.63 seconds to deallocate network for instance.
Aug 17 18:36:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:31 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:36:31 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:36:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.294s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:31 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Deleted allocations for instance 66cc888a-561d-4ce2-b07a-2cde7206be8b
Aug 17 18:36:31 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Updating instance_info_cache with network_info: [{"id": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "address": "fa:16:3e:25:a4:9a", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e25bfc2-df", "ovs_interfaceid": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:36:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5e594a97-c5f3-4738-a7e2-9d633e42b7f8 tempest-VolumesActionsTest-580827709 tempest-VolumesActionsTest-580827709-project-member] Lock "66cc888a-561d-4ce2-b07a-2cde7206be8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.958s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:36:31 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:36:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:36:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:36:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:36:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:36:31 user nova-compute[72874]: DEBUG nova.compute.manager [req-0e9da0ad-9b3e-4b2c-8515-5f1877944bcd req-fc16a984-5134-4eb8-b3da-2d7d2d69863b service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Received event network-vif-plugged-534f68a0-b15f-4b75-94aa-445b580e4246 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:36:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0e9da0ad-9b3e-4b2c-8515-5f1877944bcd req-fc16a984-5134-4eb8-b3da-2d7d2d69863b service nova] Acquiring lock "66cc888a-561d-4ce2-b07a-2cde7206be8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0e9da0ad-9b3e-4b2c-8515-5f1877944bcd req-fc16a984-5134-4eb8-b3da-2d7d2d69863b service nova] Lock "66cc888a-561d-4ce2-b07a-2cde7206be8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0e9da0ad-9b3e-4b2c-8515-5f1877944bcd req-fc16a984-5134-4eb8-b3da-2d7d2d69863b service nova] Lock "66cc888a-561d-4ce2-b07a-2cde7206be8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:31 user nova-compute[72874]: DEBUG nova.compute.manager [req-0e9da0ad-9b3e-4b2c-8515-5f1877944bcd req-fc16a984-5134-4eb8-b3da-2d7d2d69863b service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] No waiting events found dispatching network-vif-plugged-534f68a0-b15f-4b75-94aa-445b580e4246 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:36:31 user nova-compute[72874]: WARNING nova.compute.manager [req-0e9da0ad-9b3e-4b2c-8515-5f1877944bcd req-fc16a984-5134-4eb8-b3da-2d7d2d69863b service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Received unexpected event network-vif-plugged-534f68a0-b15f-4b75-94aa-445b580e4246 for instance with vm_state deleted and task_state None.
Aug 17 18:36:31 user nova-compute[72874]: DEBUG nova.compute.manager [req-0e9da0ad-9b3e-4b2c-8515-5f1877944bcd req-fc16a984-5134-4eb8-b3da-2d7d2d69863b service nova] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Received event network-vif-deleted-534f68a0-b15f-4b75-94aa-445b580e4246 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:36:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:37 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:36:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:36:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:45 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297390.0694118, 66cc888a-561d-4ce2-b07a-2cde7206be8b => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:36:45 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] VM Stopped (Lifecycle Event)
Aug 17 18:36:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-1161d62e-9cf5-4bbf-bd63-bf28f6db9cef None None] [instance: 66cc888a-561d-4ce2-b07a-2cde7206be8b] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:36:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "1cbc48a0-476c-46bf-a30b-9875c08d818a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "1cbc48a0-476c-46bf-a30b-9875c08d818a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:36:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:36:50 user nova-compute[72874]: INFO nova.compute.claims [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Claim successful on node user
Aug 17 18:36:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:36:51 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:36:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:36:51 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Creating image(s)
Aug 17 18:36:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "/opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "/opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "/opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG nova.policy [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '500d14cc838b4812bd7a5d36336ae6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eab2a4b0d14b11b488bcc6a8638134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.438s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk 1073741824" returned: 0 in 0.051s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.495s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Successfully created port: e9ab5da3-c723-42e4-b704-b4c68e4dfe55 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Cannot resize image /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG nova.objects.instance [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lazy-loading 'migration_context' on Instance uuid 1cbc48a0-476c-46bf-a30b-9875c08d818a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Ensure instance console log exists: /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Successfully updated port: e9ab5da3-c723-42e4-b704-b4c68e4dfe55 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "refresh_cache-1cbc48a0-476c-46bf-a30b-9875c08d818a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquired lock "refresh_cache-1cbc48a0-476c-46bf-a30b-9875c08d818a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-b3c90680-79a8-4626-8b86-ec2b266f6867 req-32dad472-bd01-4fbc-aab6-abf2427c87d3 service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Received event network-changed-e9ab5da3-c723-42e4-b704-b4c68e4dfe55 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-b3c90680-79a8-4626-8b86-ec2b266f6867 req-32dad472-bd01-4fbc-aab6-abf2427c87d3 service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Refreshing instance network info cache due to event network-changed-e9ab5da3-c723-42e4-b704-b4c68e4dfe55. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:36:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b3c90680-79a8-4626-8b86-ec2b266f6867 req-32dad472-bd01-4fbc-aab6-abf2427c87d3 service nova] Acquiring lock "refresh_cache-1cbc48a0-476c-46bf-a30b-9875c08d818a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Updating instance_info_cache with network_info: [{"id": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "address": "fa:16:3e:14:98:96", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ab5da3-c7", "ovs_interfaceid": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Releasing lock "refresh_cache-1cbc48a0-476c-46bf-a30b-9875c08d818a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Instance network_info: |[{"id": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "address": "fa:16:3e:14:98:96", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ab5da3-c7", "ovs_interfaceid": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b3c90680-79a8-4626-8b86-ec2b266f6867 req-32dad472-bd01-4fbc-aab6-abf2427c87d3 service nova] Acquired lock "refresh_cache-1cbc48a0-476c-46bf-a30b-9875c08d818a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.network.neutron [req-b3c90680-79a8-4626-8b86-ec2b266f6867 req-32dad472-bd01-4fbc-aab6-abf2427c87d3 service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Refreshing network info cache for port e9ab5da3-c723-42e4-b704-b4c68e4dfe55 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Start _get_guest_xml network_info=[{"id": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "address": "fa:16:3e:14:98:96", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ab5da3-c7", "ovs_interfaceid": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:36:53 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:36:53 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-186884759',display_name='tempest-ServersNegativeTestJSON-server-186884759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-186884759',id=37,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1eab2a4b0d14b11b488bcc6a8638134',ramdisk_id='',reservation_id='r-9uc90pyk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-754663374',owner_user_name='tempest-ServersNegativeTestJSON-754663374-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:36:51Z,user_data=None,user_id='500d14cc838b4812bd7a5d36336ae6ae',uuid=1cbc48a0-476c-46bf-a30b-9875c08d818a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "address": "fa:16:3e:14:98:96", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ab5da3-c7", "ovs_interfaceid": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Converting VIF {"id": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "address": "fa:16:3e:14:98:96", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ab5da3-c7", "ovs_interfaceid": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:96,bridge_name='br-int',has_traffic_filtering=True,id=e9ab5da3-c723-42e4-b704-b4c68e4dfe55,network=Network(518607ac-ae8a-4a0e-823a-0b65d7de624b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ab5da3-c7') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.objects.instance [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lazy-loading 'pci_devices' on Instance uuid 1cbc48a0-476c-46bf-a30b-9875c08d818a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:36:53 user nova-compute[72874]:   <uuid>1cbc48a0-476c-46bf-a30b-9875c08d818a</uuid>
Aug 17 18:36:53 user nova-compute[72874]:   <name>instance-00000025</name>
Aug 17 18:36:53 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:36:53 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:36:53 user nova-compute[72874]:   <metadata>
Aug 17 18:36:53 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:36:53 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:36:53 user nova-compute[72874]:       <nova:name>tempest-ServersNegativeTestJSON-server-186884759</nova:name>
Aug 17 18:36:53 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:36:53</nova:creationTime>
Aug 17 18:36:53 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:36:53 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:36:53 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:36:53 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:36:53 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:36:53 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:36:53 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:36:53 user nova-compute[72874]:       <nova:owner>
Aug 17 18:36:53 user nova-compute[72874]:         <nova:user uuid="500d14cc838b4812bd7a5d36336ae6ae">tempest-ServersNegativeTestJSON-754663374-project-member</nova:user>
Aug 17 18:36:53 user nova-compute[72874]:         <nova:project uuid="a1eab2a4b0d14b11b488bcc6a8638134">tempest-ServersNegativeTestJSON-754663374</nova:project>
Aug 17 18:36:53 user nova-compute[72874]:       </nova:owner>
Aug 17 18:36:53 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:36:53 user nova-compute[72874]:       <nova:ports>
Aug 17 18:36:53 user nova-compute[72874]:         <nova:port uuid="e9ab5da3-c723-42e4-b704-b4c68e4dfe55">
Aug 17 18:36:53 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 18:36:53 user nova-compute[72874]:         </nova:port>
Aug 17 18:36:53 user nova-compute[72874]:       </nova:ports>
Aug 17 18:36:53 user nova-compute[72874]:     </nova:instance>
Aug 17 18:36:53 user nova-compute[72874]:   </metadata>
Aug 17 18:36:53 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:36:53 user nova-compute[72874]:     <system>
Aug 17 18:36:53 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:36:53 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:36:53 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:36:53 user nova-compute[72874]:       <entry name="serial">1cbc48a0-476c-46bf-a30b-9875c08d818a</entry>
Aug 17 18:36:53 user nova-compute[72874]:       <entry name="uuid">1cbc48a0-476c-46bf-a30b-9875c08d818a</entry>
Aug 17 18:36:53 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:36:53 user nova-compute[72874]:     </system>
Aug 17 18:36:53 user nova-compute[72874]:   </sysinfo>
Aug 17 18:36:53 user nova-compute[72874]:   <os>
Aug 17 18:36:53 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:36:53 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:36:53 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:36:53 user nova-compute[72874]:   </os>
Aug 17 18:36:53 user nova-compute[72874]:   <features>
Aug 17 18:36:53 user nova-compute[72874]:     <acpi/>
Aug 17 18:36:53 user nova-compute[72874]:     <apic/>
Aug 17 18:36:53 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:36:53 user nova-compute[72874]:   </features>
Aug 17 18:36:53 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:36:53 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:36:53 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:36:53 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:36:53 user nova-compute[72874]:   </clock>
Aug 17 18:36:53 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:36:53 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:36:53 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:36:53 user nova-compute[72874]:   </cpu>
Aug 17 18:36:53 user nova-compute[72874]:   <devices>
Aug 17 18:36:53 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:36:53 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:36:53 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk"/>
Aug 17 18:36:53 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:36:53 user nova-compute[72874]:     </disk>
Aug 17 18:36:53 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:36:53 user nova-compute[72874]:       <mac address="fa:16:3e:14:98:96"/>
Aug 17 18:36:53 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:36:53 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:36:53 user nova-compute[72874]:       <target dev="tape9ab5da3-c7"/>
Aug 17 18:36:53 user nova-compute[72874]:     </interface>
Aug 17 18:36:53 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:36:53 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/console.log" append="off"/>
Aug 17 18:36:53 user nova-compute[72874]:     </serial>
Aug 17 18:36:53 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:36:53 user nova-compute[72874]:     <video>
Aug 17 18:36:53 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:36:53 user nova-compute[72874]:     </video>
Aug 17 18:36:53 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:36:53 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:36:53 user nova-compute[72874]:     </rng>
Aug 17 18:36:53 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:36:53 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:36:53 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:36:53 user nova-compute[72874]:     </memballoon>
Aug 17 18:36:53 user nova-compute[72874]:   </devices>
Aug 17 18:36:53 user nova-compute[72874]: </domain>
Aug 17 18:36:53 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-186884759',display_name='tempest-ServersNegativeTestJSON-server-186884759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-186884759',id=37,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1eab2a4b0d14b11b488bcc6a8638134',ramdisk_id='',reservation_id='r-9uc90pyk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-754663374',owner_user_name='tempest-ServersNegativeTestJSON-754663374-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:36:51Z,user_data=None,user_id='500d14cc838b4812bd7a5d36336ae6ae',uuid=1cbc48a0-476c-46bf-a30b-9875c08d818a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "address": "fa:16:3e:14:98:96", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ab5da3-c7", "ovs_interfaceid": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Converting VIF {"id": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "address": "fa:16:3e:14:98:96", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ab5da3-c7", "ovs_interfaceid": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:96,bridge_name='br-int',has_traffic_filtering=True,id=e9ab5da3-c723-42e4-b704-b4c68e4dfe55,network=Network(518607ac-ae8a-4a0e-823a-0b65d7de624b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ab5da3-c7') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG os_vif [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:96,bridge_name='br-int',has_traffic_filtering=True,id=e9ab5da3-c723-42e4-b704-b4c68e4dfe55,network=Network(518607ac-ae8a-4a0e-823a-0b65d7de624b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ab5da3-c7') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9ab5da3-c7, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape9ab5da3-c7, col_values=(('external_ids', {'iface-id': 'e9ab5da3-c723-42e4-b704-b4c68e4dfe55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:98:96', 'vm-uuid': '1cbc48a0-476c-46bf-a30b-9875c08d818a'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:53 user nova-compute[72874]: INFO os_vif [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:98:96,bridge_name='br-int',has_traffic_filtering=True,id=e9ab5da3-c723-42e4-b704-b4c68e4dfe55,network=Network(518607ac-ae8a-4a0e-823a-0b65d7de624b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ab5da3-c7')
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:36:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] No VIF found with MAC fa:16:3e:14:98:96, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:36:54 user nova-compute[72874]: DEBUG nova.network.neutron [req-b3c90680-79a8-4626-8b86-ec2b266f6867 req-32dad472-bd01-4fbc-aab6-abf2427c87d3 service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Updated VIF entry in instance network info cache for port e9ab5da3-c723-42e4-b704-b4c68e4dfe55. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:36:54 user nova-compute[72874]: DEBUG nova.network.neutron [req-b3c90680-79a8-4626-8b86-ec2b266f6867 req-32dad472-bd01-4fbc-aab6-abf2427c87d3 service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Updating instance_info_cache with network_info: [{"id": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "address": "fa:16:3e:14:98:96", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ab5da3-c7", "ovs_interfaceid": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:36:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b3c90680-79a8-4626-8b86-ec2b266f6867 req-32dad472-bd01-4fbc-aab6-abf2427c87d3 service nova] Releasing lock "refresh_cache-1cbc48a0-476c-46bf-a30b-9875c08d818a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:36:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-2568fc6f-fe3c-49c9-b804-f31ffac02aca req-0429770a-c1f0-4538-a251-b64b986cfdbf service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Received event network-vif-plugged-e9ab5da3-c723-42e4-b704-b4c68e4dfe55 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:36:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2568fc6f-fe3c-49c9-b804-f31ffac02aca req-0429770a-c1f0-4538-a251-b64b986cfdbf service nova] Acquiring lock "1cbc48a0-476c-46bf-a30b-9875c08d818a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2568fc6f-fe3c-49c9-b804-f31ffac02aca req-0429770a-c1f0-4538-a251-b64b986cfdbf service nova] Lock "1cbc48a0-476c-46bf-a30b-9875c08d818a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2568fc6f-fe3c-49c9-b804-f31ffac02aca req-0429770a-c1f0-4538-a251-b64b986cfdbf service nova] Lock "1cbc48a0-476c-46bf-a30b-9875c08d818a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-2568fc6f-fe3c-49c9-b804-f31ffac02aca req-0429770a-c1f0-4538-a251-b64b986cfdbf service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] No waiting events found dispatching network-vif-plugged-e9ab5da3-c723-42e4-b704-b4c68e4dfe55 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:36:55 user nova-compute[72874]: WARNING nova.compute.manager [req-2568fc6f-fe3c-49c9-b804-f31ffac02aca req-0429770a-c1f0-4538-a251-b64b986cfdbf service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Received unexpected event network-vif-plugged-e9ab5da3-c723-42e4-b704-b4c68e4dfe55 for instance with vm_state building and task_state spawning.
Aug 17 18:36:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297417.251549, 1cbc48a0-476c-46bf-a30b-9875c08d818a => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:36:57 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] VM Resumed (Lifecycle Event)
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:36:57 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Instance spawned successfully.
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:36:57 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297417.2551513, 1cbc48a0-476c-46bf-a30b-9875c08d818a => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:36:57 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] VM Started (Lifecycle Event)
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:36:57 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:36:57 user nova-compute[72874]: INFO nova.compute.manager [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Took 6.10 seconds to spawn the instance on the hypervisor.
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-45f1489b-4398-4adf-a3b1-acfb6f24bba2 req-47ad0141-b376-43ac-8f91-aa883a1e3b61 service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Received event network-vif-plugged-e9ab5da3-c723-42e4-b704-b4c68e4dfe55 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:36:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-45f1489b-4398-4adf-a3b1-acfb6f24bba2 req-47ad0141-b376-43ac-8f91-aa883a1e3b61 service nova] Acquiring lock "1cbc48a0-476c-46bf-a30b-9875c08d818a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:36:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-45f1489b-4398-4adf-a3b1-acfb6f24bba2 req-47ad0141-b376-43ac-8f91-aa883a1e3b61 service nova] Lock "1cbc48a0-476c-46bf-a30b-9875c08d818a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:36:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-45f1489b-4398-4adf-a3b1-acfb6f24bba2 req-47ad0141-b376-43ac-8f91-aa883a1e3b61 service nova] Lock "1cbc48a0-476c-46bf-a30b-9875c08d818a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-45f1489b-4398-4adf-a3b1-acfb6f24bba2 req-47ad0141-b376-43ac-8f91-aa883a1e3b61 service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] No waiting events found dispatching network-vif-plugged-e9ab5da3-c723-42e4-b704-b4c68e4dfe55 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:36:57 user nova-compute[72874]: WARNING nova.compute.manager [req-45f1489b-4398-4adf-a3b1-acfb6f24bba2 req-47ad0141-b376-43ac-8f91-aa883a1e3b61 service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Received unexpected event network-vif-plugged-e9ab5da3-c723-42e4-b704-b4c68e4dfe55 for instance with vm_state building and task_state spawning.
Aug 17 18:36:57 user nova-compute[72874]: INFO nova.compute.manager [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Took 6.79 seconds to build instance.
Aug 17 18:36:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2e39b067-51cc-4cba-bdca-1f7decd1c175 tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "1cbc48a0-476c-46bf-a30b-9875c08d818a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.875s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:36:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "dd54e88a-91b7-439c-9d69-7812dacc3932" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "dd54e88a-91b7-439c-9d69-7812dacc3932-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:12 user nova-compute[72874]: INFO nova.compute.manager [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Terminating instance
Aug 17 18:37:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-0dd571b4-760c-492d-a5bf-444993e534a0 req-8961ea05-1a75-434e-bef6-d552267a9eae service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Received event network-vif-unplugged-5f197504-5f21-4940-84a4-d0116f895319 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0dd571b4-760c-492d-a5bf-444993e534a0 req-8961ea05-1a75-434e-bef6-d552267a9eae service nova] Acquiring lock "dd54e88a-91b7-439c-9d69-7812dacc3932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0dd571b4-760c-492d-a5bf-444993e534a0 req-8961ea05-1a75-434e-bef6-d552267a9eae service nova] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0dd571b4-760c-492d-a5bf-444993e534a0 req-8961ea05-1a75-434e-bef6-d552267a9eae service nova] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-0dd571b4-760c-492d-a5bf-444993e534a0 req-8961ea05-1a75-434e-bef6-d552267a9eae service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] No waiting events found dispatching network-vif-unplugged-5f197504-5f21-4940-84a4-d0116f895319 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-0dd571b4-760c-492d-a5bf-444993e534a0 req-8961ea05-1a75-434e-bef6-d552267a9eae service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Received event network-vif-unplugged-5f197504-5f21-4940-84a4-d0116f895319 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:37:12 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Instance destroyed successfully.
Aug 17 18:37:12 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lazy-loading 'resources' on Instance uuid dd54e88a-91b7-439c-9d69-7812dacc3932 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:34:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-477220644',display_name='tempest-AttachVolumeNegativeTest-server-477220644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-477220644',id=34,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnj2YznEcxCKBbM2e2LGaYwcleJIOFX1jLo0GqXJ7Hoq+E5F6UKTOFT+NCnUwYYStxUwtPwLTWDKWNW8dUoCC+q74lNLGCZxCI/Zdis+iaazEPymwdIJ7XBsDYcwpQcQw==',key_name='tempest-keypair-1143954971',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:34:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d44ed4bf46e4f6bb8d9f9255bfceded',ramdisk_id='',reservation_id='r-ncs1qdcx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1092460488',owner_user_name='tempest-AttachVolumeNegativeTest-1092460488-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:34:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='37eba99d36a842ca93af2d82be67dea1',uuid=dd54e88a-91b7-439c-9d69-7812dacc3932,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f197504-5f21-4940-84a4-d0116f895319", "address": "fa:16:3e:e8:39:6c", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f197504-5f", "ovs_interfaceid": "5f197504-5f21-4940-84a4-d0116f895319", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converting VIF {"id": "5f197504-5f21-4940-84a4-d0116f895319", "address": "fa:16:3e:e8:39:6c", "network": {"id": "11eedcb6-158a-491b-b846-bed22089e619", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1500806778-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d44ed4bf46e4f6bb8d9f9255bfceded", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f197504-5f", "ovs_interfaceid": "5f197504-5f21-4940-84a4-d0116f895319", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:39:6c,bridge_name='br-int',has_traffic_filtering=True,id=5f197504-5f21-4940-84a4-d0116f895319,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f197504-5f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG os_vif [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:39:6c,bridge_name='br-int',has_traffic_filtering=True,id=5f197504-5f21-4940-84a4-d0116f895319,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f197504-5f') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f197504-5f, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:37:12 user nova-compute[72874]: INFO os_vif [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:39:6c,bridge_name='br-int',has_traffic_filtering=True,id=5f197504-5f21-4940-84a4-d0116f895319,network=Network(11eedcb6-158a-491b-b846-bed22089e619),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f197504-5f')
Aug 17 18:37:12 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Deleting instance files /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932_del
Aug 17 18:37:12 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Deletion of /opt/stack/data/nova/instances/dd54e88a-91b7-439c-9d69-7812dacc3932_del complete
Aug 17 18:37:12 user nova-compute[72874]: INFO nova.compute.manager [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 17 18:37:12 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:37:12 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:37:13 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:37:13 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Took 0.92 seconds to deallocate network for instance.
Aug 17 18:37:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:14 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:37:14 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:37:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:14 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Deleted allocations for instance dd54e88a-91b7-439c-9d69-7812dacc3932
Aug 17 18:37:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e6582157-f7d8-4266-8d02-6067c173c1e3 tempest-AttachVolumeNegativeTest-1092460488 tempest-AttachVolumeNegativeTest-1092460488-project-member] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.215s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:14 user nova-compute[72874]: DEBUG nova.compute.manager [req-8927e36b-9432-4147-8dcc-e2d019952d8a req-078975dc-6a91-4e9d-9d4a-0464c2f3d3a8 service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Received event network-vif-plugged-5f197504-5f21-4940-84a4-d0116f895319 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:37:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8927e36b-9432-4147-8dcc-e2d019952d8a req-078975dc-6a91-4e9d-9d4a-0464c2f3d3a8 service nova] Acquiring lock "dd54e88a-91b7-439c-9d69-7812dacc3932-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8927e36b-9432-4147-8dcc-e2d019952d8a req-078975dc-6a91-4e9d-9d4a-0464c2f3d3a8 service nova] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8927e36b-9432-4147-8dcc-e2d019952d8a req-078975dc-6a91-4e9d-9d4a-0464c2f3d3a8 service nova] Lock "dd54e88a-91b7-439c-9d69-7812dacc3932-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:14 user nova-compute[72874]: DEBUG nova.compute.manager [req-8927e36b-9432-4147-8dcc-e2d019952d8a req-078975dc-6a91-4e9d-9d4a-0464c2f3d3a8 service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] No waiting events found dispatching network-vif-plugged-5f197504-5f21-4940-84a4-d0116f895319 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:37:14 user nova-compute[72874]: WARNING nova.compute.manager [req-8927e36b-9432-4147-8dcc-e2d019952d8a req-078975dc-6a91-4e9d-9d4a-0464c2f3d3a8 service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Received unexpected event network-vif-plugged-5f197504-5f21-4940-84a4-d0116f895319 for instance with vm_state deleted and task_state None.
Aug 17 18:37:14 user nova-compute[72874]: DEBUG nova.compute.manager [req-8927e36b-9432-4147-8dcc-e2d019952d8a req-078975dc-6a91-4e9d-9d4a-0464c2f3d3a8 service nova] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Received event network-vif-deleted-5f197504-5f21-4940-84a4-d0116f895319 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:37:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:18 user nova-compute[72874]: INFO nova.compute.manager [None req-45d2bbe3-25ef-4501-804b-59a75d9ea480 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Unrescuing
Aug 17 18:37:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-45d2bbe3-25ef-4501-804b-59a75d9ea480 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "refresh_cache-1bf20bb4-44a7-463d-bf0d-3ba449399b2c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:37:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-45d2bbe3-25ef-4501-804b-59a75d9ea480 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquired lock "refresh_cache-1bf20bb4-44a7-463d-bf0d-3ba449399b2c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:37:18 user nova-compute[72874]: DEBUG nova.network.neutron [None req-45d2bbe3-25ef-4501-804b-59a75d9ea480 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:37:18 user nova-compute[72874]: DEBUG nova.network.neutron [None req-45d2bbe3-25ef-4501-804b-59a75d9ea480 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Updating instance_info_cache with network_info: [{"id": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "address": "fa:16:3e:f3:05:5e", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd701e5dd-9a", "ovs_interfaceid": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:37:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-45d2bbe3-25ef-4501-804b-59a75d9ea480 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Releasing lock "refresh_cache-1bf20bb4-44a7-463d-bf0d-3ba449399b2c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:37:18 user nova-compute[72874]: DEBUG nova.objects.instance [None req-45d2bbe3-25ef-4501-804b-59a75d9ea480 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'flavor' on Instance uuid 1bf20bb4-44a7-463d-bf0d-3ba449399b2c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:37:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:18 user nova-compute[72874]: DEBUG nova.compute.manager [req-b88355fb-7c39-4f7c-a868-7662af815fc4 req-5b652c52-9a05-4353-85b5-0e4d7347a6b9 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received event network-vif-unplugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:37:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b88355fb-7c39-4f7c-a868-7662af815fc4 req-5b652c52-9a05-4353-85b5-0e4d7347a6b9 service nova] Acquiring lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b88355fb-7c39-4f7c-a868-7662af815fc4 req-5b652c52-9a05-4353-85b5-0e4d7347a6b9 service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b88355fb-7c39-4f7c-a868-7662af815fc4 req-5b652c52-9a05-4353-85b5-0e4d7347a6b9 service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:18 user nova-compute[72874]: DEBUG nova.compute.manager [req-b88355fb-7c39-4f7c-a868-7662af815fc4 req-5b652c52-9a05-4353-85b5-0e4d7347a6b9 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] No waiting events found dispatching network-vif-unplugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:37:18 user nova-compute[72874]: WARNING nova.compute.manager [req-b88355fb-7c39-4f7c-a868-7662af815fc4 req-5b652c52-9a05-4353-85b5-0e4d7347a6b9 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received unexpected event network-vif-unplugged-d701e5dd-9a42-44c9-8ca1-c645f382220a for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:37:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:19 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Instance destroyed successfully.
Aug 17 18:37:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:20 user nova-compute[72874]: DEBUG nova.compute.manager [req-cddbace9-4e21-4552-ad6a-17082782b03d req-64fb031d-db8d-46d2-91ed-b80ca11d159c service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:37:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cddbace9-4e21-4552-ad6a-17082782b03d req-64fb031d-db8d-46d2-91ed-b80ca11d159c service nova] Acquiring lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cddbace9-4e21-4552-ad6a-17082782b03d req-64fb031d-db8d-46d2-91ed-b80ca11d159c service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-cddbace9-4e21-4552-ad6a-17082782b03d req-64fb031d-db8d-46d2-91ed-b80ca11d159c service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:20 user nova-compute[72874]: DEBUG nova.compute.manager [req-cddbace9-4e21-4552-ad6a-17082782b03d req-64fb031d-db8d-46d2-91ed-b80ca11d159c service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] No waiting events found dispatching network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:37:20 user nova-compute[72874]: WARNING nova.compute.manager [req-cddbace9-4e21-4552-ad6a-17082782b03d req-64fb031d-db8d-46d2-91ed-b80ca11d159c service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received unexpected event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:37:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:37:22 user nova-compute[72874]: INFO nova.compute.claims [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Claim successful on node user
Aug 17 18:37:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG nova.compute.manager [req-26fc34a2-eae3-436b-ae19-379cfb360281 req-f02e96cc-cf3e-4824-8887-4beaf0710fca service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-26fc34a2-eae3-436b-ae19-379cfb360281 req-f02e96cc-cf3e-4824-8887-4beaf0710fca service nova] Acquiring lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-26fc34a2-eae3-436b-ae19-379cfb360281 req-f02e96cc-cf3e-4824-8887-4beaf0710fca service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-26fc34a2-eae3-436b-ae19-379cfb360281 req-f02e96cc-cf3e-4824-8887-4beaf0710fca service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG nova.compute.manager [req-26fc34a2-eae3-436b-ae19-379cfb360281 req-f02e96cc-cf3e-4824-8887-4beaf0710fca service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] No waiting events found dispatching network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:37:22 user nova-compute[72874]: WARNING nova.compute.manager [req-26fc34a2-eae3-436b-ae19-379cfb360281 req-f02e96cc-cf3e-4824-8887-4beaf0710fca service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received unexpected event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:37:22 user nova-compute[72874]: DEBUG nova.compute.manager [req-26fc34a2-eae3-436b-ae19-379cfb360281 req-f02e96cc-cf3e-4824-8887-4beaf0710fca service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-26fc34a2-eae3-436b-ae19-379cfb360281 req-f02e96cc-cf3e-4824-8887-4beaf0710fca service nova] Acquiring lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-26fc34a2-eae3-436b-ae19-379cfb360281 req-f02e96cc-cf3e-4824-8887-4beaf0710fca service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-26fc34a2-eae3-436b-ae19-379cfb360281 req-f02e96cc-cf3e-4824-8887-4beaf0710fca service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG nova.compute.manager [req-26fc34a2-eae3-436b-ae19-379cfb360281 req-f02e96cc-cf3e-4824-8887-4beaf0710fca service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] No waiting events found dispatching network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:37:22 user nova-compute[72874]: WARNING nova.compute.manager [req-26fc34a2-eae3-436b-ae19-379cfb360281 req-f02e96cc-cf3e-4824-8887-4beaf0710fca service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received unexpected event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:37:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Removed pending event for 1bf20bb4-44a7-463d-bf0d-3ba449399b2c due to event {{(pid=72874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297442.8224175, 1bf20bb4-44a7-463d-bf0d-3ba449399b2c => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:37:22 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] VM Resumed (Lifecycle Event)
Aug 17 18:37:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-45d2bbe3-25ef-4501-804b-59a75d9ea480 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:37:22 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 18:37:22 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297442.8292792, 1bf20bb4-44a7-463d-bf0d-3ba449399b2c => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:37:22 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] VM Started (Lifecycle Event)
Aug 17 18:37:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:37:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG nova.network.neutron [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:37:23 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:37:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG nova.policy [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3143ae598e814e359466d90e74f9b00c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6287735c21fb4b43b3cbd9e0d742b0ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:37:23 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Creating image(s)
Aug 17 18:37:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "/opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "/opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.194s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk 1073741824" returned: 0 in 0.126s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:23 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Successfully created port: 50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.195s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Cannot resize image /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG nova.objects.instance [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'migration_context' on Instance uuid c4d2b606-6c62-4fad-91b6-a9e333c7cf30 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Ensure instance console log exists: /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Successfully updated port: 50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquired lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-09a5dd92-d354-4d99-8248-e26a9df76979 req-85304898-e588-4cb9-ba4d-2a10417fb556 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-changed-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG nova.compute.manager [req-09a5dd92-d354-4d99-8248-e26a9df76979 req-85304898-e588-4cb9-ba4d-2a10417fb556 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Refreshing instance network info cache due to event network-changed-50497298-f834-4b53-ae7a-8fa2482fa36c. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-09a5dd92-d354-4d99-8248-e26a9df76979 req-85304898-e588-4cb9-ba4d-2a10417fb556 service nova] Acquiring lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:37:24 user nova-compute[72874]: DEBUG nova.network.neutron [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.network.neutron [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Updating instance_info_cache with network_info: [{"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Releasing lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Instance network_info: |[{"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-09a5dd92-d354-4d99-8248-e26a9df76979 req-85304898-e588-4cb9-ba4d-2a10417fb556 service nova] Acquired lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.network.neutron [req-09a5dd92-d354-4d99-8248-e26a9df76979 req-85304898-e588-4cb9-ba4d-2a10417fb556 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Refreshing network info cache for port 50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Start _get_guest_xml network_info=[{"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:25 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:37:25 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1055707657',display_name='tempest-ServerRescueNegativeTestJSON-server-1055707657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1055707657',id=38,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3iTq9nQBkw6d5pdNe1FZAZTAW88Yk72scauvf0O1vFLhQ6P6ltfdRJDSZUaOOg8xwo+pIfXWyM0kcGTBt1oOUXk+kw323QJuB4UFVz1ZjtHmd8vO+HqSgQ+qqe2Eub2w==',key_name='tempest-keypair-931894594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6287735c21fb4b43b3cbd9e0d742b0ec',ramdisk_id='',reservation_id='r-sbi7tlp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-717723449',owner_user_name='tempest-ServerRescueNegativeTestJSON-717723449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3143ae598e814e359466d90e74f9b00c',uuid=c4d2b606-6c62-4fad-91b6-a9e333c7cf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converting VIF {"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a1:2c,bridge_name='br-int',has_traffic_filtering=True,id=50497298-f834-4b53-ae7a-8fa2482fa36c,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50497298-f8') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.objects.instance [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'pci_devices' on Instance uuid c4d2b606-6c62-4fad-91b6-a9e333c7cf30 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:37:25 user nova-compute[72874]:   <uuid>c4d2b606-6c62-4fad-91b6-a9e333c7cf30</uuid>
Aug 17 18:37:25 user nova-compute[72874]:   <name>instance-00000026</name>
Aug 17 18:37:25 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:37:25 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:37:25 user nova-compute[72874]:   <metadata>
Aug 17 18:37:25 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:37:25 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:37:25 user nova-compute[72874]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1055707657</nova:name>
Aug 17 18:37:25 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:37:25</nova:creationTime>
Aug 17 18:37:25 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:37:25 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:37:25 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:37:25 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:37:25 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:37:25 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:37:25 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:37:25 user nova-compute[72874]:       <nova:owner>
Aug 17 18:37:25 user nova-compute[72874]:         <nova:user uuid="3143ae598e814e359466d90e74f9b00c">tempest-ServerRescueNegativeTestJSON-717723449-project-member</nova:user>
Aug 17 18:37:25 user nova-compute[72874]:         <nova:project uuid="6287735c21fb4b43b3cbd9e0d742b0ec">tempest-ServerRescueNegativeTestJSON-717723449</nova:project>
Aug 17 18:37:25 user nova-compute[72874]:       </nova:owner>
Aug 17 18:37:25 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:37:25 user nova-compute[72874]:       <nova:ports>
Aug 17 18:37:25 user nova-compute[72874]:         <nova:port uuid="50497298-f834-4b53-ae7a-8fa2482fa36c">
Aug 17 18:37:25 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 18:37:25 user nova-compute[72874]:         </nova:port>
Aug 17 18:37:25 user nova-compute[72874]:       </nova:ports>
Aug 17 18:37:25 user nova-compute[72874]:     </nova:instance>
Aug 17 18:37:25 user nova-compute[72874]:   </metadata>
Aug 17 18:37:25 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:37:25 user nova-compute[72874]:     <system>
Aug 17 18:37:25 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:37:25 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:37:25 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:37:25 user nova-compute[72874]:       <entry name="serial">c4d2b606-6c62-4fad-91b6-a9e333c7cf30</entry>
Aug 17 18:37:25 user nova-compute[72874]:       <entry name="uuid">c4d2b606-6c62-4fad-91b6-a9e333c7cf30</entry>
Aug 17 18:37:25 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:37:25 user nova-compute[72874]:     </system>
Aug 17 18:37:25 user nova-compute[72874]:   </sysinfo>
Aug 17 18:37:25 user nova-compute[72874]:   <os>
Aug 17 18:37:25 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:37:25 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:37:25 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:37:25 user nova-compute[72874]:   </os>
Aug 17 18:37:25 user nova-compute[72874]:   <features>
Aug 17 18:37:25 user nova-compute[72874]:     <acpi/>
Aug 17 18:37:25 user nova-compute[72874]:     <apic/>
Aug 17 18:37:25 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:37:25 user nova-compute[72874]:   </features>
Aug 17 18:37:25 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:37:25 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:37:25 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:37:25 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:37:25 user nova-compute[72874]:   </clock>
Aug 17 18:37:25 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:37:25 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:37:25 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:37:25 user nova-compute[72874]:   </cpu>
Aug 17 18:37:25 user nova-compute[72874]:   <devices>
Aug 17 18:37:25 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:37:25 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:37:25 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk"/>
Aug 17 18:37:25 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:37:25 user nova-compute[72874]:     </disk>
Aug 17 18:37:25 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:37:25 user nova-compute[72874]:       <mac address="fa:16:3e:0f:a1:2c"/>
Aug 17 18:37:25 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:37:25 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:37:25 user nova-compute[72874]:       <target dev="tap50497298-f8"/>
Aug 17 18:37:25 user nova-compute[72874]:     </interface>
Aug 17 18:37:25 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:37:25 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/console.log" append="off"/>
Aug 17 18:37:25 user nova-compute[72874]:     </serial>
Aug 17 18:37:25 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:37:25 user nova-compute[72874]:     <video>
Aug 17 18:37:25 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:37:25 user nova-compute[72874]:     </video>
Aug 17 18:37:25 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:37:25 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:37:25 user nova-compute[72874]:     </rng>
Aug 17 18:37:25 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:37:25 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:37:25 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:37:25 user nova-compute[72874]:     </memballoon>
Aug 17 18:37:25 user nova-compute[72874]:   </devices>
Aug 17 18:37:25 user nova-compute[72874]: </domain>
Aug 17 18:37:25 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1055707657',display_name='tempest-ServerRescueNegativeTestJSON-server-1055707657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1055707657',id=38,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3iTq9nQBkw6d5pdNe1FZAZTAW88Yk72scauvf0O1vFLhQ6P6ltfdRJDSZUaOOg8xwo+pIfXWyM0kcGTBt1oOUXk+kw323QJuB4UFVz1ZjtHmd8vO+HqSgQ+qqe2Eub2w==',key_name='tempest-keypair-931894594',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6287735c21fb4b43b3cbd9e0d742b0ec',ramdisk_id='',reservation_id='r-sbi7tlp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-717723449',owner_user_name='tempest-ServerRescueNegativeTestJSON-717723449-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:37:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3143ae598e814e359466d90e74f9b00c',uuid=c4d2b606-6c62-4fad-91b6-a9e333c7cf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converting VIF {"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a1:2c,bridge_name='br-int',has_traffic_filtering=True,id=50497298-f834-4b53-ae7a-8fa2482fa36c,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50497298-f8') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG os_vif [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a1:2c,bridge_name='br-int',has_traffic_filtering=True,id=50497298-f834-4b53-ae7a-8fa2482fa36c,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50497298-f8') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50497298-f8, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50497298-f8, col_values=(('external_ids', {'iface-id': '50497298-f834-4b53-ae7a-8fa2482fa36c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:a1:2c', 'vm-uuid': 'c4d2b606-6c62-4fad-91b6-a9e333c7cf30'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:25 user nova-compute[72874]: INFO os_vif [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:a1:2c,bridge_name='br-int',has_traffic_filtering=True,id=50497298-f834-4b53-ae7a-8fa2482fa36c,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50497298-f8')
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No VIF found with MAC fa:16:3e:0f:a1:2c, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.network.neutron [req-09a5dd92-d354-4d99-8248-e26a9df76979 req-85304898-e588-4cb9-ba4d-2a10417fb556 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Updated VIF entry in instance network info cache for port 50497298-f834-4b53-ae7a-8fa2482fa36c. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG nova.network.neutron [req-09a5dd92-d354-4d99-8248-e26a9df76979 req-85304898-e588-4cb9-ba4d-2a10417fb556 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Updating instance_info_cache with network_info: [{"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-09a5dd92-d354-4d99-8248-e26a9df76979 req-85304898-e588-4cb9-ba4d-2a10417fb556 service nova] Releasing lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-6713322e-8d24-4238-b7a9-b8aa02d733d1 req-03bb2ea4-1878-4abe-af9d-378fa252f165 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6713322e-8d24-4238-b7a9-b8aa02d733d1 req-03bb2ea4-1878-4abe-af9d-378fa252f165 service nova] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6713322e-8d24-4238-b7a9-b8aa02d733d1 req-03bb2ea4-1878-4abe-af9d-378fa252f165 service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6713322e-8d24-4238-b7a9-b8aa02d733d1 req-03bb2ea4-1878-4abe-af9d-378fa252f165 service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-6713322e-8d24-4238-b7a9-b8aa02d733d1 req-03bb2ea4-1878-4abe-af9d-378fa252f165 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] No waiting events found dispatching network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:37:27 user nova-compute[72874]: WARNING nova.compute.manager [req-6713322e-8d24-4238-b7a9-b8aa02d733d1 req-03bb2ea4-1878-4abe-af9d-378fa252f165 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received unexpected event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c for instance with vm_state building and task_state spawning.
Aug 17 18:37:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297432.7779524, dd54e88a-91b7-439c-9d69-7812dacc3932 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:37:27 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] VM Stopped (Lifecycle Event)
Aug 17 18:37:27 user nova-compute[72874]: DEBUG nova.compute.manager [None req-97015ace-f414-454f-a3c1-624647ae033a None None] [instance: dd54e88a-91b7-439c-9d69-7812dacc3932] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297449.1879408, c4d2b606-6c62-4fad-91b6-a9e333c7cf30 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:37:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] VM Resumed (Lifecycle Event)
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-6edcb524-8b00-4f27-a1b3-62460773c314 req-1a706379-ec74-473e-90e8-2aaada892166 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6edcb524-8b00-4f27-a1b3-62460773c314 req-1a706379-ec74-473e-90e8-2aaada892166 service nova] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6edcb524-8b00-4f27-a1b3-62460773c314 req-1a706379-ec74-473e-90e8-2aaada892166 service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6edcb524-8b00-4f27-a1b3-62460773c314 req-1a706379-ec74-473e-90e8-2aaada892166 service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-6edcb524-8b00-4f27-a1b3-62460773c314 req-1a706379-ec74-473e-90e8-2aaada892166 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] No waiting events found dispatching network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:37:29 user nova-compute[72874]: WARNING nova.compute.manager [req-6edcb524-8b00-4f27-a1b3-62460773c314 req-1a706379-ec74-473e-90e8-2aaada892166 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received unexpected event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c for instance with vm_state building and task_state spawning.
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:37:29 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:37:29 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7862MB free_disk=24.998455047607422GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:29 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Instance spawned successfully.
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:37:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297449.1892338, c4d2b606-6c62-4fad-91b6-a9e333c7cf30 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:37:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] VM Started (Lifecycle Event)
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:37:29 user nova-compute[72874]: INFO nova.compute.manager [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Took 6.20 seconds to spawn the instance on the hypervisor.
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:37:29 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 38df8d14-531a-42f3-8a4e-c53c1a80185f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 1bf20bb4-44a7-463d-bf0d-3ba449399b2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 939268df-3817-4cdf-b7a3-4a936a6e8ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 1cbc48a0-476c-46bf-a30b-9875c08d818a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance c4d2b606-6c62-4fad-91b6-a9e333c7cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:37:29 user nova-compute[72874]: INFO nova.compute.manager [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Took 6.97 seconds to build instance.
Aug 17 18:37:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15498adc-2bfe-47d8-ae26-ba65eea8f1e5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.052s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:37:29 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 18:37:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:30 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:37:30 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:37:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:37:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:37:31 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:37:31 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Updating instance_info_cache with network_info: [{"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:37:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-2961b0b8-98d0-4ba5-a0fa-b719753589ea" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:37:31 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:37:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:37:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:37:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:37:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:37:32 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:37:33 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:37:33 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 18:37:33 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] There are 0 instances to clean {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 18:37:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:37 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:37:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:37:37 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:37:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:37:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-737f9276-057b-4a7b-aeb0-5921b5cf45b6 req-2b7351bf-f976-4ee0-9c71-f65b380dc0e5 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Received event network-changed-c16a8e4a-00bf-436f-a021-98297ac4e14a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:37:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-737f9276-057b-4a7b-aeb0-5921b5cf45b6 req-2b7351bf-f976-4ee0-9c71-f65b380dc0e5 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Refreshing instance network info cache due to event network-changed-c16a8e4a-00bf-436f-a021-98297ac4e14a. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:37:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-737f9276-057b-4a7b-aeb0-5921b5cf45b6 req-2b7351bf-f976-4ee0-9c71-f65b380dc0e5 service nova] Acquiring lock "refresh_cache-939268df-3817-4cdf-b7a3-4a936a6e8ec9" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:37:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-737f9276-057b-4a7b-aeb0-5921b5cf45b6 req-2b7351bf-f976-4ee0-9c71-f65b380dc0e5 service nova] Acquired lock "refresh_cache-939268df-3817-4cdf-b7a3-4a936a6e8ec9" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:37:55 user nova-compute[72874]: DEBUG nova.network.neutron [req-737f9276-057b-4a7b-aeb0-5921b5cf45b6 req-2b7351bf-f976-4ee0-9c71-f65b380dc0e5 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Refreshing network info cache for port c16a8e4a-00bf-436f-a021-98297ac4e14a {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lazy-loading 'flavor' on Instance uuid 939268df-3817-4cdf-b7a3-4a936a6e8ec9 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.108s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:37:56 user nova-compute[72874]: INFO nova.compute.manager [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Attaching volume 3da69a5c-15b9-4f32-a95c-60ea0b3a0162 to /dev/vdb
Aug 17 18:37:56 user nova-compute[72874]: DEBUG os_brick.utils [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[53725ac1-a6d2-4315-926d-989499f0058b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d49ab6-ade1-4994-b097-1e13b8d6b524]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.049s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7027dce7-b0b8-490d-b8d8-76743b2c81a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ecb112-2a78-4323-bcfd-0fb5e9f8af31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG nova.network.neutron [req-737f9276-057b-4a7b-aeb0-5921b5cf45b6 req-2b7351bf-f976-4ee0-9c71-f65b380dc0e5 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Updated VIF entry in instance network info cache for port c16a8e4a-00bf-436f-a021-98297ac4e14a. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG nova.network.neutron [req-737f9276-057b-4a7b-aeb0-5921b5cf45b6 req-2b7351bf-f976-4ee0-9c71-f65b380dc0e5 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Updating instance_info_cache with network_info: [{"id": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "address": "fa:16:3e:e5:42:31", "network": {"id": "6fe94371-138a-464d-89fd-9c9f9ebaaecd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-826475339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d802b863c04d0195c73e6ec1889c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16a8e4a-00", "ovs_interfaceid": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-737f9276-057b-4a7b-aeb0-5921b5cf45b6 req-2b7351bf-f976-4ee0-9c71-f65b380dc0e5 service nova] Releasing lock "refresh_cache-939268df-3817-4cdf-b7a3-4a936a6e8ec9" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:37:56 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:37:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36f247d-6409-4c49-a27d-6fe531564039]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG os_brick.utils [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:37:56 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Updating existing volume attachment record: 99ceebf8-431b-4fe9-ae93-59b2650d3bdd {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:38:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:38:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXcZrzbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:38:07 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:38:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:38:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:38:08 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:38:08 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dca5d57-82ca-48e7-8590-1e2dfb5acd32]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:38:08 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06d6e1a-ade4-4cfe-b64a-61142df71441]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162] added
Aug 17 18:38:08 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe1df63-4ef2-4e8f-8a7a-240a37ebbfb6]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[778b24a6-a1bc-4067-83f9-0ac4ce0db283]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BXcZrzbx {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BXcZrzbx" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f44d04-190c-4a86-bb39-58c93c68ad2d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BXcZrzbx'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5e057b-57f9-49a3-8cb3-22546fa3a41f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e53d840-60e4-4429-9472-282443ede7a2]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:38:08 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:38:08 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:38:08 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:38:08 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3395129-5a12-4625-b87a-c6d3554b6e94]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162, portal: 172.16.0.220,3260]
Aug 17 18:38:08 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162, portal: 172.16.0.220,3260] successful.
Aug 17 18:38:08 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b805faa9-e388-4c3c-ba00-f2d325d68fc2]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb510f0-81c1-4e9f-864f-3020ffcc749e]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:38:08 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:38:08 user nova-compute[72874]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)
Aug 17 18:38:08 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:38:08 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:38:08 user nova-compute[72874]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)
Aug 17 18:38:08 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[740cf813-af84-45e6-91dd-ca574bc189ca]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:08 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:38:09 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:38:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXcZrzbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:38:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:38:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23339366565386532', 'path': '/dev/sdc'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:38:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339366565386532', 'path': '/dev/sdc'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:38:09 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lazy-loading 'flavor' on Instance uuid 939268df-3817-4cdf-b7a3-4a936a6e8ec9 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:38:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:38:09 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:38:09 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:38:09 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:38:09 user nova-compute[72874]:   <serial>3da69a5c-15b9-4f32-a95c-60ea0b3a0162</serial>
Aug 17 18:38:09 user nova-compute[72874]: </disk>
Aug 17 18:38:09 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:38:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:38:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:38:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] No VIF found with MAC fa:16:3e:e5:42:31, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:38:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e42f70da-bb81-41f4-9378-863ee4f00a0b tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.260s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:38:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lazy-loading 'flavor' on Instance uuid 939268df-3817-4cdf-b7a3-4a936a6e8ec9 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:38:13 user nova-compute[72874]: INFO nova.compute.manager [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Attaching volume 570a2804-f2b3-4d54-803a-462ef637a1b2 to /dev/vdc
Aug 17 18:38:13 user nova-compute[72874]: DEBUG os_brick.utils [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb02adb-bd4d-45dc-ab60-55163f12ef03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2229e34e-242b-43a6-96c1-824fc3fec377]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[573d4c40-c2e2-4462-96e4-7ee89517a52f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e785d462-bc56-4c12-8003-1dc1533a11e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:38:13 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:38:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff5472f-1c66-40ac-a7cf-6857b27f2ec3]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG os_brick.utils [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:38:13 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Updating existing volume attachment record: e66c5a04-c347-4335-9118-eff1cba61743 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:38:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:38:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:38:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:38:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:38:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xywzWile', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:38:24 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:38:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:38:24 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:38:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:38:24 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd71ec5-5f79-4770-bb1a-a9be0b7b77a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:38:24 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b9dc90-5be2-4b6c-842b-3eb049d3d0df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2] added
Aug 17 18:38:24 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ec0cd0-5c2a-4a5b-bb53-c7c4e9f62118]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5b68fa-a7e0-41db-b325-3157820b29e5]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xywzWile {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xywzWile" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[73525066-9b0f-4776-85bf-60803b07c6ba]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xywzWile'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d021201a-2c38-48b2-9458-191b3e248c6f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d85ba14-6660-4af8-b2a3-22e5c32285d9]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:38:24 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:38:24 user nova-compute[72874]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)
Aug 17 18:38:24 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:38:24 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:38:24 user nova-compute[72874]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)
Aug 17 18:38:24 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7b5593-f941-47fb-9644-43c1a5c4c350]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2, portal: 172.16.0.220,3260]
Aug 17 18:38:24 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2, portal: 172.16.0.220,3260] successful.
Aug 17 18:38:24 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:24 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd16456d-6182-4fc1-b6cc-41212f8340da]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5830eeb2-9e54-45b9-b590-e5f6567314c8]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:38:25 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:38:25 user nova-compute[72874]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)
Aug 17 18:38:25 user nova-compute[72874]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 (non-flash)
Aug 17 18:38:25 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:38:25 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:38:25 user nova-compute[72874]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)
Aug 17 18:38:25 user nova-compute[72874]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 (non-flash)
Aug 17 18:38:25 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2902802-cb60-4ba6-94f4-f856054853ef]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:38:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xywzWile', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23734393863386361', 'path': '/dev/sde'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734393863386361', 'path': '/dev/sde'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lazy-loading 'flavor' on Instance uuid 939268df-3817-4cdf-b7a3-4a936a6e8ec9 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:38:26 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:38:26 user nova-compute[72874]:   <source dev="/dev/sde"/>
Aug 17 18:38:26 user nova-compute[72874]:   <target dev="vdc" bus="virtio"/>
Aug 17 18:38:26 user nova-compute[72874]:   <serial>570a2804-f2b3-4d54-803a-462ef637a1b2</serial>
Aug 17 18:38:26 user nova-compute[72874]: </disk>
Aug 17 18:38:26 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] No VIF found with MAC fa:16:3e:e5:42:31, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b4dd9beb-e26e-498e-bd44-4bc4c62f7ab2 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.193s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:27 user nova-compute[72874]: INFO nova.compute.manager [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Detaching volume 570a2804-f2b3-4d54-803a-462ef637a1b2
Aug 17 18:38:27 user nova-compute[72874]: INFO nova.virt.block_device [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Attempting to driver detach volume 570a2804-f2b3-4d54-803a-462ef637a1b2 from mountpoint /dev/vdc
Aug 17 18:38:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Attempting to detach device vdc from instance 939268df-3817-4cdf-b7a3-4a936a6e8ec9 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:38:27 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:38:27 user nova-compute[72874]:   <source dev="/dev/sde"/>
Aug 17 18:38:27 user nova-compute[72874]:   <target dev="vdc" bus="virtio"/>
Aug 17 18:38:27 user nova-compute[72874]:   <serial>570a2804-f2b3-4d54-803a-462ef637a1b2</serial>
Aug 17 18:38:27 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 18:38:27 user nova-compute[72874]: </disk>
Aug 17 18:38:27 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:38:27 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Successfully detached device vdc from instance 939268df-3817-4cdf-b7a3-4a936a6e8ec9 from the persistent domain config.
Aug 17 18:38:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 939268df-3817-4cdf-b7a3-4a936a6e8ec9 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:38:27 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:38:27 user nova-compute[72874]:   <source dev="/dev/sde"/>
Aug 17 18:38:27 user nova-compute[72874]:   <target dev="vdc" bus="virtio"/>
Aug 17 18:38:27 user nova-compute[72874]:   <serial>570a2804-f2b3-4d54-803a-462ef637a1b2</serial>
Aug 17 18:38:27 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 18:38:27 user nova-compute[72874]: </disk>
Aug 17 18:38:27 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692297508.4541733, 939268df-3817-4cdf-b7a3-4a936a6e8ec9 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 939268df-3817-4cdf-b7a3-4a936a6e8ec9 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:38:28 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Successfully detached device vdc from instance 939268df-3817-4cdf-b7a3-4a936a6e8ec9 from the live domain config.
Aug 17 18:38:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xywzWile', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:38:28 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[65924804-acfa-4b78-a91f-8d23ac3f1d4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cdadc79-9e6a-44b7-b02d-9cd3842b9334]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:38:28 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:38:28 user nova-compute[72874]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)
Aug 17 18:38:28 user nova-compute[72874]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 (non-flash)
Aug 17 18:38:28 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:38:28 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:38:28 user nova-compute[72874]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)
Aug 17 18:38:28 user nova-compute[72874]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 (non-flash)
Aug 17 18:38:28 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6f3bb7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2'): ({'sde'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Removing single pathed devices sde {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c3fa4e-64da-4c15-ade1-69de19895388]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7649f0ad-9fc2-47e6-bd87-7fcb4facf671]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Flushing IO for device /dev/sde {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a18b4b3-d60a-4ae9-851b-bae0b0315cf7]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed938f7c-b392-4049-a138-3c505a44c4f6]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] SCSI volumes sde have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[77efb3ea-a48d-4261-9e29-a4d909ab9254]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d3fe0b-a6fe-4d4f-ac59-5c38bd65c8ce]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2, portal: 172.16.0.220,3260]
Aug 17 18:38:28 user nova-compute[72874]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2, portal: 172.16.0.220,3260] successful.
Aug 17 18:38:28 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:570a2804-f2b3-4d54-803a-462ef637a1b2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7ab8aa-ec29-4e5f-94be-ddb464139a8b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] <== disconnect_volume: return (355ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:38:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:29 user nova-compute[72874]: DEBUG nova.objects.instance [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lazy-loading 'flavor' on Instance uuid 939268df-3817-4cdf-b7a3-4a936a6e8ec9 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:38:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:38:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-09bddfb9-c5a8-4359-aab6-2897ab6e21af tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.023s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:38:30 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:38:30 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7776MB free_disk=24.95937728881836GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 38df8d14-531a-42f3-8a4e-c53c1a80185f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 1bf20bb4-44a7-463d-bf0d-3ba449399b2c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 939268df-3817-4cdf-b7a3-4a936a6e8ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 1cbc48a0-476c-46bf-a30b-9875c08d818a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance c4d2b606-6c62-4fad-91b6-a9e333c7cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing inventories for resource provider b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Updating ProviderTree inventory for provider b677d836-b01b-4674-8972-53d526f1b5f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Updating inventory in ProviderTree for provider b677d836-b01b-4674-8972-53d526f1b5f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing aggregate associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, aggregates: None {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing trait associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, traits: HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:38:30 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:38:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:38:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.927s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:38:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:36 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:38:36 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:38:36 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:38:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:38:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:38:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:38:36 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:38:36 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Updating instance_info_cache with network_info: [{"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:38:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:38:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:38:36 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:38:36 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:38:36 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:38:39 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:38:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:38:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "a1d61632-3c45-4141-917f-7848fb036f6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:38:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "a1d61632-3c45-4141-917f-7848fb036f6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:38:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:38:42 user nova-compute[72874]: INFO nova.compute.claims [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Claim successful on node user
Aug 17 18:38:42 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:38:42 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:38:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG nova.policy [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '500d14cc838b4812bd7a5d36336ae6ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1eab2a4b0d14b11b488bcc6a8638134', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:38:42 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Creating image(s)
Aug 17 18:38:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "/opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "/opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:38:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.191s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk 1073741824" returned: 0 in 0.058s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Successfully created port: 5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Cannot resize image /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG nova.objects.instance [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lazy-loading 'migration_context' on Instance uuid a1d61632-3c45-4141-917f-7848fb036f6d {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Ensure instance console log exists: /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:38:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Successfully updated port: 5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "refresh_cache-a1d61632-3c45-4141-917f-7848fb036f6d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquired lock "refresh_cache-a1d61632-3c45-4141-917f-7848fb036f6d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-d5a2e41a-dbac-4207-b8f9-92a39073ffda req-0f63de2b-bb32-47ec-8ae7-bb45372c78e3 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received event network-changed-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-d5a2e41a-dbac-4207-b8f9-92a39073ffda req-0f63de2b-bb32-47ec-8ae7-bb45372c78e3 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Refreshing instance network info cache due to event network-changed-5fa239d2-4325-4554-a90b-116902f818ae. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d5a2e41a-dbac-4207-b8f9-92a39073ffda req-0f63de2b-bb32-47ec-8ae7-bb45372c78e3 service nova] Acquiring lock "refresh_cache-a1d61632-3c45-4141-917f-7848fb036f6d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.network.neutron [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Updating instance_info_cache with network_info: [{"id": "5fa239d2-4325-4554-a90b-116902f818ae", "address": "fa:16:3e:67:18:19", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa239d2-43", "ovs_interfaceid": "5fa239d2-4325-4554-a90b-116902f818ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Releasing lock "refresh_cache-a1d61632-3c45-4141-917f-7848fb036f6d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Instance network_info: |[{"id": "5fa239d2-4325-4554-a90b-116902f818ae", "address": "fa:16:3e:67:18:19", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa239d2-43", "ovs_interfaceid": "5fa239d2-4325-4554-a90b-116902f818ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d5a2e41a-dbac-4207-b8f9-92a39073ffda req-0f63de2b-bb32-47ec-8ae7-bb45372c78e3 service nova] Acquired lock "refresh_cache-a1d61632-3c45-4141-917f-7848fb036f6d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.network.neutron [req-d5a2e41a-dbac-4207-b8f9-92a39073ffda req-0f63de2b-bb32-47ec-8ae7-bb45372c78e3 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Refreshing network info cache for port 5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Start _get_guest_xml network_info=[{"id": "5fa239d2-4325-4554-a90b-116902f818ae", "address": "fa:16:3e:67:18:19", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa239d2-43", "ovs_interfaceid": "5fa239d2-4325-4554-a90b-116902f818ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:38:44 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:38:44 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-530975050',display_name='tempest-ServersNegativeTestJSON-server-530975050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-530975050',id=39,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1eab2a4b0d14b11b488bcc6a8638134',ramdisk_id='',reservation_id='r-zplor80n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-754663374',owner_user_name='tempest-ServersNegativeTestJSON-754663374-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:38:43Z,user_data=None,user_id='500d14cc838b4812bd7a5d36336ae6ae',uuid=a1d61632-3c45-4141-917f-7848fb036f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fa239d2-4325-4554-a90b-116902f818ae", "address": "fa:16:3e:67:18:19", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa239d2-43", "ovs_interfaceid": "5fa239d2-4325-4554-a90b-116902f818ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Converting VIF {"id": "5fa239d2-4325-4554-a90b-116902f818ae", "address": "fa:16:3e:67:18:19", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa239d2-43", "ovs_interfaceid": "5fa239d2-4325-4554-a90b-116902f818ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:19,bridge_name='br-int',has_traffic_filtering=True,id=5fa239d2-4325-4554-a90b-116902f818ae,network=Network(518607ac-ae8a-4a0e-823a-0b65d7de624b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa239d2-43') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.objects.instance [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lazy-loading 'pci_devices' on Instance uuid a1d61632-3c45-4141-917f-7848fb036f6d {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:38:44 user nova-compute[72874]:   <uuid>a1d61632-3c45-4141-917f-7848fb036f6d</uuid>
Aug 17 18:38:44 user nova-compute[72874]:   <name>instance-00000027</name>
Aug 17 18:38:44 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:38:44 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:38:44 user nova-compute[72874]:   <metadata>
Aug 17 18:38:44 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:38:44 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:38:44 user nova-compute[72874]:       <nova:name>tempest-ServersNegativeTestJSON-server-530975050</nova:name>
Aug 17 18:38:44 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:38:44</nova:creationTime>
Aug 17 18:38:44 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:38:44 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:38:44 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:38:44 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:38:44 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:38:44 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:38:44 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:38:44 user nova-compute[72874]:       <nova:owner>
Aug 17 18:38:44 user nova-compute[72874]:         <nova:user uuid="500d14cc838b4812bd7a5d36336ae6ae">tempest-ServersNegativeTestJSON-754663374-project-member</nova:user>
Aug 17 18:38:44 user nova-compute[72874]:         <nova:project uuid="a1eab2a4b0d14b11b488bcc6a8638134">tempest-ServersNegativeTestJSON-754663374</nova:project>
Aug 17 18:38:44 user nova-compute[72874]:       </nova:owner>
Aug 17 18:38:44 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:38:44 user nova-compute[72874]:       <nova:ports>
Aug 17 18:38:44 user nova-compute[72874]:         <nova:port uuid="5fa239d2-4325-4554-a90b-116902f818ae">
Aug 17 18:38:44 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 18:38:44 user nova-compute[72874]:         </nova:port>
Aug 17 18:38:44 user nova-compute[72874]:       </nova:ports>
Aug 17 18:38:44 user nova-compute[72874]:     </nova:instance>
Aug 17 18:38:44 user nova-compute[72874]:   </metadata>
Aug 17 18:38:44 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:38:44 user nova-compute[72874]:     <system>
Aug 17 18:38:44 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:38:44 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:38:44 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:38:44 user nova-compute[72874]:       <entry name="serial">a1d61632-3c45-4141-917f-7848fb036f6d</entry>
Aug 17 18:38:44 user nova-compute[72874]:       <entry name="uuid">a1d61632-3c45-4141-917f-7848fb036f6d</entry>
Aug 17 18:38:44 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:38:44 user nova-compute[72874]:     </system>
Aug 17 18:38:44 user nova-compute[72874]:   </sysinfo>
Aug 17 18:38:44 user nova-compute[72874]:   <os>
Aug 17 18:38:44 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:38:44 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:38:44 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:38:44 user nova-compute[72874]:   </os>
Aug 17 18:38:44 user nova-compute[72874]:   <features>
Aug 17 18:38:44 user nova-compute[72874]:     <acpi/>
Aug 17 18:38:44 user nova-compute[72874]:     <apic/>
Aug 17 18:38:44 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:38:44 user nova-compute[72874]:   </features>
Aug 17 18:38:44 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:38:44 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:38:44 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:38:44 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:38:44 user nova-compute[72874]:   </clock>
Aug 17 18:38:44 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:38:44 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:38:44 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:38:44 user nova-compute[72874]:   </cpu>
Aug 17 18:38:44 user nova-compute[72874]:   <devices>
Aug 17 18:38:44 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:38:44 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:38:44 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk"/>
Aug 17 18:38:44 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:38:44 user nova-compute[72874]:     </disk>
Aug 17 18:38:44 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:38:44 user nova-compute[72874]:       <mac address="fa:16:3e:67:18:19"/>
Aug 17 18:38:44 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:38:44 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:38:44 user nova-compute[72874]:       <target dev="tap5fa239d2-43"/>
Aug 17 18:38:44 user nova-compute[72874]:     </interface>
Aug 17 18:38:44 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:38:44 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/console.log" append="off"/>
Aug 17 18:38:44 user nova-compute[72874]:     </serial>
Aug 17 18:38:44 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:38:44 user nova-compute[72874]:     <video>
Aug 17 18:38:44 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:38:44 user nova-compute[72874]:     </video>
Aug 17 18:38:44 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:38:44 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:38:44 user nova-compute[72874]:     </rng>
Aug 17 18:38:44 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:38:44 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:38:44 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:38:44 user nova-compute[72874]:     </memballoon>
Aug 17 18:38:44 user nova-compute[72874]:   </devices>
Aug 17 18:38:44 user nova-compute[72874]: </domain>
Aug 17 18:38:44 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-530975050',display_name='tempest-ServersNegativeTestJSON-server-530975050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-530975050',id=39,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a1eab2a4b0d14b11b488bcc6a8638134',ramdisk_id='',reservation_id='r-zplor80n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-754663374',owner_user_name='tempest-ServersNegativeTestJSON-754663374-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:38:43Z,user_data=None,user_id='500d14cc838b4812bd7a5d36336ae6ae',uuid=a1d61632-3c45-4141-917f-7848fb036f6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fa239d2-4325-4554-a90b-116902f818ae", "address": "fa:16:3e:67:18:19", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa239d2-43", "ovs_interfaceid": "5fa239d2-4325-4554-a90b-116902f818ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Converting VIF {"id": "5fa239d2-4325-4554-a90b-116902f818ae", "address": "fa:16:3e:67:18:19", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa239d2-43", "ovs_interfaceid": "5fa239d2-4325-4554-a90b-116902f818ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:19,bridge_name='br-int',has_traffic_filtering=True,id=5fa239d2-4325-4554-a90b-116902f818ae,network=Network(518607ac-ae8a-4a0e-823a-0b65d7de624b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa239d2-43') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG os_vif [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:19,bridge_name='br-int',has_traffic_filtering=True,id=5fa239d2-4325-4554-a90b-116902f818ae,network=Network(518607ac-ae8a-4a0e-823a-0b65d7de624b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa239d2-43') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fa239d2-43, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5fa239d2-43, col_values=(('external_ids', {'iface-id': '5fa239d2-4325-4554-a90b-116902f818ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:18:19', 'vm-uuid': 'a1d61632-3c45-4141-917f-7848fb036f6d'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:44 user nova-compute[72874]: INFO os_vif [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:19,bridge_name='br-int',has_traffic_filtering=True,id=5fa239d2-4325-4554-a90b-116902f818ae,network=Network(518607ac-ae8a-4a0e-823a-0b65d7de624b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa239d2-43')
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] No VIF found with MAC fa:16:3e:67:18:19, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.network.neutron [req-d5a2e41a-dbac-4207-b8f9-92a39073ffda req-0f63de2b-bb32-47ec-8ae7-bb45372c78e3 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Updated VIF entry in instance network info cache for port 5fa239d2-4325-4554-a90b-116902f818ae. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG nova.network.neutron [req-d5a2e41a-dbac-4207-b8f9-92a39073ffda req-0f63de2b-bb32-47ec-8ae7-bb45372c78e3 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Updating instance_info_cache with network_info: [{"id": "5fa239d2-4325-4554-a90b-116902f818ae", "address": "fa:16:3e:67:18:19", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa239d2-43", "ovs_interfaceid": "5fa239d2-4325-4554-a90b-116902f818ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:38:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d5a2e41a-dbac-4207-b8f9-92a39073ffda req-0f63de2b-bb32-47ec-8ae7-bb45372c78e3 service nova] Releasing lock "refresh_cache-a1d61632-3c45-4141-917f-7848fb036f6d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:38:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:46 user nova-compute[72874]: DEBUG nova.compute.manager [req-4cd5a58e-dbc0-45e8-b70b-c9eb7dde9cf0 req-688038ef-8363-48bd-bdd0-d9f43e2f4a06 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received event network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:38:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4cd5a58e-dbc0-45e8-b70b-c9eb7dde9cf0 req-688038ef-8363-48bd-bdd0-d9f43e2f4a06 service nova] Acquiring lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:38:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4cd5a58e-dbc0-45e8-b70b-c9eb7dde9cf0 req-688038ef-8363-48bd-bdd0-d9f43e2f4a06 service nova] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:38:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4cd5a58e-dbc0-45e8-b70b-c9eb7dde9cf0 req-688038ef-8363-48bd-bdd0-d9f43e2f4a06 service nova] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:38:46 user nova-compute[72874]: DEBUG nova.compute.manager [req-4cd5a58e-dbc0-45e8-b70b-c9eb7dde9cf0 req-688038ef-8363-48bd-bdd0-d9f43e2f4a06 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] No waiting events found dispatching network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:38:46 user nova-compute[72874]: WARNING nova.compute.manager [req-4cd5a58e-dbc0-45e8-b70b-c9eb7dde9cf0 req-688038ef-8363-48bd-bdd0-d9f43e2f4a06 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received unexpected event network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae for instance with vm_state building and task_state spawning.
Aug 17 18:38:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297528.1276076, a1d61632-3c45-4141-917f-7848fb036f6d => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:38:48 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] VM Resumed (Lifecycle Event)
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:38:48 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Instance spawned successfully.
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:38:48 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297528.1293755, a1d61632-3c45-4141-917f-7848fb036f6d => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:38:48 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] VM Started (Lifecycle Event)
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:38:48 user nova-compute[72874]: INFO nova.compute.manager [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Took 5.48 seconds to spawn the instance on the hypervisor.
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:38:48 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:38:48 user nova-compute[72874]: INFO nova.compute.manager [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Took 6.27 seconds to build instance.
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-645105a4-783a-4769-85e3-a4188f0fd337 req-53baa073-bf9c-41f2-9ec7-3deafab43de9 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received event network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:38:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-645105a4-783a-4769-85e3-a4188f0fd337 req-53baa073-bf9c-41f2-9ec7-3deafab43de9 service nova] Acquiring lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:38:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-645105a4-783a-4769-85e3-a4188f0fd337 req-53baa073-bf9c-41f2-9ec7-3deafab43de9 service nova] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:38:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-645105a4-783a-4769-85e3-a4188f0fd337 req-53baa073-bf9c-41f2-9ec7-3deafab43de9 service nova] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:38:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-645105a4-783a-4769-85e3-a4188f0fd337 req-53baa073-bf9c-41f2-9ec7-3deafab43de9 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] No waiting events found dispatching network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:38:48 user nova-compute[72874]: WARNING nova.compute.manager [req-645105a4-783a-4769-85e3-a4188f0fd337 req-53baa073-bf9c-41f2-9ec7-3deafab43de9 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received unexpected event network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae for instance with vm_state active and task_state None.
Aug 17 18:38:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc6feea2-0a51-4f3e-8f0f-05c277e0cbef tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "a1d61632-3c45-4141-917f-7848fb036f6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.370s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:38:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:38:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:09 user nova-compute[72874]: INFO nova.compute.manager [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Terminating instance
Aug 17 18:39:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG nova.compute.manager [req-a3a71376-8887-4d25-8c52-1496c203ba1c req-9d50c74f-9225-42c6-bebb-30efcbb5069d service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received event network-vif-unplugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a3a71376-8887-4d25-8c52-1496c203ba1c req-9d50c74f-9225-42c6-bebb-30efcbb5069d service nova] Acquiring lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a3a71376-8887-4d25-8c52-1496c203ba1c req-9d50c74f-9225-42c6-bebb-30efcbb5069d service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a3a71376-8887-4d25-8c52-1496c203ba1c req-9d50c74f-9225-42c6-bebb-30efcbb5069d service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG nova.compute.manager [req-a3a71376-8887-4d25-8c52-1496c203ba1c req-9d50c74f-9225-42c6-bebb-30efcbb5069d service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] No waiting events found dispatching network-vif-unplugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG nova.compute.manager [req-a3a71376-8887-4d25-8c52-1496c203ba1c req-9d50c74f-9225-42c6-bebb-30efcbb5069d service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received event network-vif-unplugged-d701e5dd-9a42-44c9-8ca1-c645f382220a for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:09 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Instance destroyed successfully.
Aug 17 18:39:09 user nova-compute[72874]: DEBUG nova.objects.instance [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'resources' on Instance uuid 1bf20bb4-44a7-463d-bf0d-3ba449399b2c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:33:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1074554763',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1074554763',id=33,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:35:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a550f3591d1347bf8b9fb4d3e90b8aad',ramdisk_id='',reservation_id='r-wa0950yp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-68498997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:37:23Z,user_data=None,user_id='d13289795c8b4991a9cf6bb2880ad6ef',uuid=1bf20bb4-44a7-463d-bf0d-3ba449399b2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "address": "fa:16:3e:f3:05:5e", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd701e5dd-9a", "ovs_interfaceid": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converting VIF {"id": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "address": "fa:16:3e:f3:05:5e", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd701e5dd-9a", "ovs_interfaceid": "d701e5dd-9a42-44c9-8ca1-c645f382220a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:05:5e,bridge_name='br-int',has_traffic_filtering=True,id=d701e5dd-9a42-44c9-8ca1-c645f382220a,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd701e5dd-9a') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG os_vif [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:05:5e,bridge_name='br-int',has_traffic_filtering=True,id=d701e5dd-9a42-44c9-8ca1-c645f382220a,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd701e5dd-9a') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd701e5dd-9a, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:39:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:39:09 user nova-compute[72874]: INFO os_vif [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:05:5e,bridge_name='br-int',has_traffic_filtering=True,id=d701e5dd-9a42-44c9-8ca1-c645f382220a,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd701e5dd-9a')
Aug 17 18:39:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BSgCdeQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:39:10 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf9bc18-831c-4925-91a3-a6b51ae7ca30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf5feec-ba64-44f2-a25b-c66caa9ae3a6]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:39:10 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:39:10 user nova-compute[72874]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)
Aug 17 18:39:10 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:39:10 user nova-compute[72874]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 (non-flash)
Aug 17 18:39:10 user nova-compute[72874]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)
Aug 17 18:39:10 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c079b370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920'): ({'sdd'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Removing single pathed devices sdd {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[30fcea22-0c16-4531-a934-5772581129fd]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[044ee713-606f-4a8c-9fbb-fe5fc09fd109]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Flushing IO for device /dev/sdd {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[412b7089-87e4-4bce-b890-a4637de0bc42]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae7e302-81e5-45c2-829b-00be3a3dce6e]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO28aa75da-a5a132a9b70974af', '/dev/disk/by-id/scsi-26135613133326139', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_28aa75da') {{(pid=83588) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad791920-96e5-4ac0-97f3-1a491d3ad2ba]: (4, None) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[90497fb5-7995-4aa6-8fe5-9949506ac17a]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[55faf34c-ef6f-443c-9536-2d3369a91761]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920, portal: 172.16.0.220,3260]
Aug 17 18:39:10 user nova-compute[72874]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920, portal: 172.16.0.220,3260] successful.
Aug 17 18:39:10 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef557e2d-85da-403e-ae95-b86bead13920 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd35b1e-321b-4213-b599-5b4398cd0f31]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] <== disconnect_volume: return (326ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:39:10 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Deleting instance files /opt/stack/data/nova/instances/1bf20bb4-44a7-463d-bf0d-3ba449399b2c_del
Aug 17 18:39:10 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Deletion of /opt/stack/data/nova/instances/1bf20bb4-44a7-463d-bf0d-3ba449399b2c_del complete
Aug 17 18:39:10 user nova-compute[72874]: INFO nova.compute.manager [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Took 1.22 seconds to destroy the instance on the hypervisor.
Aug 17 18:39:10 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:10 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:39:11 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Took 0.60 seconds to deallocate network for instance.
Aug 17 18:39:11 user nova-compute[72874]: DEBUG nova.compute.manager [req-c3cfd2d4-4681-4ba7-9438-0f9488fbfd88 req-7082a7e4-2c59-4a2f-8df4-6a44850d59d8 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received event network-vif-deleted-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:39:11 user nova-compute[72874]: INFO nova.compute.manager [req-c3cfd2d4-4681-4ba7-9438-0f9488fbfd88 req-7082a7e4-2c59-4a2f-8df4-6a44850d59d8 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Neutron deleted interface d701e5dd-9a42-44c9-8ca1-c645f382220a; detaching it from the instance and deleting it from the info cache
Aug 17 18:39:11 user nova-compute[72874]: DEBUG nova.network.neutron [req-c3cfd2d4-4681-4ba7-9438-0f9488fbfd88 req-7082a7e4-2c59-4a2f-8df4-6a44850d59d8 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:39:11 user nova-compute[72874]: DEBUG nova.compute.manager [req-c3cfd2d4-4681-4ba7-9438-0f9488fbfd88 req-7082a7e4-2c59-4a2f-8df4-6a44850d59d8 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Detach interface failed, port_id=d701e5dd-9a42-44c9-8ca1-c645f382220a, reason: Instance 1bf20bb4-44a7-463d-bf0d-3ba449399b2c could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:39:11 user nova-compute[72874]: DEBUG nova.compute.manager [req-32c28718-9e7f-4fee-aa4a-519cb7828ab4 req-996f7e05-a852-43fe-a8b9-84a26f828616 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:39:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-32c28718-9e7f-4fee-aa4a-519cb7828ab4 req-996f7e05-a852-43fe-a8b9-84a26f828616 service nova] Acquiring lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-32c28718-9e7f-4fee-aa4a-519cb7828ab4 req-996f7e05-a852-43fe-a8b9-84a26f828616 service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-32c28718-9e7f-4fee-aa4a-519cb7828ab4 req-996f7e05-a852-43fe-a8b9-84a26f828616 service nova] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:11 user nova-compute[72874]: DEBUG nova.compute.manager [req-32c28718-9e7f-4fee-aa4a-519cb7828ab4 req-996f7e05-a852-43fe-a8b9-84a26f828616 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] No waiting events found dispatching network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:39:11 user nova-compute[72874]: WARNING nova.compute.manager [req-32c28718-9e7f-4fee-aa4a-519cb7828ab4 req-996f7e05-a852-43fe-a8b9-84a26f828616 service nova] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Received unexpected event network-vif-plugged-d701e5dd-9a42-44c9-8ca1-c645f382220a for instance with vm_state active and task_state deleting.
Aug 17 18:39:11 user nova-compute[72874]: INFO nova.compute.manager [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Took 0.82 seconds to detach 1 volumes for instance.
Aug 17 18:39:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:12 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:39:12 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:39:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:12 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Deleted allocations for instance 1bf20bb4-44a7-463d-bf0d-3ba449399b2c
Aug 17 18:39:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bc9a6f3d-fc2d-4735-88ea-3fb8c8acf6c6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "1bf20bb4-44a7-463d-bf0d-3ba449399b2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.148s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG nova.compute.manager [req-43386927-ab87-4952-8a1e-933c9cc2d295 req-a6dfd915-9ac2-4ba3-bb73-0a0dd0013236 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-changed-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG nova.compute.manager [req-43386927-ab87-4952-8a1e-933c9cc2d295 req-a6dfd915-9ac2-4ba3-bb73-0a0dd0013236 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Refreshing instance network info cache due to event network-changed-50497298-f834-4b53-ae7a-8fa2482fa36c. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-43386927-ab87-4952-8a1e-933c9cc2d295 req-a6dfd915-9ac2-4ba3-bb73-0a0dd0013236 service nova] Acquiring lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-43386927-ab87-4952-8a1e-933c9cc2d295 req-a6dfd915-9ac2-4ba3-bb73-0a0dd0013236 service nova] Acquired lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG nova.network.neutron [req-43386927-ab87-4952-8a1e-933c9cc2d295 req-a6dfd915-9ac2-4ba3-bb73-0a0dd0013236 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Refreshing network info cache for port 50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG nova.objects.instance [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'flavor' on Instance uuid c4d2b606-6c62-4fad-91b6-a9e333c7cf30 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG nova.network.neutron [req-43386927-ab87-4952-8a1e-933c9cc2d295 req-a6dfd915-9ac2-4ba3-bb73-0a0dd0013236 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Updated VIF entry in instance network info cache for port 50497298-f834-4b53-ae7a-8fa2482fa36c. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG nova.network.neutron [req-43386927-ab87-4952-8a1e-933c9cc2d295 req-a6dfd915-9ac2-4ba3-bb73-0a0dd0013236 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Updating instance_info_cache with network_info: [{"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:14 user nova-compute[72874]: INFO nova.compute.manager [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Attaching volume f4400196-5cf0-448c-ae0e-ff9c27bd116a to /dev/vdb
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-43386927-ab87-4952-8a1e-933c9cc2d295 req-a6dfd915-9ac2-4ba3-bb73-0a0dd0013236 service nova] Releasing lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG os_brick.utils [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c112e8-0062-471d-b2e7-ece23a54a844]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[10370b46-9b7d-4c4c-b220-65c4c3d6b474]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32d4f37-6279-4655-8dcf-de39011d3710]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce1b7a5-89bf-4688-860c-62634fc5b6a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:39:14 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:39:14 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e36211a-5b23-4171-ab86-d8f1b10c1d4c]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG os_brick.utils [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Updating existing volume attachment record: dd507653-bd12-4676-a835-74ce25240843 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:39:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:18 user nova-compute[72874]: INFO nova.compute.manager [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Detaching volume 3da69a5c-15b9-4f32-a95c-60ea0b3a0162
Aug 17 18:39:18 user nova-compute[72874]: INFO nova.virt.block_device [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Attempting to driver detach volume 3da69a5c-15b9-4f32-a95c-60ea0b3a0162 from mountpoint /dev/vdb
Aug 17 18:39:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Attempting to detach device vdb from instance 939268df-3817-4cdf-b7a3-4a936a6e8ec9 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:39:18 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:39:18 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:39:18 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:39:18 user nova-compute[72874]:   <serial>3da69a5c-15b9-4f32-a95c-60ea0b3a0162</serial>
Aug 17 18:39:18 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:39:18 user nova-compute[72874]: </disk>
Aug 17 18:39:18 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:39:18 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Successfully detached device vdb from instance 939268df-3817-4cdf-b7a3-4a936a6e8ec9 from the persistent domain config.
Aug 17 18:39:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 939268df-3817-4cdf-b7a3-4a936a6e8ec9 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:39:18 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:39:18 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:39:18 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:39:18 user nova-compute[72874]:   <serial>3da69a5c-15b9-4f32-a95c-60ea0b3a0162</serial>
Aug 17 18:39:18 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:39:18 user nova-compute[72874]: </disk>
Aug 17 18:39:18 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692297558.7740939, 939268df-3817-4cdf-b7a3-4a936a6e8ec9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 939268df-3817-4cdf-b7a3-4a936a6e8ec9 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:39:18 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Successfully detached device vdb from instance 939268df-3817-4cdf-b7a3-4a936a6e8ec9 from the live domain config.
Aug 17 18:39:18 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BXcZrzbx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:39:18 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:39:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[20175b9b-1beb-4a70-92d1-4eede11ca70e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[532e2cce-99b9-4a4b-87e4-18c7830e8236]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:39:18 user nova-compute[72874]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)
Aug 17 18:39:18 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:39:18 user nova-compute[72874]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 (non-flash)
Aug 17 18:39:18 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a0432710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162'): ({'sdc'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Removing single pathed devices sdc {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91eada8-eeb4-43f2-a222-2597377bad3d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[265df7e9-5f04-4221-b8d6-10beb08d0eef]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Flushing IO for device /dev/sdc {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[12aacb5a-c773-4661-a537-651477a07b7a]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b23d29-1658-4ec2-8809-60835079a1d4]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdc8ab6-8294-48e7-8d37-94bb3c64a108]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:18 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:39:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62c686d-44b4-4aa1-a823-54c0ce66f97b]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162, portal: 172.16.0.220,3260]
Aug 17 18:39:19 user nova-compute[72874]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162, portal: 172.16.0.220,3260] successful.
Aug 17 18:39:19 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:39:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:19 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3da69a5c-15b9-4f32-a95c-60ea0b3a0162 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:19 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f07e71c-ce50-48e8-a66f-040cc731340f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:39:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:39:19 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] <== disconnect_volume: return (293ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:39:19 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:39:19 user nova-compute[72874]: DEBUG nova.objects.instance [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lazy-loading 'flavor' on Instance uuid 939268df-3817-4cdf-b7a3-4a936a6e8ec9 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:39:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-78e7fbd6-3efd-49dc-ad02-bb0b8730aaa3 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.725s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:24 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297549.953604, 1bf20bb4-44a7-463d-bf0d-3ba449399b2c => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:39:24 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] VM Stopped (Lifecycle Event)
Aug 17 18:39:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-960d55d8-a159-44de-91e9-1a3982c30543 None None] [instance: 1bf20bb4-44a7-463d-bf0d-3ba449399b2c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:39:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'caTBGsXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:39:25 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:39:25 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:39:25 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae53ba4-c521-4bfe-85d1-58925fb69692]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:39:25 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f105c17b-ae49-492c-8827-8a28c402b013]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a] added
Aug 17 18:39:25 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[269f0452-5a4c-4a7a-9fc9-0c41f9663303]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[356a5779-8a78-4c55-8b84-9712b8bd3869]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v caTBGsXv {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v caTBGsXv" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7029b8-ab5b-4be1-9926-873f8afb6da1]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'caTBGsXv'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f78ab20-6748-4935-b8f8-0ba5bb1d245a]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8728c35e-cffa-4185-99e7-5f3b69df2556]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:39:25 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:39:25 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a5326f-241c-410d-967d-1e04a2dd0b2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a, portal: 172.16.0.220,3260]
Aug 17 18:39:25 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a, portal: 172.16.0.220,3260] successful.
Aug 17 18:39:25 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[72182be7-2aac-45b9-baf1-705e0a1278e8]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef64d5a6-d57a-40ce-8e5c-d1be67bd5940]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:39:25 user nova-compute[72874]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)
Aug 17 18:39:25 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:39:25 user nova-compute[72874]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)
Aug 17 18:39:25 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b73774-c4d4-4339-82e1-d7a1a326951c]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:39:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'caTBGsXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23961363537353232', 'path': '/dev/sdc'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961363537353232', 'path': '/dev/sdc'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG nova.objects.instance [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'flavor' on Instance uuid c4d2b606-6c62-4fad-91b6-a9e333c7cf30 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:39:26 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:39:26 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:39:26 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:39:26 user nova-compute[72874]:   <serial>f4400196-5cf0-448c-ae0e-ff9c27bd116a</serial>
Aug 17 18:39:26 user nova-compute[72874]: </disk>
Aug 17 18:39:26 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:26 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:39:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:39:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No VIF found with MAC fa:16:3e:0f:a1:2c, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:39:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-15893d0a-76fa-4058-950b-44a05322b9c1 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.586s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:28 user nova-compute[72874]: INFO nova.compute.manager [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Rescuing
Aug 17 18:39:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquired lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG nova.network.neutron [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG nova.network.neutron [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Updating instance_info_cache with network_info: [{"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Releasing lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-9584d340-ba8b-45c2-b58e-44d2ab8a0bf5 req-94140563-34bc-47ff-a66f-692893255d42 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-vif-unplugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9584d340-ba8b-45c2-b58e-44d2ab8a0bf5 req-94140563-34bc-47ff-a66f-692893255d42 service nova] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9584d340-ba8b-45c2-b58e-44d2ab8a0bf5 req-94140563-34bc-47ff-a66f-692893255d42 service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9584d340-ba8b-45c2-b58e-44d2ab8a0bf5 req-94140563-34bc-47ff-a66f-692893255d42 service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-9584d340-ba8b-45c2-b58e-44d2ab8a0bf5 req-94140563-34bc-47ff-a66f-692893255d42 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] No waiting events found dispatching network-vif-unplugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:39:29 user nova-compute[72874]: WARNING nova.compute.manager [req-9584d340-ba8b-45c2-b58e-44d2ab8a0bf5 req-94140563-34bc-47ff-a66f-692893255d42 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received unexpected event network-vif-unplugged-50497298-f834-4b53-ae7a-8fa2482fa36c for instance with vm_state active and task_state rescuing.
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:29 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Instance destroyed successfully.
Aug 17 18:39:29 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Attempting rescue
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72874) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Instance directory exists: not creating {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 18:39:29 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Creating image(s)
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "/opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "/opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.objects.instance [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'trusted_certs' on Instance uuid c4d2b606-6c62-4fad-91b6-a9e333c7cf30 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.178s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk.rescue {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk.rescue" returned: 0 in 0.048s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.objects.instance [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'migration_context' on Instance uuid c4d2b606-6c62-4fad-91b6-a9e333c7cf30 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Start _get_guest_xml network_info=[{"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "vif_mac": "fa:16:3e:0f:a1:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.objects.instance [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'resources' on Instance uuid c4d2b606-6c62-4fad-91b6-a9e333c7cf30 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.objects.instance [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'numa_topology' on Instance uuid c4d2b606-6c62-4fad-91b6-a9e333c7cf30 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:39:29 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:39:29 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.objects.instance [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'vcpu_model' on Instance uuid c4d2b606-6c62-4fad-91b6-a9e333c7cf30 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1055707657',display_name='tempest-ServerRescueNegativeTestJSON-server-1055707657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1055707657',id=38,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3iTq9nQBkw6d5pdNe1FZAZTAW88Yk72scauvf0O1vFLhQ6P6ltfdRJDSZUaOOg8xwo+pIfXWyM0kcGTBt1oOUXk+kw323QJuB4UFVz1ZjtHmd8vO+HqSgQ+qqe2Eub2w==',key_name='tempest-keypair-931894594',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:37:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6287735c21fb4b43b3cbd9e0d742b0ec',ramdisk_id='',reservation_id='r-sbi7tlp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-717723449',owner_user_name='tempest-ServerRescueNegativeTestJSON-717723449-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:37:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3143ae598e814e359466d90e74f9b00c',uuid=c4d2b606-6c62-4fad-91b6-a9e333c7cf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "vif_mac": "fa:16:3e:0f:a1:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converting VIF {"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "vif_mac": "fa:16:3e:0f:a1:2c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a1:2c,bridge_name='br-int',has_traffic_filtering=True,id=50497298-f834-4b53-ae7a-8fa2482fa36c,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50497298-f8') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:39:29 user nova-compute[72874]: DEBUG nova.objects.instance [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'pci_devices' on Instance uuid c4d2b606-6c62-4fad-91b6-a9e333c7cf30 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:39:30 user nova-compute[72874]:   <uuid>c4d2b606-6c62-4fad-91b6-a9e333c7cf30</uuid>
Aug 17 18:39:30 user nova-compute[72874]:   <name>instance-00000026</name>
Aug 17 18:39:30 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:39:30 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:39:30 user nova-compute[72874]:   <metadata>
Aug 17 18:39:30 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:39:30 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:39:30 user nova-compute[72874]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1055707657</nova:name>
Aug 17 18:39:30 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:39:29</nova:creationTime>
Aug 17 18:39:30 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:39:30 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:39:30 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:39:30 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:39:30 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:39:30 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:39:30 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:39:30 user nova-compute[72874]:       <nova:owner>
Aug 17 18:39:30 user nova-compute[72874]:         <nova:user uuid="3143ae598e814e359466d90e74f9b00c">tempest-ServerRescueNegativeTestJSON-717723449-project-member</nova:user>
Aug 17 18:39:30 user nova-compute[72874]:         <nova:project uuid="6287735c21fb4b43b3cbd9e0d742b0ec">tempest-ServerRescueNegativeTestJSON-717723449</nova:project>
Aug 17 18:39:30 user nova-compute[72874]:       </nova:owner>
Aug 17 18:39:30 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:39:30 user nova-compute[72874]:       <nova:ports>
Aug 17 18:39:30 user nova-compute[72874]:         <nova:port uuid="50497298-f834-4b53-ae7a-8fa2482fa36c">
Aug 17 18:39:30 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 18:39:30 user nova-compute[72874]:         </nova:port>
Aug 17 18:39:30 user nova-compute[72874]:       </nova:ports>
Aug 17 18:39:30 user nova-compute[72874]:     </nova:instance>
Aug 17 18:39:30 user nova-compute[72874]:   </metadata>
Aug 17 18:39:30 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:39:30 user nova-compute[72874]:     <system>
Aug 17 18:39:30 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:39:30 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:39:30 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:39:30 user nova-compute[72874]:       <entry name="serial">c4d2b606-6c62-4fad-91b6-a9e333c7cf30</entry>
Aug 17 18:39:30 user nova-compute[72874]:       <entry name="uuid">c4d2b606-6c62-4fad-91b6-a9e333c7cf30</entry>
Aug 17 18:39:30 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:39:30 user nova-compute[72874]:     </system>
Aug 17 18:39:30 user nova-compute[72874]:   </sysinfo>
Aug 17 18:39:30 user nova-compute[72874]:   <os>
Aug 17 18:39:30 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:39:30 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:39:30 user nova-compute[72874]:   </os>
Aug 17 18:39:30 user nova-compute[72874]:   <features>
Aug 17 18:39:30 user nova-compute[72874]:     <acpi/>
Aug 17 18:39:30 user nova-compute[72874]:     <apic/>
Aug 17 18:39:30 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:39:30 user nova-compute[72874]:   </features>
Aug 17 18:39:30 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:39:30 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:39:30 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:39:30 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:39:30 user nova-compute[72874]:   </clock>
Aug 17 18:39:30 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:39:30 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:39:30 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:39:30 user nova-compute[72874]:   </cpu>
Aug 17 18:39:30 user nova-compute[72874]:   <devices>
Aug 17 18:39:30 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:39:30 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:39:30 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk.rescue"/>
Aug 17 18:39:30 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:39:30 user nova-compute[72874]:     </disk>
Aug 17 18:39:30 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:39:30 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:39:30 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk"/>
Aug 17 18:39:30 user nova-compute[72874]:       <target dev="vdb" bus="virtio"/>
Aug 17 18:39:30 user nova-compute[72874]:     </disk>
Aug 17 18:39:30 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:39:30 user nova-compute[72874]:       <mac address="fa:16:3e:0f:a1:2c"/>
Aug 17 18:39:30 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:39:30 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:39:30 user nova-compute[72874]:       <target dev="tap50497298-f8"/>
Aug 17 18:39:30 user nova-compute[72874]:     </interface>
Aug 17 18:39:30 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:39:30 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/console.log" append="off"/>
Aug 17 18:39:30 user nova-compute[72874]:     </serial>
Aug 17 18:39:30 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:39:30 user nova-compute[72874]:     <video>
Aug 17 18:39:30 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:39:30 user nova-compute[72874]:     </video>
Aug 17 18:39:30 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:39:30 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:39:30 user nova-compute[72874]:     </rng>
Aug 17 18:39:30 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:39:30 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:39:30 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:39:30 user nova-compute[72874]:     </memballoon>
Aug 17 18:39:30 user nova-compute[72874]:   </devices>
Aug 17 18:39:30 user nova-compute[72874]: </domain>
Aug 17 18:39:30 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:39:30 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:39:30 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=7858MB free_disk=24.92801284790039GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:30 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Instance destroyed successfully.
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] No VIF found with MAC fa:16:3e:0f:a1:2c, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 38df8d14-531a-42f3-8a4e-c53c1a80185f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 939268df-3817-4cdf-b7a3-4a936a6e8ec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 1cbc48a0-476c-46bf-a30b-9875c08d818a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance c4d2b606-6c62-4fad-91b6-a9e333c7cf30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance a1d61632-3c45-4141-917f-7848fb036f6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.436s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:31 user nova-compute[72874]: DEBUG nova.compute.manager [req-545248b3-8cbd-47c5-9ab9-3f2007124000 req-6f9f93e4-57f4-4670-8a79-6ca324fa135b service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:39:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-545248b3-8cbd-47c5-9ab9-3f2007124000 req-6f9f93e4-57f4-4670-8a79-6ca324fa135b service nova] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-545248b3-8cbd-47c5-9ab9-3f2007124000 req-6f9f93e4-57f4-4670-8a79-6ca324fa135b service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-545248b3-8cbd-47c5-9ab9-3f2007124000 req-6f9f93e4-57f4-4670-8a79-6ca324fa135b service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:31 user nova-compute[72874]: DEBUG nova.compute.manager [req-545248b3-8cbd-47c5-9ab9-3f2007124000 req-6f9f93e4-57f4-4670-8a79-6ca324fa135b service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] No waiting events found dispatching network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:39:31 user nova-compute[72874]: WARNING nova.compute.manager [req-545248b3-8cbd-47c5-9ab9-3f2007124000 req-6f9f93e4-57f4-4670-8a79-6ca324fa135b service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received unexpected event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c for instance with vm_state active and task_state rescuing.
Aug 17 18:39:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:39:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:39:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:32 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:39:32 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:39:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:39:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:39:32 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:39:32 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Updating instance_info_cache with network_info: [{"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:39:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:39:32 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:39:32 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:39:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-a78caf2b-473a-4165-810c-0a0fef803a2a req-c8dbe162-acd5-439c-88ca-a265dbcb829d service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:39:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a78caf2b-473a-4165-810c-0a0fef803a2a req-c8dbe162-acd5-439c-88ca-a265dbcb829d service nova] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a78caf2b-473a-4165-810c-0a0fef803a2a req-c8dbe162-acd5-439c-88ca-a265dbcb829d service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a78caf2b-473a-4165-810c-0a0fef803a2a req-c8dbe162-acd5-439c-88ca-a265dbcb829d service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-a78caf2b-473a-4165-810c-0a0fef803a2a req-c8dbe162-acd5-439c-88ca-a265dbcb829d service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] No waiting events found dispatching network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:39:33 user nova-compute[72874]: WARNING nova.compute.manager [req-a78caf2b-473a-4165-810c-0a0fef803a2a req-c8dbe162-acd5-439c-88ca-a265dbcb829d service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received unexpected event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c for instance with vm_state active and task_state rescuing.
Aug 17 18:39:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-a78caf2b-473a-4165-810c-0a0fef803a2a req-c8dbe162-acd5-439c-88ca-a265dbcb829d service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:39:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a78caf2b-473a-4165-810c-0a0fef803a2a req-c8dbe162-acd5-439c-88ca-a265dbcb829d service nova] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a78caf2b-473a-4165-810c-0a0fef803a2a req-c8dbe162-acd5-439c-88ca-a265dbcb829d service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a78caf2b-473a-4165-810c-0a0fef803a2a req-c8dbe162-acd5-439c-88ca-a265dbcb829d service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-a78caf2b-473a-4165-810c-0a0fef803a2a req-c8dbe162-acd5-439c-88ca-a265dbcb829d service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] No waiting events found dispatching network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:39:33 user nova-compute[72874]: WARNING nova.compute.manager [req-a78caf2b-473a-4165-810c-0a0fef803a2a req-c8dbe162-acd5-439c-88ca-a265dbcb829d service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received unexpected event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c for instance with vm_state active and task_state rescuing.
Aug 17 18:39:33 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:39:33 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Removed pending event for c4d2b606-6c62-4fad-91b6-a9e333c7cf30 due to event {{(pid=72874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 18:39:33 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297573.7939954, c4d2b606-6c62-4fad-91b6-a9e333c7cf30 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:39:33 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] VM Resumed (Lifecycle Event)
Aug 17 18:39:33 user nova-compute[72874]: DEBUG nova.compute.manager [None req-31b49792-8e70-457a-abaa-2292b5f4ade5 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:39:33 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:39:33 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:39:33 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 18:39:33 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297573.800021, c4d2b606-6c62-4fad-91b6-a9e333c7cf30 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:39:33 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] VM Started (Lifecycle Event)
Aug 17 18:39:33 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:39:33 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:39:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:36 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:39:39 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:39:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:39:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:39:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:39:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:39:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:39:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:39:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "38df8d14-531a-42f3-8a4e-c53c1a80185f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:39:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:39:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:39:59 user nova-compute[72874]: INFO nova.compute.manager [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Terminating instance
Aug 17 18:39:59 user nova-compute[72874]: DEBUG nova.compute.manager [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:39:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-4a296e66-1796-4fc3-b76a-c2b79db95375 req-25cb18ad-5624-440e-8796-8a9394689db1 service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received event network-vif-unplugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4a296e66-1796-4fc3-b76a-c2b79db95375 req-25cb18ad-5624-440e-8796-8a9394689db1 service nova] Acquiring lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4a296e66-1796-4fc3-b76a-c2b79db95375 req-25cb18ad-5624-440e-8796-8a9394689db1 service nova] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4a296e66-1796-4fc3-b76a-c2b79db95375 req-25cb18ad-5624-440e-8796-8a9394689db1 service nova] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-4a296e66-1796-4fc3-b76a-c2b79db95375 req-25cb18ad-5624-440e-8796-8a9394689db1 service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] No waiting events found dispatching network-vif-unplugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG nova.compute.manager [req-4a296e66-1796-4fc3-b76a-c2b79db95375 req-25cb18ad-5624-440e-8796-8a9394689db1 service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received event network-vif-unplugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:00 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Instance destroyed successfully.
Aug 17 18:40:00 user nova-compute[72874]: DEBUG nova.objects.instance [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'resources' on Instance uuid 38df8d14-531a-42f3-8a4e-c53c1a80185f {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:30:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1070652381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1070652381',id=31,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:30:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a550f3591d1347bf8b9fb4d3e90b8aad',ramdisk_id='',reservation_id='r-6scw0pi2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-68498997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:32:34Z,user_data=None,user_id='d13289795c8b4991a9cf6bb2880ad6ef',uuid=38df8d14-531a-42f3-8a4e-c53c1a80185f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "address": "fa:16:3e:9c:53:06", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c43eee-c2", "ovs_interfaceid": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converting VIF {"id": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "address": "fa:16:3e:9c:53:06", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2c43eee-c2", "ovs_interfaceid": "d2c43eee-c27d-477d-b02f-1f45a7e1e843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d2c43eee-c27d-477d-b02f-1f45a7e1e843,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c43eee-c2') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG os_vif [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d2c43eee-c27d-477d-b02f-1f45a7e1e843,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c43eee-c2') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2c43eee-c2, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:40:00 user nova-compute[72874]: INFO os_vif [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:53:06,bridge_name='br-int',has_traffic_filtering=True,id=d2c43eee-c27d-477d-b02f-1f45a7e1e843,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2c43eee-c2')
Aug 17 18:40:00 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Deleting instance files /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f_del
Aug 17 18:40:00 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Deletion of /opt/stack/data/nova/instances/38df8d14-531a-42f3-8a4e-c53c1a80185f_del complete
Aug 17 18:40:00 user nova-compute[72874]: INFO nova.compute.manager [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Took 0.83 seconds to destroy the instance on the hypervisor.
Aug 17 18:40:00 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:01 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:40:01 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Took 1.05 seconds to deallocate network for instance.
Aug 17 18:40:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-d4c251d9-5e9c-4157-9871-40de7653111e req-18be624e-d159-4c28-98e3-d385aec3689f service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received event network-vif-deleted-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received event network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] Acquiring lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] No waiting events found dispatching network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:02 user nova-compute[72874]: WARNING nova.compute.manager [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received unexpected event network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 for instance with vm_state deleted and task_state None.
Aug 17 18:40:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received event network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] Acquiring lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] No waiting events found dispatching network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:02 user nova-compute[72874]: WARNING nova.compute.manager [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received unexpected event network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 for instance with vm_state deleted and task_state None.
Aug 17 18:40:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received event network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] Acquiring lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] No waiting events found dispatching network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:02 user nova-compute[72874]: WARNING nova.compute.manager [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received unexpected event network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 for instance with vm_state deleted and task_state None.
Aug 17 18:40:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received event network-vif-unplugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] Acquiring lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] No waiting events found dispatching network-vif-unplugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:02 user nova-compute[72874]: WARNING nova.compute.manager [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received unexpected event network-vif-unplugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 for instance with vm_state deleted and task_state None.
Aug 17 18:40:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received event network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] Acquiring lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:02 user nova-compute[72874]: DEBUG nova.compute.manager [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] No waiting events found dispatching network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:02 user nova-compute[72874]: WARNING nova.compute.manager [req-9b4c8e3e-059e-462d-8c1a-1d3327300494 req-e3f9cc8e-0413-44ae-9353-f7fa24520b4b service nova] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Received unexpected event network-vif-plugged-d2c43eee-c27d-477d-b02f-1f45a7e1e843 for instance with vm_state deleted and task_state None.
Aug 17 18:40:02 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Deleted allocations for instance 38df8d14-531a-42f3-8a4e-c53c1a80185f
Aug 17 18:40:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-655ed8c8-5d02-4527-8e51-424ebc0c71f5 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "38df8d14-531a-42f3-8a4e-c53c1a80185f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.425s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:08 user nova-compute[72874]: INFO nova.compute.manager [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Terminating instance
Aug 17 18:40:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:40:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:08 user nova-compute[72874]: DEBUG nova.compute.manager [req-bed9dead-a964-4f49-abd8-1c90f14f7908 req-47710e6c-673f-4b8c-9615-070997303c9c service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Received event network-vif-unplugged-c16a8e4a-00bf-436f-a021-98297ac4e14a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bed9dead-a964-4f49-abd8-1c90f14f7908 req-47710e6c-673f-4b8c-9615-070997303c9c service nova] Acquiring lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bed9dead-a964-4f49-abd8-1c90f14f7908 req-47710e6c-673f-4b8c-9615-070997303c9c service nova] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-bed9dead-a964-4f49-abd8-1c90f14f7908 req-47710e6c-673f-4b8c-9615-070997303c9c service nova] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:08 user nova-compute[72874]: DEBUG nova.compute.manager [req-bed9dead-a964-4f49-abd8-1c90f14f7908 req-47710e6c-673f-4b8c-9615-070997303c9c service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] No waiting events found dispatching network-vif-unplugged-c16a8e4a-00bf-436f-a021-98297ac4e14a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:08 user nova-compute[72874]: DEBUG nova.compute.manager [req-bed9dead-a964-4f49-abd8-1c90f14f7908 req-47710e6c-673f-4b8c-9615-070997303c9c service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Received event network-vif-unplugged-c16a8e4a-00bf-436f-a021-98297ac4e14a for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:40:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:09 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Instance destroyed successfully.
Aug 17 18:40:09 user nova-compute[72874]: DEBUG nova.objects.instance [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lazy-loading 'resources' on Instance uuid 939268df-3817-4cdf-b7a3-4a936a6e8ec9 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:40:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:36:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-331170581',display_name='tempest-TestServerVolumeAttachmentScenario-server-331170581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-331170581',id=36,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOY15x83Fv+Mg812YWUFkwpmPG7571+/OVK4LQecRJNVMpRXujdaDtiTPYWHvi5m/Rq2S9GLg4mTdTB7wjDE2DQQtCPGXAuhuzqfNK282QmZLA0t5+oJx/EoPFgrNT+A2Q==',key_name='tempest-keypair-1074304418',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:36:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='70d802b863c04d0195c73e6ec1889c8f',ramdisk_id='',reservation_id='r-opr2i1zl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1089325841',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1089325841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:36:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bd31113bd5164578811f839d549dfd58',uuid=939268df-3817-4cdf-b7a3-4a936a6e8ec9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "address": "fa:16:3e:e5:42:31", "network": {"id": "6fe94371-138a-464d-89fd-9c9f9ebaaecd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-826475339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d802b863c04d0195c73e6ec1889c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16a8e4a-00", "ovs_interfaceid": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:40:09 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Converting VIF {"id": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "address": "fa:16:3e:e5:42:31", "network": {"id": "6fe94371-138a-464d-89fd-9c9f9ebaaecd", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-826475339-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "70d802b863c04d0195c73e6ec1889c8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc16a8e4a-00", "ovs_interfaceid": "c16a8e4a-00bf-436f-a021-98297ac4e14a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:40:09 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:42:31,bridge_name='br-int',has_traffic_filtering=True,id=c16a8e4a-00bf-436f-a021-98297ac4e14a,network=Network(6fe94371-138a-464d-89fd-9c9f9ebaaecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16a8e4a-00') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:40:09 user nova-compute[72874]: DEBUG os_vif [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:42:31,bridge_name='br-int',has_traffic_filtering=True,id=c16a8e4a-00bf-436f-a021-98297ac4e14a,network=Network(6fe94371-138a-464d-89fd-9c9f9ebaaecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16a8e4a-00') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:40:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc16a8e4a-00, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:40:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:40:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:09 user nova-compute[72874]: INFO os_vif [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:42:31,bridge_name='br-int',has_traffic_filtering=True,id=c16a8e4a-00bf-436f-a021-98297ac4e14a,network=Network(6fe94371-138a-464d-89fd-9c9f9ebaaecd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc16a8e4a-00')
Aug 17 18:40:09 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Deleting instance files /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9_del
Aug 17 18:40:09 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Deletion of /opt/stack/data/nova/instances/939268df-3817-4cdf-b7a3-4a936a6e8ec9_del complete
Aug 17 18:40:09 user nova-compute[72874]: INFO nova.compute.manager [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 18:40:09 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:40:09 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:40:09 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:40:10 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:40:10 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Took 0.97 seconds to deallocate network for instance.
Aug 17 18:40:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-e7ca0b07-01f5-437c-8d49-9d55ff801604 req-209b906e-e7e7-4b36-8cdf-28bdbddad522 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Received event network-vif-deleted-c16a8e4a-00bf-436f-a021-98297ac4e14a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:10 user nova-compute[72874]: INFO nova.compute.manager [req-e7ca0b07-01f5-437c-8d49-9d55ff801604 req-209b906e-e7e7-4b36-8cdf-28bdbddad522 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Neutron deleted interface c16a8e4a-00bf-436f-a021-98297ac4e14a; detaching it from the instance and deleting it from the info cache
Aug 17 18:40:10 user nova-compute[72874]: DEBUG nova.network.neutron [req-e7ca0b07-01f5-437c-8d49-9d55ff801604 req-209b906e-e7e7-4b36-8cdf-28bdbddad522 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:40:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-e7ca0b07-01f5-437c-8d49-9d55ff801604 req-209b906e-e7e7-4b36-8cdf-28bdbddad522 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Detach interface failed, port_id=c16a8e4a-00bf-436f-a021-98297ac4e14a, reason: Instance 939268df-3817-4cdf-b7a3-4a936a6e8ec9 could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:40:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:10 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:40:10 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:40:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:10 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Deleted allocations for instance 939268df-3817-4cdf-b7a3-4a936a6e8ec9
Aug 17 18:40:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-03aee626-ce4f-455f-9853-acc4d45effe8 tempest-TestServerVolumeAttachmentScenario-1089325841 tempest-TestServerVolumeAttachmentScenario-1089325841-project-member] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.283s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:11 user nova-compute[72874]: DEBUG nova.compute.manager [req-e1213a72-d297-45da-aea2-304ec4f063db req-cb4c207a-cf58-4d94-8740-b0009b3c61e8 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Received event network-vif-plugged-c16a8e4a-00bf-436f-a021-98297ac4e14a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e1213a72-d297-45da-aea2-304ec4f063db req-cb4c207a-cf58-4d94-8740-b0009b3c61e8 service nova] Acquiring lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e1213a72-d297-45da-aea2-304ec4f063db req-cb4c207a-cf58-4d94-8740-b0009b3c61e8 service nova] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e1213a72-d297-45da-aea2-304ec4f063db req-cb4c207a-cf58-4d94-8740-b0009b3c61e8 service nova] Lock "939268df-3817-4cdf-b7a3-4a936a6e8ec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:11 user nova-compute[72874]: DEBUG nova.compute.manager [req-e1213a72-d297-45da-aea2-304ec4f063db req-cb4c207a-cf58-4d94-8740-b0009b3c61e8 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] No waiting events found dispatching network-vif-plugged-c16a8e4a-00bf-436f-a021-98297ac4e14a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:11 user nova-compute[72874]: WARNING nova.compute.manager [req-e1213a72-d297-45da-aea2-304ec4f063db req-cb4c207a-cf58-4d94-8740-b0009b3c61e8 service nova] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Received unexpected event network-vif-plugged-c16a8e4a-00bf-436f-a021-98297ac4e14a for instance with vm_state deleted and task_state None.
Aug 17 18:40:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:15 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297600.477074, 38df8d14-531a-42f3-8a4e-c53c1a80185f => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:40:15 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] VM Stopped (Lifecycle Event)
Aug 17 18:40:15 user nova-compute[72874]: DEBUG nova.compute.manager [None req-1e0abfe9-a21c-4031-a3ba-2a03e7016fcd None None] [instance: 38df8d14-531a-42f3-8a4e-c53c1a80185f] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:40:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:24 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297609.4083443, 939268df-3817-4cdf-b7a3-4a936a6e8ec9 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:40:24 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] VM Stopped (Lifecycle Event)
Aug 17 18:40:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bd20d818-22b9-4f23-9818-f278ab38bbba None None] [instance: 939268df-3817-4cdf-b7a3-4a936a6e8ec9] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:40:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:27 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:40:27 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:40:27 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:40:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:27 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:40:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:40:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:40:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:30 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:40:30 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:40:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8053MB free_disk=25.069438934326172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 1cbc48a0-476c-46bf-a30b-9875c08d818a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance c4d2b606-6c62-4fad-91b6-a9e333c7cf30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance a1d61632-3c45-4141-917f-7848fb036f6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:40:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "a1d61632-3c45-4141-917f-7848fb036f6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "a1d61632-3c45-4141-917f-7848fb036f6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:32 user nova-compute[72874]: INFO nova.compute.manager [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Terminating instance
Aug 17 18:40:32 user nova-compute[72874]: DEBUG nova.compute.manager [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG nova.compute.manager [req-fe528b27-17b2-4135-bd1c-4c8cb1f831f4 req-643d0be3-a661-4531-86ff-6c18239d4f84 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received event network-vif-unplugged-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fe528b27-17b2-4135-bd1c-4c8cb1f831f4 req-643d0be3-a661-4531-86ff-6c18239d4f84 service nova] Acquiring lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fe528b27-17b2-4135-bd1c-4c8cb1f831f4 req-643d0be3-a661-4531-86ff-6c18239d4f84 service nova] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fe528b27-17b2-4135-bd1c-4c8cb1f831f4 req-643d0be3-a661-4531-86ff-6c18239d4f84 service nova] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG nova.compute.manager [req-fe528b27-17b2-4135-bd1c-4c8cb1f831f4 req-643d0be3-a661-4531-86ff-6c18239d4f84 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] No waiting events found dispatching network-vif-unplugged-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG nova.compute.manager [req-fe528b27-17b2-4135-bd1c-4c8cb1f831f4 req-643d0be3-a661-4531-86ff-6c18239d4f84 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received event network-vif-unplugged-5fa239d2-4325-4554-a90b-116902f818ae for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:32 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Instance destroyed successfully.
Aug 17 18:40:32 user nova-compute[72874]: DEBUG nova.objects.instance [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lazy-loading 'resources' on Instance uuid a1d61632-3c45-4141-917f-7848fb036f6d {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:38:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-530975050',display_name='tempest-ServersNegativeTestJSON-server-530975050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-530975050',id=39,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:38:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1eab2a4b0d14b11b488bcc6a8638134',ramdisk_id='',reservation_id='r-zplor80n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-754663374',owner_user_name='tempest-ServersNegativeTestJSON-754663374-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:38:48Z,user_data=None,user_id='500d14cc838b4812bd7a5d36336ae6ae',uuid=a1d61632-3c45-4141-917f-7848fb036f6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fa239d2-4325-4554-a90b-116902f818ae", "address": "fa:16:3e:67:18:19", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa239d2-43", "ovs_interfaceid": "5fa239d2-4325-4554-a90b-116902f818ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Converting VIF {"id": "5fa239d2-4325-4554-a90b-116902f818ae", "address": "fa:16:3e:67:18:19", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fa239d2-43", "ovs_interfaceid": "5fa239d2-4325-4554-a90b-116902f818ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:19,bridge_name='br-int',has_traffic_filtering=True,id=5fa239d2-4325-4554-a90b-116902f818ae,network=Network(518607ac-ae8a-4a0e-823a-0b65d7de624b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa239d2-43') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG os_vif [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:19,bridge_name='br-int',has_traffic_filtering=True,id=5fa239d2-4325-4554-a90b-116902f818ae,network=Network(518607ac-ae8a-4a0e-823a-0b65d7de624b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa239d2-43') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fa239d2-43, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:32 user nova-compute[72874]: INFO os_vif [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:18:19,bridge_name='br-int',has_traffic_filtering=True,id=5fa239d2-4325-4554-a90b-116902f818ae,network=Network(518607ac-ae8a-4a0e-823a-0b65d7de624b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fa239d2-43')
Aug 17 18:40:32 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Deleting instance files /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d_del
Aug 17 18:40:32 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Deletion of /opt/stack/data/nova/instances/a1d61632-3c45-4141-917f-7848fb036f6d_del complete
Aug 17 18:40:32 user nova-compute[72874]: INFO nova.compute.manager [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 17 18:40:32 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:33 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:40:33 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Took 0.82 seconds to deallocate network for instance.
Aug 17 18:40:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-33c6a1cb-acab-49a0-83cb-777f60261b67 req-fe0ad384-2579-4987-8246-85069235774d service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received event network-vif-deleted-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:33 user nova-compute[72874]: INFO nova.compute.manager [req-33c6a1cb-acab-49a0-83cb-777f60261b67 req-fe0ad384-2579-4987-8246-85069235774d service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Neutron deleted interface 5fa239d2-4325-4554-a90b-116902f818ae; detaching it from the instance and deleting it from the info cache
Aug 17 18:40:33 user nova-compute[72874]: DEBUG nova.network.neutron [req-33c6a1cb-acab-49a0-83cb-777f60261b67 req-fe0ad384-2579-4987-8246-85069235774d service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:40:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-33c6a1cb-acab-49a0-83cb-777f60261b67 req-fe0ad384-2579-4987-8246-85069235774d service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Detach interface failed, port_id=5fa239d2-4325-4554-a90b-116902f818ae, reason: Instance a1d61632-3c45-4141-917f-7848fb036f6d could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:40:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:33 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:40:33 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:40:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.232s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:34 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Deleted allocations for instance a1d61632-3c45-4141-917f-7848fb036f6d
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-379e09d8-7a91-479f-a7d7-b381e5749d7b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "a1d61632-3c45-4141-917f-7848fb036f6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.906s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received event network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] Acquiring lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] No waiting events found dispatching network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:34 user nova-compute[72874]: WARNING nova.compute.manager [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received unexpected event network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae for instance with vm_state deleted and task_state None.
Aug 17 18:40:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received event network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] Acquiring lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] No waiting events found dispatching network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:34 user nova-compute[72874]: WARNING nova.compute.manager [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received unexpected event network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae for instance with vm_state deleted and task_state None.
Aug 17 18:40:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received event network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] Acquiring lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] No waiting events found dispatching network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:34 user nova-compute[72874]: WARNING nova.compute.manager [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received unexpected event network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae for instance with vm_state deleted and task_state None.
Aug 17 18:40:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received event network-vif-unplugged-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] Acquiring lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] No waiting events found dispatching network-vif-unplugged-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:34 user nova-compute[72874]: WARNING nova.compute.manager [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received unexpected event network-vif-unplugged-5fa239d2-4325-4554-a90b-116902f818ae for instance with vm_state deleted and task_state None.
Aug 17 18:40:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received event network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] Acquiring lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] Lock "a1d61632-3c45-4141-917f-7848fb036f6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] No waiting events found dispatching network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:34 user nova-compute[72874]: WARNING nova.compute.manager [req-d50f1e92-f31f-44bd-b7be-04396ab1afb7 req-603cc0aa-6a5e-4ddf-a6d2-77225ee3de72 service nova] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Received unexpected event network-vif-plugged-5fa239d2-4325-4554-a90b-116902f818ae for instance with vm_state deleted and task_state None.
Aug 17 18:40:34 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:40:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:40:35 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Didn't find any instances for network info cache update. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 18:40:35 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:40:35 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:40:35 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:40:36 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:40:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "794b74db-61ea-478d-9d4d-6380fda3a20c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:40:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:36 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:40:36 user nova-compute[72874]: INFO nova.compute.claims [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Claim successful on node user
Aug 17 18:40:37 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:40:37 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:40:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:40:37 user nova-compute[72874]: INFO nova.virt.block_device [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Booting with volume 3053295a-2f62-4f60-a1ec-ceca666e53f7 at /dev/vda
Aug 17 18:40:37 user nova-compute[72874]: DEBUG nova.policy [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '737b7b45d61a4a4da68539e463bd1483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '442712d4c97643208940c3be5ecedd02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG os_brick.utils [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[13338a3c-f019-45bb-97d3-12fd33a243b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4af34d1-7a74-4edb-b154-791229e34cdd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fae618-30c1-400e-a009-19227c267b1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1122bed4-d619-472d-99b9-ac0a482dc99d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:40:37 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:40:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e4c891-b66b-4f66-88fb-3fbb216ff73e]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG os_brick.utils [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updating existing volume attachment record: 6f8eb040-8709-4a02-af37-f2e4aad16daa {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:37 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Successfully created port: 8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:40:38 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Successfully updated port: 8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:40:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:40:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquired lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:40:38 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:40:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-7f3ce49b-c6dd-42ad-a3a2-5e5de0bdf233 req-8dbfbb92-85b5-470c-809c-bfb070cbfc0d service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received event network-changed-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-7f3ce49b-c6dd-42ad-a3a2-5e5de0bdf233 req-8dbfbb92-85b5-470c-809c-bfb070cbfc0d service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Refreshing instance network info cache due to event network-changed-8ea2189e-d741-45d3-90a7-e96a7001a3fe. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:40:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7f3ce49b-c6dd-42ad-a3a2-5e5de0bdf233 req-8dbfbb92-85b5-470c-809c-bfb070cbfc0d service nova] Acquiring lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:40:38 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:40:39 user nova-compute[72874]: DEBUG nova.network.neutron [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updating instance_info_cache with network_info: [{"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:40:39 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:40:39 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:40:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:40:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Releasing lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:40:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Instance network_info: |[{"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:40:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7f3ce49b-c6dd-42ad-a3a2-5e5de0bdf233 req-8dbfbb92-85b5-470c-809c-bfb070cbfc0d service nova] Acquired lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:40:39 user nova-compute[72874]: DEBUG nova.network.neutron [req-7f3ce49b-c6dd-42ad-a3a2-5e5de0bdf233 req-8dbfbb92-85b5-470c-809c-bfb070cbfc0d service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Refreshing network info cache for port 8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:40:39 user nova-compute[72874]: DEBUG nova.network.neutron [req-7f3ce49b-c6dd-42ad-a3a2-5e5de0bdf233 req-8dbfbb92-85b5-470c-809c-bfb070cbfc0d service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updated VIF entry in instance network info cache for port 8ea2189e-d741-45d3-90a7-e96a7001a3fe. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:40:39 user nova-compute[72874]: DEBUG nova.network.neutron [req-7f3ce49b-c6dd-42ad-a3a2-5e5de0bdf233 req-8dbfbb92-85b5-470c-809c-bfb070cbfc0d service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updating instance_info_cache with network_info: [{"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:40:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7f3ce49b-c6dd-42ad-a3a2-5e5de0bdf233 req-8dbfbb92-85b5-470c-809c-bfb070cbfc0d service nova] Releasing lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:40:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:47 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297632.740922, a1d61632-3c45-4141-917f-7848fb036f6d => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:40:47 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] VM Stopped (Lifecycle Event)
Aug 17 18:40:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-51cebb28-e550-47c1-8547-13916d98b8e1 None None] [instance: a1d61632-3c45-4141-917f-7848fb036f6d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:40:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:40:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:40:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Creating image(s)
Aug 17 18:40:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 18:40:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Ensure instance console log exists: /opt/stack/data/nova/instances/794b74db-61ea-478d-9d4d-6380fda3a20c/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:40:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Start _get_guest_xml network_info=[{"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrEnsfIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '794b74db-61ea-478d-9d4d-6380fda3a20c', 'attached_at': '', 'detached_at': '', 'volume_id': '3053295a-2f62-4f60-a1ec-ceca666e53f7', 'serial': '3053295a-2f62-4f60-a1ec-ceca666e53f7'}, 'delete_on_termination': True, 'attachment_id': '6f8eb040-8709-4a02-af37-f2e4aad16daa', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:40:47 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:40:47 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrEnsfIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:40:48 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:40:48 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:40:48 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c81dcaf-41dc-4363-b1e3-54e57a89adde]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:40:48 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3556dc6-d1cf-44a8-827a-51c2ef247976]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7] added
Aug 17 18:40:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e2857d-8e7d-4035-bb4a-7217742648b7]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7a85d1-3284-4cee-ab65-ef749bb6c989]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrEnsfIc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrEnsfIc" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[992322b9-99c9-4a29-bd2f-2119c47bcb26]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CrEnsfIc'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eb4b0a-f438-43ce-9d4d-73fc0c24020e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f963e0a6-24a7-4490-839a-9f1daa922819]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:40:48 user nova-compute[72874]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)
Aug 17 18:40:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:40:48 user nova-compute[72874]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)
Aug 17 18:40:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7d2a33-a915-4f2a-854f-7d2fd2b00582]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7, portal: 172.16.0.220,3260]
Aug 17 18:40:48 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7, portal: 172.16.0.220,3260] successful.
Aug 17 18:40:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65f746b-0c73-43bc-bee3-7428345d2dcb]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[da12d393-2ffa-4300-84e3-f2d614736bfa]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:40:48 user nova-compute[72874]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)
Aug 17 18:40:48 user nova-compute[72874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)
Aug 17 18:40:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:40:48 user nova-compute[72874]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)
Aug 17 18:40:48 user nova-compute[72874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)
Aug 17 18:40:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd35c20-f04c-403b-b85f-9b68a6eee883]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:40:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrEnsfIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26433303562616662', 'path': '/dev/sdd'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433303562616662', 'path': '/dev/sdd'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1706665819',display_name='tempest-TestShelveInstance-server-1706665819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1706665819',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqy6nYYaqyNvje0gkLPcdEvXj/bISglLAvp7zAI8ZcdQeUFMPS3/Qsw2b6NirZ7f0MDmJNWYLhK28eOGKzhjiheFnFHZb7HcGrNbGLTtcCzWaJ+AHusJELx1RsmVZ7f5A==',key_name='tempest-TestShelveInstance-101218560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='442712d4c97643208940c3be5ecedd02',ramdisk_id='',reservation_id='r-9y1yy1ch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1461547480',owner_user_name='tempest-TestShelveInstance-1461547480-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:40:37Z,user_data=None,user_id='737b7b45d61a4a4da68539e463bd1483',uuid=794b74db-61ea-478d-9d4d-6380fda3a20c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Converting VIF {"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:59:33,bridge_name='br-int',has_traffic_filtering=True,id=8ea2189e-d741-45d3-90a7-e96a7001a3fe,network=Network(c8d77991-30ad-400e-8a4e-ae2a3f341354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2189e-d7') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG nova.objects.instance [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lazy-loading 'pci_devices' on Instance uuid 794b74db-61ea-478d-9d4d-6380fda3a20c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:40:49 user nova-compute[72874]:   <uuid>794b74db-61ea-478d-9d4d-6380fda3a20c</uuid>
Aug 17 18:40:49 user nova-compute[72874]:   <name>instance-00000028</name>
Aug 17 18:40:49 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:40:49 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:40:49 user nova-compute[72874]:   <metadata>
Aug 17 18:40:49 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:40:49 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:40:49 user nova-compute[72874]:       <nova:name>tempest-TestShelveInstance-server-1706665819</nova:name>
Aug 17 18:40:49 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:40:47</nova:creationTime>
Aug 17 18:40:49 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:40:49 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:40:49 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:40:49 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:40:49 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:40:49 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:40:49 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:40:49 user nova-compute[72874]:       <nova:owner>
Aug 17 18:40:49 user nova-compute[72874]:         <nova:user uuid="737b7b45d61a4a4da68539e463bd1483">tempest-TestShelveInstance-1461547480-project-member</nova:user>
Aug 17 18:40:49 user nova-compute[72874]:         <nova:project uuid="442712d4c97643208940c3be5ecedd02">tempest-TestShelveInstance-1461547480</nova:project>
Aug 17 18:40:49 user nova-compute[72874]:       </nova:owner>
Aug 17 18:40:49 user nova-compute[72874]:       <nova:ports>
Aug 17 18:40:49 user nova-compute[72874]:         <nova:port uuid="8ea2189e-d741-45d3-90a7-e96a7001a3fe">
Aug 17 18:40:49 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 18:40:49 user nova-compute[72874]:         </nova:port>
Aug 17 18:40:49 user nova-compute[72874]:       </nova:ports>
Aug 17 18:40:49 user nova-compute[72874]:     </nova:instance>
Aug 17 18:40:49 user nova-compute[72874]:   </metadata>
Aug 17 18:40:49 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:40:49 user nova-compute[72874]:     <system>
Aug 17 18:40:49 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:40:49 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:40:49 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:40:49 user nova-compute[72874]:       <entry name="serial">794b74db-61ea-478d-9d4d-6380fda3a20c</entry>
Aug 17 18:40:49 user nova-compute[72874]:       <entry name="uuid">794b74db-61ea-478d-9d4d-6380fda3a20c</entry>
Aug 17 18:40:49 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:40:49 user nova-compute[72874]:     </system>
Aug 17 18:40:49 user nova-compute[72874]:   </sysinfo>
Aug 17 18:40:49 user nova-compute[72874]:   <os>
Aug 17 18:40:49 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:40:49 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:40:49 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:40:49 user nova-compute[72874]:   </os>
Aug 17 18:40:49 user nova-compute[72874]:   <features>
Aug 17 18:40:49 user nova-compute[72874]:     <acpi/>
Aug 17 18:40:49 user nova-compute[72874]:     <apic/>
Aug 17 18:40:49 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:40:49 user nova-compute[72874]:   </features>
Aug 17 18:40:49 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:40:49 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:40:49 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:40:49 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:40:49 user nova-compute[72874]:   </clock>
Aug 17 18:40:49 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:40:49 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:40:49 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:40:49 user nova-compute[72874]:   </cpu>
Aug 17 18:40:49 user nova-compute[72874]:   <devices>
Aug 17 18:40:49 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:40:49 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:40:49 user nova-compute[72874]:       <source dev="/dev/sdd"/>
Aug 17 18:40:49 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:40:49 user nova-compute[72874]:       <serial>3053295a-2f62-4f60-a1ec-ceca666e53f7</serial>
Aug 17 18:40:49 user nova-compute[72874]:     </disk>
Aug 17 18:40:49 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:40:49 user nova-compute[72874]:       <mac address="fa:16:3e:75:59:33"/>
Aug 17 18:40:49 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:40:49 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:40:49 user nova-compute[72874]:       <target dev="tap8ea2189e-d7"/>
Aug 17 18:40:49 user nova-compute[72874]:     </interface>
Aug 17 18:40:49 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:40:49 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/794b74db-61ea-478d-9d4d-6380fda3a20c/console.log" append="off"/>
Aug 17 18:40:49 user nova-compute[72874]:     </serial>
Aug 17 18:40:49 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:40:49 user nova-compute[72874]:     <video>
Aug 17 18:40:49 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:40:49 user nova-compute[72874]:     </video>
Aug 17 18:40:49 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:40:49 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:40:49 user nova-compute[72874]:     </rng>
Aug 17 18:40:49 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:40:49 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:40:49 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:40:49 user nova-compute[72874]:     </memballoon>
Aug 17 18:40:49 user nova-compute[72874]:   </devices>
Aug 17 18:40:49 user nova-compute[72874]: </domain>
Aug 17 18:40:49 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1706665819',display_name='tempest-TestShelveInstance-server-1706665819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1706665819',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqy6nYYaqyNvje0gkLPcdEvXj/bISglLAvp7zAI8ZcdQeUFMPS3/Qsw2b6NirZ7f0MDmJNWYLhK28eOGKzhjiheFnFHZb7HcGrNbGLTtcCzWaJ+AHusJELx1RsmVZ7f5A==',key_name='tempest-TestShelveInstance-101218560',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='442712d4c97643208940c3be5ecedd02',ramdisk_id='',reservation_id='r-9y1yy1ch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1461547480',owner_user_name='tempest-TestShelveInstance-1461547480-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:40:37Z,user_data=None,user_id='737b7b45d61a4a4da68539e463bd1483',uuid=794b74db-61ea-478d-9d4d-6380fda3a20c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Converting VIF {"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:59:33,bridge_name='br-int',has_traffic_filtering=True,id=8ea2189e-d741-45d3-90a7-e96a7001a3fe,network=Network(c8d77991-30ad-400e-8a4e-ae2a3f341354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2189e-d7') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG os_vif [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:59:33,bridge_name='br-int',has_traffic_filtering=True,id=8ea2189e-d741-45d3-90a7-e96a7001a3fe,network=Network(c8d77991-30ad-400e-8a4e-ae2a3f341354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2189e-d7') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ea2189e-d7, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ea2189e-d7, col_values=(('external_ids', {'iface-id': '8ea2189e-d741-45d3-90a7-e96a7001a3fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:59:33', 'vm-uuid': '794b74db-61ea-478d-9d4d-6380fda3a20c'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:49 user nova-compute[72874]: INFO os_vif [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:59:33,bridge_name='br-int',has_traffic_filtering=True,id=8ea2189e-d741-45d3-90a7-e96a7001a3fe,network=Network(c8d77991-30ad-400e-8a4e-ae2a3f341354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2189e-d7')
Aug 17 18:40:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:40:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] No VIF found with MAC fa:16:3e:75:59:33, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:50 user nova-compute[72874]: INFO nova.compute.manager [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Terminating instance
Aug 17 18:40:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-b98621e8-e0c9-4830-82c7-4fad162e4b9b req-d0f8322f-6260-42b0-83c2-a1e37fafd0f7 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received event network-vif-unplugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b98621e8-e0c9-4830-82c7-4fad162e4b9b req-d0f8322f-6260-42b0-83c2-a1e37fafd0f7 service nova] Acquiring lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b98621e8-e0c9-4830-82c7-4fad162e4b9b req-d0f8322f-6260-42b0-83c2-a1e37fafd0f7 service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b98621e8-e0c9-4830-82c7-4fad162e4b9b req-d0f8322f-6260-42b0-83c2-a1e37fafd0f7 service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-b98621e8-e0c9-4830-82c7-4fad162e4b9b req-d0f8322f-6260-42b0-83c2-a1e37fafd0f7 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] No waiting events found dispatching network-vif-unplugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-b98621e8-e0c9-4830-82c7-4fad162e4b9b req-d0f8322f-6260-42b0-83c2-a1e37fafd0f7 service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received event network-vif-unplugged-2d5c5445-861c-412b-8929-030ec72e68fb for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG nova.compute.manager [req-c95d3d96-ee04-4734-a71d-bd95f9da0119 req-9f03d0a8-23ad-45ca-a15e-6d991bc47a7a service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received event network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c95d3d96-ee04-4734-a71d-bd95f9da0119 req-9f03d0a8-23ad-45ca-a15e-6d991bc47a7a service nova] Acquiring lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c95d3d96-ee04-4734-a71d-bd95f9da0119 req-9f03d0a8-23ad-45ca-a15e-6d991bc47a7a service nova] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c95d3d96-ee04-4734-a71d-bd95f9da0119 req-9f03d0a8-23ad-45ca-a15e-6d991bc47a7a service nova] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG nova.compute.manager [req-c95d3d96-ee04-4734-a71d-bd95f9da0119 req-9f03d0a8-23ad-45ca-a15e-6d991bc47a7a service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] No waiting events found dispatching network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:51 user nova-compute[72874]: WARNING nova.compute.manager [req-c95d3d96-ee04-4734-a71d-bd95f9da0119 req-9f03d0a8-23ad-45ca-a15e-6d991bc47a7a service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received unexpected event network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe for instance with vm_state building and task_state spawning.
Aug 17 18:40:51 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Instance destroyed successfully.
Aug 17 18:40:51 user nova-compute[72874]: DEBUG nova.objects.instance [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'resources' on Instance uuid 2961b0b8-98d0-4ba5-a0fa-b719753589ea {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:25:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-584565083',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-584565083',id=23,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:27:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a550f3591d1347bf8b9fb4d3e90b8aad',ramdisk_id='',reservation_id='r-7lqgm0qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-68498997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:28:51Z,user_data=None,user_id='d13289795c8b4991a9cf6bb2880ad6ef',uuid=2961b0b8-98d0-4ba5-a0fa-b719753589ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converting VIF {"id": "2d5c5445-861c-412b-8929-030ec72e68fb", "address": "fa:16:3e:3d:02:9b", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5c5445-86", "ovs_interfaceid": "2d5c5445-861c-412b-8929-030ec72e68fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:02:9b,bridge_name='br-int',has_traffic_filtering=True,id=2d5c5445-861c-412b-8929-030ec72e68fb,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5c5445-86') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_vif [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:02:9b,bridge_name='br-int',has_traffic_filtering=True,id=2d5c5445-861c-412b-8929-030ec72e68fb,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5c5445-86') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d5c5445-86, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:40:51 user nova-compute[72874]: INFO os_vif [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:02:9b,bridge_name='br-int',has_traffic_filtering=True,id=2d5c5445-861c-412b-8929-030ec72e68fb,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5c5445-86')
Aug 17 18:40:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wxjuHieG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:40:51 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a71cfd-2253-4765-bfa5-7f6245a75797]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0de20d-5a23-4224-86f4-00966fb33a98]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:40:51 user nova-compute[72874]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)
Aug 17 18:40:51 user nova-compute[72874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)
Aug 17 18:40:51 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 (non-flash)
Aug 17 18:40:51 user nova-compute[72874]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)
Aug 17 18:40:51 user nova-compute[72874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)
Aug 17 18:40:51 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a06083a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6854a057-f517-42a2-8703-12ccf12e34af]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[22253560-6571-4bdc-918a-7fd755adaf32]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc60036-9904-4f97-9087-5aef373bdd6d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0858fd38-2cc0-4a2a-917e-9aa04737aaf2]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdd2568-03e0-4b04-a457-52f1d36152e8]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[600f9e28-f1cf-45fb-a02b-10ccda806cea]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3, portal: 172.16.0.220,3260]
Aug 17 18:40:51 user nova-compute[72874]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3, portal: 172.16.0.220,3260] successful.
Aug 17 18:40:51 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c51cc2b-ba5d-4ed0-818d-17bad96f23b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5d6405-f930-477f-b23f-2378f36e1f68]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] <== disconnect_volume: return (259ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:40:51 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Deleting instance files /opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea_del
Aug 17 18:40:51 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Deletion of /opt/stack/data/nova/instances/2961b0b8-98d0-4ba5-a0fa-b719753589ea_del complete
Aug 17 18:40:51 user nova-compute[72874]: INFO nova.compute.manager [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Took 1.30 seconds to destroy the instance on the hypervisor.
Aug 17 18:40:51 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:40:51 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:40:52 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:40:52 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Took 0.50 seconds to deallocate network for instance.
Aug 17 18:40:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-2ab69e5f-1662-4ca4-af00-830eba1be301 req-dd9de12a-6021-4487-8f4c-ea876243da1d service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2ab69e5f-1662-4ca4-af00-830eba1be301 req-dd9de12a-6021-4487-8f4c-ea876243da1d service nova] Acquiring lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2ab69e5f-1662-4ca4-af00-830eba1be301 req-dd9de12a-6021-4487-8f4c-ea876243da1d service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2ab69e5f-1662-4ca4-af00-830eba1be301 req-dd9de12a-6021-4487-8f4c-ea876243da1d service nova] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-2ab69e5f-1662-4ca4-af00-830eba1be301 req-dd9de12a-6021-4487-8f4c-ea876243da1d service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] No waiting events found dispatching network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:52 user nova-compute[72874]: WARNING nova.compute.manager [req-2ab69e5f-1662-4ca4-af00-830eba1be301 req-dd9de12a-6021-4487-8f4c-ea876243da1d service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received unexpected event network-vif-plugged-2d5c5445-861c-412b-8929-030ec72e68fb for instance with vm_state active and task_state deleting.
Aug 17 18:40:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-2ab69e5f-1662-4ca4-af00-830eba1be301 req-dd9de12a-6021-4487-8f4c-ea876243da1d service nova] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Received event network-vif-deleted-2d5c5445-861c-412b-8929-030ec72e68fb {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:53 user nova-compute[72874]: INFO nova.compute.manager [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Took 0.79 seconds to detach 1 volumes for instance.
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-64e19d19-5aa6-4ee8-96e1-41c17985e9b4 req-edf331da-5f26-4f9f-a14a-4880fe252e33 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received event network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-64e19d19-5aa6-4ee8-96e1-41c17985e9b4 req-edf331da-5f26-4f9f-a14a-4880fe252e33 service nova] Acquiring lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-64e19d19-5aa6-4ee8-96e1-41c17985e9b4 req-edf331da-5f26-4f9f-a14a-4880fe252e33 service nova] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-64e19d19-5aa6-4ee8-96e1-41c17985e9b4 req-edf331da-5f26-4f9f-a14a-4880fe252e33 service nova] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-64e19d19-5aa6-4ee8-96e1-41c17985e9b4 req-edf331da-5f26-4f9f-a14a-4880fe252e33 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] No waiting events found dispatching network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:40:53 user nova-compute[72874]: WARNING nova.compute.manager [req-64e19d19-5aa6-4ee8-96e1-41c17985e9b4 req-edf331da-5f26-4f9f-a14a-4880fe252e33 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received unexpected event network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe for instance with vm_state building and task_state spawning.
Aug 17 18:40:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297653.1206813, 794b74db-61ea-478d-9d4d-6380fda3a20c => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:40:53 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] VM Resumed (Lifecycle Event)
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:40:53 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Instance spawned successfully.
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:40:53 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297653.1220386, 794b74db-61ea-478d-9d4d-6380fda3a20c => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:40:53 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] VM Started (Lifecycle Event)
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:40:53 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:40:53 user nova-compute[72874]: INFO nova.compute.manager [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Took 5.27 seconds to spawn the instance on the hypervisor.
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:40:53 user nova-compute[72874]: INFO nova.compute.manager [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Took 16.52 seconds to build instance.
Aug 17 18:40:53 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cf0422b1-afcb-4ad6-8c59-f487bcbc6d7a tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.617s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:53 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Deleted allocations for instance 2961b0b8-98d0-4ba5-a0fa-b719753589ea
Aug 17 18:40:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-283bf0a6-cfe2-44af-8c3e-3e4cfbe817f6 tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "2961b0b8-98d0-4ba5-a0fa-b719753589ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.030s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:40:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:40:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:41:06 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297651.3842537, 2961b0b8-98d0-4ba5-a0fa-b719753589ea => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:41:06 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] VM Stopped (Lifecycle Event)
Aug 17 18:41:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-d477c0d9-c2d9-423b-aef8-1ad71d5254de None None] [instance: 2961b0b8-98d0-4ba5-a0fa-b719753589ea] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:41:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:41:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:41:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:41:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:41:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:41:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:18 user nova-compute[72874]: INFO nova.compute.manager [None req-d1d39549-4e29-4b21-b4be-6f9fc5175c05 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Unrescuing
Aug 17 18:41:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d1d39549-4e29-4b21-b4be-6f9fc5175c05 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:41:18 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d1d39549-4e29-4b21-b4be-6f9fc5175c05 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquired lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:41:18 user nova-compute[72874]: DEBUG nova.network.neutron [None req-d1d39549-4e29-4b21-b4be-6f9fc5175c05 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:41:19 user nova-compute[72874]: DEBUG nova.network.neutron [None req-d1d39549-4e29-4b21-b4be-6f9fc5175c05 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Updating instance_info_cache with network_info: [{"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:41:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d1d39549-4e29-4b21-b4be-6f9fc5175c05 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Releasing lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:41:19 user nova-compute[72874]: DEBUG nova.objects.instance [None req-d1d39549-4e29-4b21-b4be-6f9fc5175c05 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'flavor' on Instance uuid c4d2b606-6c62-4fad-91b6-a9e333c7cf30 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:41:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:20 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Instance destroyed successfully.
Aug 17 18:41:20 user nova-compute[72874]: DEBUG nova.compute.manager [req-9257c6c9-b8b7-434c-afe4-6f67d8ae7fed req-82634fe4-9dc8-4cee-9a4c-e688036636aa service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-vif-unplugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:41:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9257c6c9-b8b7-434c-afe4-6f67d8ae7fed req-82634fe4-9dc8-4cee-9a4c-e688036636aa service nova] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:41:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9257c6c9-b8b7-434c-afe4-6f67d8ae7fed req-82634fe4-9dc8-4cee-9a4c-e688036636aa service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:41:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9257c6c9-b8b7-434c-afe4-6f67d8ae7fed req-82634fe4-9dc8-4cee-9a4c-e688036636aa service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:41:20 user nova-compute[72874]: DEBUG nova.compute.manager [req-9257c6c9-b8b7-434c-afe4-6f67d8ae7fed req-82634fe4-9dc8-4cee-9a4c-e688036636aa service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] No waiting events found dispatching network-vif-unplugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:41:20 user nova-compute[72874]: WARNING nova.compute.manager [req-9257c6c9-b8b7-434c-afe4-6f67d8ae7fed req-82634fe4-9dc8-4cee-9a4c-e688036636aa service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received unexpected event network-vif-unplugged-50497298-f834-4b53-ae7a-8fa2482fa36c for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:41:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:22 user nova-compute[72874]: DEBUG nova.compute.manager [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:41:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:41:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:41:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:41:22 user nova-compute[72874]: DEBUG nova.compute.manager [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] No waiting events found dispatching network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:41:22 user nova-compute[72874]: WARNING nova.compute.manager [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received unexpected event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:41:22 user nova-compute[72874]: DEBUG nova.compute.manager [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:41:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:41:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:41:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:41:22 user nova-compute[72874]: DEBUG nova.compute.manager [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] No waiting events found dispatching network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:41:22 user nova-compute[72874]: WARNING nova.compute.manager [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received unexpected event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:41:22 user nova-compute[72874]: DEBUG nova.compute.manager [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:41:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:41:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:41:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:41:22 user nova-compute[72874]: DEBUG nova.compute.manager [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] No waiting events found dispatching network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:41:22 user nova-compute[72874]: WARNING nova.compute.manager [req-57af23f9-b450-4720-8976-6fc1c903fcbc req-30bcc5d6-7caa-4a00-9e98-0286f3ea6b7f service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received unexpected event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c for instance with vm_state rescued and task_state unrescuing.
Aug 17 18:41:23 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Removed pending event for c4d2b606-6c62-4fad-91b6-a9e333c7cf30 due to event {{(pid=72874) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 18:41:23 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297683.7701433, c4d2b606-6c62-4fad-91b6-a9e333c7cf30 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:41:23 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] VM Resumed (Lifecycle Event)
Aug 17 18:41:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-d1d39549-4e29-4b21-b4be-6f9fc5175c05 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:41:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:41:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:41:23 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 18:41:23 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297683.773493, c4d2b606-6c62-4fad-91b6-a9e333c7cf30 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:41:23 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] VM Started (Lifecycle Event)
Aug 17 18:41:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:41:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:41:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:27 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:41:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:41:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:41:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:41:27 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:41:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:41:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:41:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:41:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:41:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:41:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:41:27 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:41:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:41:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:41:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:41:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:41:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:41:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:41:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:41:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:41:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:41:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:41:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:41:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:41:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:41:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:41:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:41:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:41:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:41:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:41:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:41:30 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:41:30 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:41:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8154MB free_disk=25.093772888183594GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:41:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:41:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:41:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:41:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:41:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:41:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 1cbc48a0-476c-46bf-a30b-9875c08d818a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:41:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance c4d2b606-6c62-4fad-91b6-a9e333c7cf30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:41:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 794b74db-61ea-478d-9d4d-6380fda3a20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:41:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:41:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:41:30 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:41:30 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:41:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:41:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:41:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:41:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:41:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:41:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:41:33 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:41:34 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:41:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:41:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:41:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:41:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:41:34 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:41:34 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid 9b638f7b-ba47-403f-be22-a65a39ed8438 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:41:34 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Updating instance_info_cache with network_info: [{"id": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "address": "fa:16:3e:25:a4:9a", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e25bfc2-df", "ovs_interfaceid": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:41:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-9b638f7b-ba47-403f-be22-a65a39ed8438" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:41:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:41:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:41:36 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:41:37 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:41:40 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:41:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:41:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "9b638f7b-ba47-403f-be22-a65a39ed8438" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "9b638f7b-ba47-403f-be22-a65a39ed8438-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:41:41 user nova-compute[72874]: INFO nova.compute.manager [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Terminating instance
Aug 17 18:41:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG nova.compute.manager [req-d772f36b-cf48-4193-923b-2c26cd7c407e req-c9f62a51-1883-4345-8710-f5ad6a345766 service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Received event network-vif-unplugged-2e25bfc2-dfe4-4e04-88cb-9347ef481944 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d772f36b-cf48-4193-923b-2c26cd7c407e req-c9f62a51-1883-4345-8710-f5ad6a345766 service nova] Acquiring lock "9b638f7b-ba47-403f-be22-a65a39ed8438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d772f36b-cf48-4193-923b-2c26cd7c407e req-c9f62a51-1883-4345-8710-f5ad6a345766 service nova] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d772f36b-cf48-4193-923b-2c26cd7c407e req-c9f62a51-1883-4345-8710-f5ad6a345766 service nova] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG nova.compute.manager [req-d772f36b-cf48-4193-923b-2c26cd7c407e req-c9f62a51-1883-4345-8710-f5ad6a345766 service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] No waiting events found dispatching network-vif-unplugged-2e25bfc2-dfe4-4e04-88cb-9347ef481944 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG nova.compute.manager [req-d772f36b-cf48-4193-923b-2c26cd7c407e req-c9f62a51-1883-4345-8710-f5ad6a345766 service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Received event network-vif-unplugged-2e25bfc2-dfe4-4e04-88cb-9347ef481944 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:41:41 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Instance destroyed successfully.
Aug 17 18:41:41 user nova-compute[72874]: DEBUG nova.objects.instance [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lazy-loading 'resources' on Instance uuid 9b638f7b-ba47-403f-be22-a65a39ed8438 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:22:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-442790918',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-442790918',id=16,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:22:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a550f3591d1347bf8b9fb4d3e90b8aad',ramdisk_id='',reservation_id='r-jr0zooor',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-68498997',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:24:02Z,user_data=None,user_id='d13289795c8b4991a9cf6bb2880ad6ef',uuid=9b638f7b-ba47-403f-be22-a65a39ed8438,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "address": "fa:16:3e:25:a4:9a", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e25bfc2-df", "ovs_interfaceid": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converting VIF {"id": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "address": "fa:16:3e:25:a4:9a", "network": {"id": "db1b1593-2bf1-4635-a875-b49925492a33", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-930840335-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a550f3591d1347bf8b9fb4d3e90b8aad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e25bfc2-df", "ovs_interfaceid": "2e25bfc2-dfe4-4e04-88cb-9347ef481944", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:a4:9a,bridge_name='br-int',has_traffic_filtering=True,id=2e25bfc2-dfe4-4e04-88cb-9347ef481944,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e25bfc2-df') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG os_vif [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:a4:9a,bridge_name='br-int',has_traffic_filtering=True,id=2e25bfc2-dfe4-4e04-88cb-9347ef481944,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e25bfc2-df') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e25bfc2-df, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:41:42 user nova-compute[72874]: INFO os_vif [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:a4:9a,bridge_name='br-int',has_traffic_filtering=True,id=2e25bfc2-dfe4-4e04-88cb-9347ef481944,network=Network(db1b1593-2bf1-4635-a875-b49925492a33),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e25bfc2-df')
Aug 17 18:41:42 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Deleting instance files /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438_del
Aug 17 18:41:42 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Deletion of /opt/stack/data/nova/instances/9b638f7b-ba47-403f-be22-a65a39ed8438_del complete
Aug 17 18:41:42 user nova-compute[72874]: INFO nova.compute.manager [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 18:41:42 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:41:42 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:41:42 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:41:42 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:41:42 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Took 0.50 seconds to deallocate network for instance.
Aug 17 18:41:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-0592b5e5-549e-4b3f-a39b-8622ddb3fb5c req-f2d92217-41ee-400d-a50b-83eff741820a service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Received event network-vif-deleted-2e25bfc2-dfe4-4e04-88cb-9347ef481944 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:41:42 user nova-compute[72874]: INFO nova.compute.manager [req-0592b5e5-549e-4b3f-a39b-8622ddb3fb5c req-f2d92217-41ee-400d-a50b-83eff741820a service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Neutron deleted interface 2e25bfc2-dfe4-4e04-88cb-9347ef481944; detaching it from the instance and deleting it from the info cache
Aug 17 18:41:42 user nova-compute[72874]: DEBUG nova.network.neutron [req-0592b5e5-549e-4b3f-a39b-8622ddb3fb5c req-f2d92217-41ee-400d-a50b-83eff741820a service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:41:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-0592b5e5-549e-4b3f-a39b-8622ddb3fb5c req-f2d92217-41ee-400d-a50b-83eff741820a service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Detach interface failed, port_id=2e25bfc2-dfe4-4e04-88cb-9347ef481944, reason: Instance 9b638f7b-ba47-403f-be22-a65a39ed8438 could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:41:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:41:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:41:42 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:41:42 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:41:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:41:42 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Deleted allocations for instance 9b638f7b-ba47-403f-be22-a65a39ed8438
Aug 17 18:41:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-476724c6-3d46-4286-8106-a42b4663e1fc tempest-ServerBootFromVolumeStableRescueTest-68498997 tempest-ServerBootFromVolumeStableRescueTest-68498997-project-member] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.784s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:41:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-a7ba7067-a480-4eb0-9bd4-bf2addb5176f req-30034b7b-9ce9-47a0-8283-83a71a2f1ddb service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Received event network-vif-plugged-2e25bfc2-dfe4-4e04-88cb-9347ef481944 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:41:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a7ba7067-a480-4eb0-9bd4-bf2addb5176f req-30034b7b-9ce9-47a0-8283-83a71a2f1ddb service nova] Acquiring lock "9b638f7b-ba47-403f-be22-a65a39ed8438-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:41:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a7ba7067-a480-4eb0-9bd4-bf2addb5176f req-30034b7b-9ce9-47a0-8283-83a71a2f1ddb service nova] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:41:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a7ba7067-a480-4eb0-9bd4-bf2addb5176f req-30034b7b-9ce9-47a0-8283-83a71a2f1ddb service nova] Lock "9b638f7b-ba47-403f-be22-a65a39ed8438-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:41:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-a7ba7067-a480-4eb0-9bd4-bf2addb5176f req-30034b7b-9ce9-47a0-8283-83a71a2f1ddb service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] No waiting events found dispatching network-vif-plugged-2e25bfc2-dfe4-4e04-88cb-9347ef481944 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:41:43 user nova-compute[72874]: WARNING nova.compute.manager [req-a7ba7067-a480-4eb0-9bd4-bf2addb5176f req-30034b7b-9ce9-47a0-8283-83a71a2f1ddb service nova] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Received unexpected event network-vif-plugged-2e25bfc2-dfe4-4e04-88cb-9347ef481944 for instance with vm_state deleted and task_state None.
Aug 17 18:41:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:56 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297701.9612334, 9b638f7b-ba47-403f-be22-a65a39ed8438 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:41:56 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] VM Stopped (Lifecycle Event)
Aug 17 18:41:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-83a29683-9840-4250-94dd-0b9bbf545599 None None] [instance: 9b638f7b-ba47-403f-be22-a65a39ed8438] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:41:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:41:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:41:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:41:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:41:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:41:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:42:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:42:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:42:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:42:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:42:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG nova.compute.manager [req-5728a52a-2997-4f84-9077-9852deb747f5 req-82eaa326-f98e-49d0-bdc4-61af88522e19 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received event network-changed-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG nova.compute.manager [req-5728a52a-2997-4f84-9077-9852deb747f5 req-82eaa326-f98e-49d0-bdc4-61af88522e19 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Refreshing instance network info cache due to event network-changed-8ea2189e-d741-45d3-90a7-e96a7001a3fe. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5728a52a-2997-4f84-9077-9852deb747f5 req-82eaa326-f98e-49d0-bdc4-61af88522e19 service nova] Acquiring lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5728a52a-2997-4f84-9077-9852deb747f5 req-82eaa326-f98e-49d0-bdc4-61af88522e19 service nova] Acquired lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG nova.network.neutron [req-5728a52a-2997-4f84-9077-9852deb747f5 req-82eaa326-f98e-49d0-bdc4-61af88522e19 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Refreshing network info cache for port 8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "794b74db-61ea-478d-9d4d-6380fda3a20c" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:42:29 user nova-compute[72874]: INFO nova.compute.manager [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Shelve offloading
Aug 17 18:42:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-2f113efb-ec4e-451f-a59e-155fc5017758 req-ec92c953-b58b-4173-a38d-e741283f9e74 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received event network-vif-unplugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2f113efb-ec4e-451f-a59e-155fc5017758 req-ec92c953-b58b-4173-a38d-e741283f9e74 service nova] Acquiring lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2f113efb-ec4e-451f-a59e-155fc5017758 req-ec92c953-b58b-4173-a38d-e741283f9e74 service nova] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2f113efb-ec4e-451f-a59e-155fc5017758 req-ec92c953-b58b-4173-a38d-e741283f9e74 service nova] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-2f113efb-ec4e-451f-a59e-155fc5017758 req-ec92c953-b58b-4173-a38d-e741283f9e74 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] No waiting events found dispatching network-vif-unplugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:42:29 user nova-compute[72874]: WARNING nova.compute.manager [req-2f113efb-ec4e-451f-a59e-155fc5017758 req-ec92c953-b58b-4173-a38d-e741283f9e74 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received unexpected event network-vif-unplugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe for instance with vm_state active and task_state shelving.
Aug 17 18:42:29 user nova-compute[72874]: DEBUG nova.network.neutron [req-5728a52a-2997-4f84-9077-9852deb747f5 req-82eaa326-f98e-49d0-bdc4-61af88522e19 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updated VIF entry in instance network info cache for port 8ea2189e-d741-45d3-90a7-e96a7001a3fe. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG nova.network.neutron [req-5728a52a-2997-4f84-9077-9852deb747f5 req-82eaa326-f98e-49d0-bdc4-61af88522e19 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updating instance_info_cache with network_info: [{"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5728a52a-2997-4f84-9077-9852deb747f5 req-82eaa326-f98e-49d0-bdc4-61af88522e19 service nova] Releasing lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:29 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:42:30 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:42:30 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Instance destroyed successfully.
Aug 17 18:42:30 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:42:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:42:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquired lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:42:30 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:42:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:31 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:42:31 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:42:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8232MB free_disk=25.216930389404297GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 1cbc48a0-476c-46bf-a30b-9875c08d818a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance c4d2b606-6c62-4fad-91b6-a9e333c7cf30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 794b74db-61ea-478d-9d4d-6380fda3a20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG nova.network.neutron [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updating instance_info_cache with network_info: [{"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Releasing lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG nova.compute.manager [req-4db59fe7-b6ac-4177-aaaf-509e1a739225 req-da7ec62b-a5d6-4e13-b565-a71d4aa242ab service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received event network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4db59fe7-b6ac-4177-aaaf-509e1a739225 req-da7ec62b-a5d6-4e13-b565-a71d4aa242ab service nova] Acquiring lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4db59fe7-b6ac-4177-aaaf-509e1a739225 req-da7ec62b-a5d6-4e13-b565-a71d4aa242ab service nova] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4db59fe7-b6ac-4177-aaaf-509e1a739225 req-da7ec62b-a5d6-4e13-b565-a71d4aa242ab service nova] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:42:31 user nova-compute[72874]: DEBUG nova.compute.manager [req-4db59fe7-b6ac-4177-aaaf-509e1a739225 req-da7ec62b-a5d6-4e13-b565-a71d4aa242ab service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] No waiting events found dispatching network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:42:31 user nova-compute[72874]: WARNING nova.compute.manager [req-4db59fe7-b6ac-4177-aaaf-509e1a739225 req-da7ec62b-a5d6-4e13-b565-a71d4aa242ab service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received unexpected event network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe for instance with vm_state active and task_state shelving.
Aug 17 18:42:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:32 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Instance destroyed successfully.
Aug 17 18:42:32 user nova-compute[72874]: DEBUG nova.objects.instance [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lazy-loading 'resources' on Instance uuid 794b74db-61ea-478d-9d4d-6380fda3a20c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1706665819',display_name='tempest-TestShelveInstance-server-1706665819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1706665819',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqy6nYYaqyNvje0gkLPcdEvXj/bISglLAvp7zAI8ZcdQeUFMPS3/Qsw2b6NirZ7f0MDmJNWYLhK28eOGKzhjiheFnFHZb7HcGrNbGLTtcCzWaJ+AHusJELx1RsmVZ7f5A==',key_name='tempest-TestShelveInstance-101218560',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='442712d4c97643208940c3be5ecedd02',ramdisk_id='',reservation_id='r-9y1yy1ch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1461547480',owner_user_name='tempest-TestShelveInstance-1461547480-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:40:53Z,user_data=None,user_id='737b7b45d61a4a4da68539e463bd1483',uuid=794b74db-61ea-478d-9d4d-6380fda3a20c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Converting VIF {"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:59:33,bridge_name='br-int',has_traffic_filtering=True,id=8ea2189e-d741-45d3-90a7-e96a7001a3fe,network=Network(c8d77991-30ad-400e-8a4e-ae2a3f341354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2189e-d7') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_vif [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:59:33,bridge_name='br-int',has_traffic_filtering=True,id=8ea2189e-d741-45d3-90a7-e96a7001a3fe,network=Network(c8d77991-30ad-400e-8a4e-ae2a3f341354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2189e-d7') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ea2189e-d7, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:42:32 user nova-compute[72874]: INFO os_vif [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:59:33,bridge_name='br-int',has_traffic_filtering=True,id=8ea2189e-d741-45d3-90a7-e96a7001a3fe,network=Network(c8d77991-30ad-400e-8a4e-ae2a3f341354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2189e-d7')
Aug 17 18:42:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrEnsfIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:42:32 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff0e46c-c2e6-4877-a726-688b4fc794a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG nova.compute.manager [req-16da791f-2fc6-4679-a15a-654f0d9e443a req-31c37dd4-58bf-47a6-aa56-3f12e038e2d8 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received event network-changed-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG nova.compute.manager [req-16da791f-2fc6-4679-a15a-654f0d9e443a req-31c37dd4-58bf-47a6-aa56-3f12e038e2d8 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Refreshing instance network info cache due to event network-changed-8ea2189e-d741-45d3-90a7-e96a7001a3fe. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-16da791f-2fc6-4679-a15a-654f0d9e443a req-31c37dd4-58bf-47a6-aa56-3f12e038e2d8 service nova] Acquiring lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-16da791f-2fc6-4679-a15a-654f0d9e443a req-31c37dd4-58bf-47a6-aa56-3f12e038e2d8 service nova] Acquired lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG nova.network.neutron [req-16da791f-2fc6-4679-a15a-654f0d9e443a req-31c37dd4-58bf-47a6-aa56-3f12e038e2d8 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Refreshing network info cache for port 8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[821139ec-dec7-456b-a073-f0661e68f18b]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)
Aug 17 18:42:32 user nova-compute[72874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)
Aug 17 18:42:32 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)
Aug 17 18:42:32 user nova-compute[72874]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)
Aug 17 18:42:32 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6f3bb7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7'): ({'sdd'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Removing single pathed devices sdd {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cfda6f-9013-4f33-aaac-a072e53922df]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4283ea1b-d9ea-472f-8d50-a60e2adaefd7]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Flushing IO for device /dev/sdd {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f662c1-1d2e-496d-97e0-a39772e80000]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d195bad-f056-4a7d-b7f1-c57b5360dd1d]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[263483fc-f074-4bf0-a995-e10c6935699d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[160cc92a-853b-490d-99b6-c6f18461bcc1]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7, portal: 172.16.0.220,3260]
Aug 17 18:42:32 user nova-compute[72874]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7, portal: 172.16.0.220,3260] successful.
Aug 17 18:42:32 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6e4430-2fea-44cb-8c41-cc132dfe7da1]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] <== disconnect_volume: return (295ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:42:32 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Deleting instance files /opt/stack/data/nova/instances/794b74db-61ea-478d-9d4d-6380fda3a20c_del
Aug 17 18:42:32 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Deletion of /opt/stack/data/nova/instances/794b74db-61ea-478d-9d4d-6380fda3a20c_del complete
Aug 17 18:42:32 user nova-compute[72874]: DEBUG nova.network.neutron [req-16da791f-2fc6-4679-a15a-654f0d9e443a req-31c37dd4-58bf-47a6-aa56-3f12e038e2d8 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updated VIF entry in instance network info cache for port 8ea2189e-d741-45d3-90a7-e96a7001a3fe. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG nova.network.neutron [req-16da791f-2fc6-4679-a15a-654f0d9e443a req-31c37dd4-58bf-47a6-aa56-3f12e038e2d8 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updating instance_info_cache with network_info: [{"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": null, "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:42:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-16da791f-2fc6-4679-a15a-654f0d9e443a req-31c37dd4-58bf-47a6-aa56-3f12e038e2d8 service nova] Releasing lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:42:33 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Deleted allocations for instance 794b74db-61ea-478d-9d4d-6380fda3a20c
Aug 17 18:42:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:42:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:42:33 user nova-compute[72874]: DEBUG nova.objects.instance [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lazy-loading 'numa_topology' on Instance uuid 794b74db-61ea-478d-9d4d-6380fda3a20c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:42:33 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:42:33 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:42:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.196s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:42:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ecd60e41-54b6-4aa0-abe1-693acf496926 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.601s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:42:34 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:42:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:36 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:42:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:42:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:42:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:42:36 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:42:36 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Updating instance_info_cache with network_info: [{"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:42:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-b41da216-4183-404f-8896-58371c3ae61d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:42:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:42:37 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:42:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:38 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:42:40 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:42:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 18:42:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:42 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:42:42 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:42:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:42:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:45 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297750.280551, 794b74db-61ea-478d-9d4d-6380fda3a20c => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:42:45 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] VM Stopped (Lifecycle Event)
Aug 17 18:42:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-eb890479-b03f-480d-a9dc-4b7651daba5b None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:42:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:46 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:42:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 18:42:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] There are 0 instances to clean {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 18:42:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:42:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:42:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:42:52 user nova-compute[72874]: INFO nova.compute.claims [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Claim successful on node user
Aug 17 18:42:52 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.299s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG nova.network.neutron [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:42:52 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:42:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG nova.policy [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '538b882b4c794d9496b2bee673cfd239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15562548cd9d4848a2a0a4f99e04f11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:42:52 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Creating image(s)
Aug 17 18:42:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "/opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "/opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "/opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.177s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk 1073741824" returned: 0 in 0.054s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Successfully created port: 042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Cannot resize image /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG nova.objects.instance [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lazy-loading 'migration_context' on Instance uuid a3b3069b-a81b-4820-9fa2-c86e7361d8a6 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Ensure instance console log exists: /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Successfully updated port: 042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquired lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-30e22ac8-9caf-4d9d-8de7-1a9994102864 req-4669545e-8c4c-46b0-911c-162ebbeb7ef9 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Received event network-changed-042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-30e22ac8-9caf-4d9d-8de7-1a9994102864 req-4669545e-8c4c-46b0-911c-162ebbeb7ef9 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Refreshing instance network info cache due to event network-changed-042c5347-d89a-43b4-9ad0-599397295c03. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:42:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30e22ac8-9caf-4d9d-8de7-1a9994102864 req-4669545e-8c4c-46b0-911c-162ebbeb7ef9 service nova] Acquiring lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.network.neutron [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.network.neutron [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Updating instance_info_cache with network_info: [{"id": "042c5347-d89a-43b4-9ad0-599397295c03", "address": "fa:16:3e:7a:51:0d", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042c5347-d8", "ovs_interfaceid": "042c5347-d89a-43b4-9ad0-599397295c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Releasing lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.compute.manager [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Instance network_info: |[{"id": "042c5347-d89a-43b4-9ad0-599397295c03", "address": "fa:16:3e:7a:51:0d", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042c5347-d8", "ovs_interfaceid": "042c5347-d89a-43b4-9ad0-599397295c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30e22ac8-9caf-4d9d-8de7-1a9994102864 req-4669545e-8c4c-46b0-911c-162ebbeb7ef9 service nova] Acquired lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.network.neutron [req-30e22ac8-9caf-4d9d-8de7-1a9994102864 req-4669545e-8c4c-46b0-911c-162ebbeb7ef9 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Refreshing network info cache for port 042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Start _get_guest_xml network_info=[{"id": "042c5347-d89a-43b4-9ad0-599397295c03", "address": "fa:16:3e:7a:51:0d", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042c5347-d8", "ovs_interfaceid": "042c5347-d89a-43b4-9ad0-599397295c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:42:54 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:42:54 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-452600302',display_name='tempest-TestStampPattern-server-452600302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-452600302',id=41,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqhsRm9d1hAMSVz4vVR/PRgiZqjbXEj4l6p6aJ986tXYCYQVHYhbILnl0Ackxz/vvYoRWCnZ4khK5jTOhMQdsdT0QSQXnRiZkts9kxWBDFdSV7ZIWMf6h9Yk2mJ+vjM0w==',key_name='tempest-TestStampPattern-902745170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15562548cd9d4848a2a0a4f99e04f11e',ramdisk_id='',reservation_id='r-0bqi20mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-221411575',owner_user_name='tempest-TestStampPattern-221411575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:42:53Z,user_data=None,user_id='538b882b4c794d9496b2bee673cfd239',uuid=a3b3069b-a81b-4820-9fa2-c86e7361d8a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "042c5347-d89a-43b4-9ad0-599397295c03", "address": "fa:16:3e:7a:51:0d", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042c5347-d8", "ovs_interfaceid": "042c5347-d89a-43b4-9ad0-599397295c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Converting VIF {"id": "042c5347-d89a-43b4-9ad0-599397295c03", "address": "fa:16:3e:7a:51:0d", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042c5347-d8", "ovs_interfaceid": "042c5347-d89a-43b4-9ad0-599397295c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:51:0d,bridge_name='br-int',has_traffic_filtering=True,id=042c5347-d89a-43b4-9ad0-599397295c03,network=Network(7ccf040b-9956-46c7-bf3f-52c6d0356865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap042c5347-d8') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.objects.instance [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lazy-loading 'pci_devices' on Instance uuid a3b3069b-a81b-4820-9fa2-c86e7361d8a6 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:42:54 user nova-compute[72874]:   <uuid>a3b3069b-a81b-4820-9fa2-c86e7361d8a6</uuid>
Aug 17 18:42:54 user nova-compute[72874]:   <name>instance-00000029</name>
Aug 17 18:42:54 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:42:54 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:42:54 user nova-compute[72874]:   <metadata>
Aug 17 18:42:54 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:42:54 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:42:54 user nova-compute[72874]:       <nova:name>tempest-TestStampPattern-server-452600302</nova:name>
Aug 17 18:42:54 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:42:54</nova:creationTime>
Aug 17 18:42:54 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:42:54 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:42:54 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:42:54 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:42:54 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:42:54 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:42:54 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:42:54 user nova-compute[72874]:       <nova:owner>
Aug 17 18:42:54 user nova-compute[72874]:         <nova:user uuid="538b882b4c794d9496b2bee673cfd239">tempest-TestStampPattern-221411575-project-member</nova:user>
Aug 17 18:42:54 user nova-compute[72874]:         <nova:project uuid="15562548cd9d4848a2a0a4f99e04f11e">tempest-TestStampPattern-221411575</nova:project>
Aug 17 18:42:54 user nova-compute[72874]:       </nova:owner>
Aug 17 18:42:54 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:42:54 user nova-compute[72874]:       <nova:ports>
Aug 17 18:42:54 user nova-compute[72874]:         <nova:port uuid="042c5347-d89a-43b4-9ad0-599397295c03">
Aug 17 18:42:54 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 18:42:54 user nova-compute[72874]:         </nova:port>
Aug 17 18:42:54 user nova-compute[72874]:       </nova:ports>
Aug 17 18:42:54 user nova-compute[72874]:     </nova:instance>
Aug 17 18:42:54 user nova-compute[72874]:   </metadata>
Aug 17 18:42:54 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:42:54 user nova-compute[72874]:     <system>
Aug 17 18:42:54 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:42:54 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:42:54 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:42:54 user nova-compute[72874]:       <entry name="serial">a3b3069b-a81b-4820-9fa2-c86e7361d8a6</entry>
Aug 17 18:42:54 user nova-compute[72874]:       <entry name="uuid">a3b3069b-a81b-4820-9fa2-c86e7361d8a6</entry>
Aug 17 18:42:54 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:42:54 user nova-compute[72874]:     </system>
Aug 17 18:42:54 user nova-compute[72874]:   </sysinfo>
Aug 17 18:42:54 user nova-compute[72874]:   <os>
Aug 17 18:42:54 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:42:54 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:42:54 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:42:54 user nova-compute[72874]:   </os>
Aug 17 18:42:54 user nova-compute[72874]:   <features>
Aug 17 18:42:54 user nova-compute[72874]:     <acpi/>
Aug 17 18:42:54 user nova-compute[72874]:     <apic/>
Aug 17 18:42:54 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:42:54 user nova-compute[72874]:   </features>
Aug 17 18:42:54 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:42:54 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:42:54 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:42:54 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:42:54 user nova-compute[72874]:   </clock>
Aug 17 18:42:54 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:42:54 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:42:54 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:42:54 user nova-compute[72874]:   </cpu>
Aug 17 18:42:54 user nova-compute[72874]:   <devices>
Aug 17 18:42:54 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:42:54 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:42:54 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk"/>
Aug 17 18:42:54 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:42:54 user nova-compute[72874]:     </disk>
Aug 17 18:42:54 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:42:54 user nova-compute[72874]:       <mac address="fa:16:3e:7a:51:0d"/>
Aug 17 18:42:54 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:42:54 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:42:54 user nova-compute[72874]:       <target dev="tap042c5347-d8"/>
Aug 17 18:42:54 user nova-compute[72874]:     </interface>
Aug 17 18:42:54 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:42:54 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/console.log" append="off"/>
Aug 17 18:42:54 user nova-compute[72874]:     </serial>
Aug 17 18:42:54 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:42:54 user nova-compute[72874]:     <video>
Aug 17 18:42:54 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:42:54 user nova-compute[72874]:     </video>
Aug 17 18:42:54 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:42:54 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:42:54 user nova-compute[72874]:     </rng>
Aug 17 18:42:54 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:42:54 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:42:54 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:42:54 user nova-compute[72874]:     </memballoon>
Aug 17 18:42:54 user nova-compute[72874]:   </devices>
Aug 17 18:42:54 user nova-compute[72874]: </domain>
Aug 17 18:42:54 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-452600302',display_name='tempest-TestStampPattern-server-452600302',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-452600302',id=41,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqhsRm9d1hAMSVz4vVR/PRgiZqjbXEj4l6p6aJ986tXYCYQVHYhbILnl0Ackxz/vvYoRWCnZ4khK5jTOhMQdsdT0QSQXnRiZkts9kxWBDFdSV7ZIWMf6h9Yk2mJ+vjM0w==',key_name='tempest-TestStampPattern-902745170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15562548cd9d4848a2a0a4f99e04f11e',ramdisk_id='',reservation_id='r-0bqi20mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-221411575',owner_user_name='tempest-TestStampPattern-221411575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:42:53Z,user_data=None,user_id='538b882b4c794d9496b2bee673cfd239',uuid=a3b3069b-a81b-4820-9fa2-c86e7361d8a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "042c5347-d89a-43b4-9ad0-599397295c03", "address": "fa:16:3e:7a:51:0d", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042c5347-d8", "ovs_interfaceid": "042c5347-d89a-43b4-9ad0-599397295c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Converting VIF {"id": "042c5347-d89a-43b4-9ad0-599397295c03", "address": "fa:16:3e:7a:51:0d", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042c5347-d8", "ovs_interfaceid": "042c5347-d89a-43b4-9ad0-599397295c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:51:0d,bridge_name='br-int',has_traffic_filtering=True,id=042c5347-d89a-43b4-9ad0-599397295c03,network=Network(7ccf040b-9956-46c7-bf3f-52c6d0356865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap042c5347-d8') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG os_vif [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:51:0d,bridge_name='br-int',has_traffic_filtering=True,id=042c5347-d89a-43b4-9ad0-599397295c03,network=Network(7ccf040b-9956-46c7-bf3f-52c6d0356865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap042c5347-d8') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap042c5347-d8, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap042c5347-d8, col_values=(('external_ids', {'iface-id': '042c5347-d89a-43b4-9ad0-599397295c03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:51:0d', 'vm-uuid': 'a3b3069b-a81b-4820-9fa2-c86e7361d8a6'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:54 user nova-compute[72874]: INFO os_vif [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:51:0d,bridge_name='br-int',has_traffic_filtering=True,id=042c5347-d89a-43b4-9ad0-599397295c03,network=Network(7ccf040b-9956-46c7-bf3f-52c6d0356865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap042c5347-d8')
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] No VIF found with MAC fa:16:3e:7a:51:0d, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.network.neutron [req-30e22ac8-9caf-4d9d-8de7-1a9994102864 req-4669545e-8c4c-46b0-911c-162ebbeb7ef9 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Updated VIF entry in instance network info cache for port 042c5347-d89a-43b4-9ad0-599397295c03. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG nova.network.neutron [req-30e22ac8-9caf-4d9d-8de7-1a9994102864 req-4669545e-8c4c-46b0-911c-162ebbeb7ef9 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Updating instance_info_cache with network_info: [{"id": "042c5347-d89a-43b4-9ad0-599397295c03", "address": "fa:16:3e:7a:51:0d", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042c5347-d8", "ovs_interfaceid": "042c5347-d89a-43b4-9ad0-599397295c03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:42:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-30e22ac8-9caf-4d9d-8de7-1a9994102864 req-4669545e-8c4c-46b0-911c-162ebbeb7ef9 service nova] Releasing lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:42:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-2845e25e-d73e-4cd5-a8d0-7af5f5426229 req-98c28979-6b94-447b-8941-0895ad7303e1 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Received event network-vif-plugged-042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:42:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2845e25e-d73e-4cd5-a8d0-7af5f5426229 req-98c28979-6b94-447b-8941-0895ad7303e1 service nova] Acquiring lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:42:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2845e25e-d73e-4cd5-a8d0-7af5f5426229 req-98c28979-6b94-447b-8941-0895ad7303e1 service nova] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:42:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2845e25e-d73e-4cd5-a8d0-7af5f5426229 req-98c28979-6b94-447b-8941-0895ad7303e1 service nova] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:42:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-2845e25e-d73e-4cd5-a8d0-7af5f5426229 req-98c28979-6b94-447b-8941-0895ad7303e1 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] No waiting events found dispatching network-vif-plugged-042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:42:55 user nova-compute[72874]: WARNING nova.compute.manager [req-2845e25e-d73e-4cd5-a8d0-7af5f5426229 req-98c28979-6b94-447b-8941-0895ad7303e1 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Received unexpected event network-vif-plugged-042c5347-d89a-43b4-9ad0-599397295c03 for instance with vm_state building and task_state spawning.
Aug 17 18:42:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297777.7833421, a3b3069b-a81b-4820-9fa2-c86e7361d8a6 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:42:57 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] VM Resumed (Lifecycle Event)
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:42:57 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Instance spawned successfully.
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:42:57 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297777.7894914, a3b3069b-a81b-4820-9fa2-c86e7361d8a6 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:42:57 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] VM Started (Lifecycle Event)
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:42:57 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:42:57 user nova-compute[72874]: INFO nova.compute.manager [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Took 5.30 seconds to spawn the instance on the hypervisor.
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-82f55534-885a-465a-ae54-bc1ef364f828 req-c63ebc14-f21b-494f-bbf7-87d3349d8d23 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Received event network-vif-plugged-042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:42:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-82f55534-885a-465a-ae54-bc1ef364f828 req-c63ebc14-f21b-494f-bbf7-87d3349d8d23 service nova] Acquiring lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:42:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-82f55534-885a-465a-ae54-bc1ef364f828 req-c63ebc14-f21b-494f-bbf7-87d3349d8d23 service nova] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:42:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-82f55534-885a-465a-ae54-bc1ef364f828 req-c63ebc14-f21b-494f-bbf7-87d3349d8d23 service nova] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:42:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-82f55534-885a-465a-ae54-bc1ef364f828 req-c63ebc14-f21b-494f-bbf7-87d3349d8d23 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] No waiting events found dispatching network-vif-plugged-042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:42:57 user nova-compute[72874]: WARNING nova.compute.manager [req-82f55534-885a-465a-ae54-bc1ef364f828 req-c63ebc14-f21b-494f-bbf7-87d3349d8d23 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Received unexpected event network-vif-plugged-042c5347-d89a-43b4-9ad0-599397295c03 for instance with vm_state building and task_state spawning.
Aug 17 18:42:57 user nova-compute[72874]: INFO nova.compute.manager [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Took 5.93 seconds to build instance.
Aug 17 18:42:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-75394558-e677-410e-901a-14952eaaeef0 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.020s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:42:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-c165ea81-c76b-435e-9949-38aa7c014bd4 req-bb693edf-99e2-4632-a549-a08bc023790c service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-changed-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:43:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-c165ea81-c76b-435e-9949-38aa7c014bd4 req-bb693edf-99e2-4632-a549-a08bc023790c service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Refreshing instance network info cache due to event network-changed-50497298-f834-4b53-ae7a-8fa2482fa36c. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:43:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c165ea81-c76b-435e-9949-38aa7c014bd4 req-bb693edf-99e2-4632-a549-a08bc023790c service nova] Acquiring lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:43:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c165ea81-c76b-435e-9949-38aa7c014bd4 req-bb693edf-99e2-4632-a549-a08bc023790c service nova] Acquired lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:43:10 user nova-compute[72874]: DEBUG nova.network.neutron [req-c165ea81-c76b-435e-9949-38aa7c014bd4 req-bb693edf-99e2-4632-a549-a08bc023790c service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Refreshing network info cache for port 50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:43:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:43:11 user nova-compute[72874]: INFO nova.compute.manager [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Detaching volume f4400196-5cf0-448c-ae0e-ff9c27bd116a
Aug 17 18:43:11 user nova-compute[72874]: DEBUG nova.network.neutron [req-c165ea81-c76b-435e-9949-38aa7c014bd4 req-bb693edf-99e2-4632-a549-a08bc023790c service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Updated VIF entry in instance network info cache for port 50497298-f834-4b53-ae7a-8fa2482fa36c. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG nova.network.neutron [req-c165ea81-c76b-435e-9949-38aa7c014bd4 req-bb693edf-99e2-4632-a549-a08bc023790c service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Updating instance_info_cache with network_info: [{"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c165ea81-c76b-435e-9949-38aa7c014bd4 req-bb693edf-99e2-4632-a549-a08bc023790c service nova] Releasing lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:43:11 user nova-compute[72874]: INFO nova.virt.block_device [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Attempting to driver detach volume f4400196-5cf0-448c-ae0e-ff9c27bd116a from mountpoint /dev/vdb
Aug 17 18:43:11 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Attempting to detach device vdb from instance c4d2b606-6c62-4fad-91b6-a9e333c7cf30 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:43:11 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:43:11 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:43:11 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:43:11 user nova-compute[72874]:   <serial>f4400196-5cf0-448c-ae0e-ff9c27bd116a</serial>
Aug 17 18:43:11 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:43:11 user nova-compute[72874]: </disk>
Aug 17 18:43:11 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:43:11 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Successfully detached device vdb from instance c4d2b606-6c62-4fad-91b6-a9e333c7cf30 from the persistent domain config.
Aug 17 18:43:11 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c4d2b606-6c62-4fad-91b6-a9e333c7cf30 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:43:11 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:43:11 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:43:11 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:43:11 user nova-compute[72874]:   <serial>f4400196-5cf0-448c-ae0e-ff9c27bd116a</serial>
Aug 17 18:43:11 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:43:11 user nova-compute[72874]: </disk>
Aug 17 18:43:11 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692297791.8145516, c4d2b606-6c62-4fad-91b6-a9e333c7cf30 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c4d2b606-6c62-4fad-91b6-a9e333c7cf30 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:43:11 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Successfully detached device vdb from instance c4d2b606-6c62-4fad-91b6-a9e333c7cf30 from the live domain config.
Aug 17 18:43:11 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'caTBGsXv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:43:11 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:43:11 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcd6e7e-1226-445e-9749-491a2551b8f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7fdcf7-008d-49a6-894e-9a0849be11f8]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)
Aug 17 18:43:11 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a (non-flash)
Aug 17 18:43:11 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6ef3b7640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a'): ({'sdc'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Removing single pathed devices sdc {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[682b6baa-4d20-4b64-a9ca-08cde27d9bb9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3cad11-e14b-4b1c-bcb8-6541f9e37e29]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Flushing IO for device /dev/sdc {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[142d134b-58f8-4837-b48f-30bec6431383]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2dd8b07-3f73-4321-ba1d-53444b9cbea7]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f2dcff-4d8a-4678-9abe-d3162362799f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:43:11 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db4e884-b309-49da-a270-1e7e5acdd0d1]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a, portal: 172.16.0.220,3260]
Aug 17 18:43:12 user nova-compute[72874]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a, portal: 172.16.0.220,3260] successful.
Aug 17 18:43:12 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4400196-5cf0-448c-ae0e-ff9c27bd116a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6968c4-52de-44c6-8987-f33bf1a5e857]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.236s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] <== disconnect_volume: return (237ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid b41da216-4183-404f-8896-58371c3ae61d {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid 1cbc48a0-476c-46bf-a30b-9875c08d818a {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid c4d2b606-6c62-4fad-91b6-a9e333c7cf30 {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid a3b3069b-a81b-4820-9fa2-c86e7361d8a6 {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "b41da216-4183-404f-8896-58371c3ae61d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "1cbc48a0-476c-46bf-a30b-9875c08d818a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "1cbc48a0-476c-46bf-a30b-9875c08d818a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "b41da216-4183-404f-8896-58371c3ae61d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "1cbc48a0-476c-46bf-a30b-9875c08d818a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG nova.objects.instance [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'flavor' on Instance uuid c4d2b606-6c62-4fad-91b6-a9e333c7cf30 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d435880b-e1e4-41e7-a6ba-5b58f130c89b tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.560s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.298s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-2ba56157-96e6-45f1-827e-eaffbad0ed44 req-bc8e93a2-5919-44f6-aff0-bc2912d71b52 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-changed-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-2ba56157-96e6-45f1-827e-eaffbad0ed44 req-bc8e93a2-5919-44f6-aff0-bc2912d71b52 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Refreshing instance network info cache due to event network-changed-50497298-f834-4b53-ae7a-8fa2482fa36c. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2ba56157-96e6-45f1-827e-eaffbad0ed44 req-bc8e93a2-5919-44f6-aff0-bc2912d71b52 service nova] Acquiring lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2ba56157-96e6-45f1-827e-eaffbad0ed44 req-bc8e93a2-5919-44f6-aff0-bc2912d71b52 service nova] Acquired lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:43:12 user nova-compute[72874]: DEBUG nova.network.neutron [req-2ba56157-96e6-45f1-827e-eaffbad0ed44 req-bc8e93a2-5919-44f6-aff0-bc2912d71b52 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Refreshing network info cache for port 50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:43:13 user nova-compute[72874]: DEBUG nova.network.neutron [req-2ba56157-96e6-45f1-827e-eaffbad0ed44 req-bc8e93a2-5919-44f6-aff0-bc2912d71b52 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Updated VIF entry in instance network info cache for port 50497298-f834-4b53-ae7a-8fa2482fa36c. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:43:13 user nova-compute[72874]: DEBUG nova.network.neutron [req-2ba56157-96e6-45f1-827e-eaffbad0ed44 req-bc8e93a2-5919-44f6-aff0-bc2912d71b52 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Updating instance_info_cache with network_info: [{"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:43:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2ba56157-96e6-45f1-827e-eaffbad0ed44 req-bc8e93a2-5919-44f6-aff0-bc2912d71b52 service nova] Releasing lock "refresh_cache-c4d2b606-6c62-4fad-91b6-a9e333c7cf30" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:43:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:28 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:43:28 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:43:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:43:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:43:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:43:28 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:43:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:43:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:43:31 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:43:31 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:43:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8235MB free_disk=25.185802459716797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 1cbc48a0-476c-46bf-a30b-9875c08d818a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance c4d2b606-6c62-4fad-91b6-a9e333c7cf30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance a3b3069b-a81b-4820-9fa2-c86e7361d8a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing inventories for resource provider b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Updating ProviderTree inventory for provider b677d836-b01b-4674-8972-53d526f1b5f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Updating inventory in ProviderTree for provider b677d836-b01b-4674-8972-53d526f1b5f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing aggregate associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, aggregates: None {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing trait associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, traits: HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:43:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:43:33 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:43:34 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:43:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:36 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:43:37 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:43:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:43:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:43:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:43:37 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:43:37 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Updating instance_info_cache with network_info: [{"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:43:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:43:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:43:38 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:43:39 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:43:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:44 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:43:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:43:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:43:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:43:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:44:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:44:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:44:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:44:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:44:01 user nova-compute[72874]: INFO nova.compute.manager [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Terminating instance
Aug 17 18:44:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:44:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-4b47ae34-732b-419d-ad91-39c068e692bc req-e08effa0-b166-408b-9b9f-49bdd19a094f service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-vif-unplugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:44:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4b47ae34-732b-419d-ad91-39c068e692bc req-e08effa0-b166-408b-9b9f-49bdd19a094f service nova] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:44:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4b47ae34-732b-419d-ad91-39c068e692bc req-e08effa0-b166-408b-9b9f-49bdd19a094f service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:44:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4b47ae34-732b-419d-ad91-39c068e692bc req-e08effa0-b166-408b-9b9f-49bdd19a094f service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:44:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-4b47ae34-732b-419d-ad91-39c068e692bc req-e08effa0-b166-408b-9b9f-49bdd19a094f service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] No waiting events found dispatching network-vif-unplugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:44:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-4b47ae34-732b-419d-ad91-39c068e692bc req-e08effa0-b166-408b-9b9f-49bdd19a094f service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-vif-unplugged-50497298-f834-4b53-ae7a-8fa2482fa36c for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:44:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:02 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Instance destroyed successfully.
Aug 17 18:44:02 user nova-compute[72874]: DEBUG nova.objects.instance [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'resources' on Instance uuid c4d2b606-6c62-4fad-91b6-a9e333c7cf30 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:44:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:37:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1055707657',display_name='tempest-ServerRescueNegativeTestJSON-server-1055707657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1055707657',id=38,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD3iTq9nQBkw6d5pdNe1FZAZTAW88Yk72scauvf0O1vFLhQ6P6ltfdRJDSZUaOOg8xwo+pIfXWyM0kcGTBt1oOUXk+kw323QJuB4UFVz1ZjtHmd8vO+HqSgQ+qqe2Eub2w==',key_name='tempest-keypair-931894594',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:39:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6287735c21fb4b43b3cbd9e0d742b0ec',ramdisk_id='',reservation_id='r-sbi7tlp2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-717723449',owner_user_name='tempest-ServerRescueNegativeTestJSON-717723449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:41:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3143ae598e814e359466d90e74f9b00c',uuid=c4d2b606-6c62-4fad-91b6-a9e333c7cf30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:44:02 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converting VIF {"id": "50497298-f834-4b53-ae7a-8fa2482fa36c", "address": "fa:16:3e:0f:a1:2c", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50497298-f8", "ovs_interfaceid": "50497298-f834-4b53-ae7a-8fa2482fa36c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:44:02 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a1:2c,bridge_name='br-int',has_traffic_filtering=True,id=50497298-f834-4b53-ae7a-8fa2482fa36c,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50497298-f8') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:44:02 user nova-compute[72874]: DEBUG os_vif [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a1:2c,bridge_name='br-int',has_traffic_filtering=True,id=50497298-f834-4b53-ae7a-8fa2482fa36c,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50497298-f8') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:44:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50497298-f8, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:44:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:44:02 user nova-compute[72874]: INFO os_vif [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:a1:2c,bridge_name='br-int',has_traffic_filtering=True,id=50497298-f834-4b53-ae7a-8fa2482fa36c,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50497298-f8')
Aug 17 18:44:02 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Deleting instance files /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30_del
Aug 17 18:44:02 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Deletion of /opt/stack/data/nova/instances/c4d2b606-6c62-4fad-91b6-a9e333c7cf30_del complete
Aug 17 18:44:02 user nova-compute[72874]: INFO nova.compute.manager [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 17 18:44:02 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:44:02 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:44:02 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:44:03 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:44:03 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Took 0.85 seconds to deallocate network for instance.
Aug 17 18:44:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-48d242be-bda0-4693-afbf-dcc25b9f2221 req-61ba5168-54b8-4589-8d9e-fe9793474251 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-vif-deleted-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:44:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:44:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:44:03 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:44:03 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:44:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:44:03 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Deleted allocations for instance c4d2b606-6c62-4fad-91b6-a9e333c7cf30
Aug 17 18:44:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-01be8ca9-a916-41f9-a561-0c762a7468d2 tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.057s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:44:04 user nova-compute[72874]: DEBUG nova.compute.manager [req-c184b3b9-53b2-44a2-a8b2-662e67ac93a6 req-6fb9c302-2874-44b5-9bea-7f8782441280 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:44:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c184b3b9-53b2-44a2-a8b2-662e67ac93a6 req-6fb9c302-2874-44b5-9bea-7f8782441280 service nova] Acquiring lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:44:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c184b3b9-53b2-44a2-a8b2-662e67ac93a6 req-6fb9c302-2874-44b5-9bea-7f8782441280 service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:44:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c184b3b9-53b2-44a2-a8b2-662e67ac93a6 req-6fb9c302-2874-44b5-9bea-7f8782441280 service nova] Lock "c4d2b606-6c62-4fad-91b6-a9e333c7cf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:44:04 user nova-compute[72874]: DEBUG nova.compute.manager [req-c184b3b9-53b2-44a2-a8b2-662e67ac93a6 req-6fb9c302-2874-44b5-9bea-7f8782441280 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] No waiting events found dispatching network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:44:04 user nova-compute[72874]: WARNING nova.compute.manager [req-c184b3b9-53b2-44a2-a8b2-662e67ac93a6 req-6fb9c302-2874-44b5-9bea-7f8782441280 service nova] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Received unexpected event network-vif-plugged-50497298-f834-4b53-ae7a-8fa2482fa36c for instance with vm_state deleted and task_state None.
Aug 17 18:44:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:44:17 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297842.3721466, c4d2b606-6c62-4fad-91b6-a9e333c7cf30 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:44:17 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] VM Stopped (Lifecycle Event)
Aug 17 18:44:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ae492ed7-d945-47ab-9ec6-7ae0e7d2f388 None None] [instance: c4d2b606-6c62-4fad-91b6-a9e333c7cf30] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:44:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:44:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:44:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:44:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:44:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "794b74db-61ea-478d-9d4d-6380fda3a20c" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:44:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:44:20 user nova-compute[72874]: INFO nova.compute.manager [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Unshelving
Aug 17 18:44:21 user nova-compute[72874]: INFO nova.virt.block_device [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Booting with volume 3053295a-2f62-4f60-a1ec-ceca666e53f7 at /dev/vda
Aug 17 18:44:21 user nova-compute[72874]: DEBUG os_brick.utils [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6505159-a8eb-40ac-ad00-2536517bb21f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a00d57c-1223-4bf2-a536-9276e6000719]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[139d4530-63ac-4e7e-a9a8-b8b7957b071b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c3b3e5-dcc6-468e-a06b-14260fb60392]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:44:21 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:44:21 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a554b232-4fb3-4aef-b644-3e2eb904e9bd]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG os_brick.utils [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:44:21 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updating existing volume attachment record: 0e8409fc-3612-4491-8852-37f7464b4bec {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:44:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:28 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:44:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:44:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:44:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:44:28 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:44:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:28 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:29 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:30 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:44:30 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:44:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8439MB free_disk=25.197280883789062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:44:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:44:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:44:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:44:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:44:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 1cbc48a0-476c-46bf-a30b-9875c08d818a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:44:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance a3b3069b-a81b-4820-9fa2-c86e7361d8a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:44:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 794b74db-61ea-478d-9d4d-6380fda3a20c has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 17 18:44:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:44:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:44:30 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:44:30 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:44:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:44:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:44:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:44:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:44:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:44:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:44:32 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lazy-loading 'pci_requests' on Instance uuid 794b74db-61ea-478d-9d4d-6380fda3a20c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:44:32 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lazy-loading 'numa_topology' on Instance uuid 794b74db-61ea-478d-9d4d-6380fda3a20c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:44:32 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:44:32 user nova-compute[72874]: INFO nova.compute.claims [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Claim successful on node user
Aug 17 18:44:32 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:44:32 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:44:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:44:32 user nova-compute[72874]: INFO nova.network.neutron [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updating port 8ea2189e-d741-45d3-90a7-e96a7001a3fe with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 18:44:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:44:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:44:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquired lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:44:33 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:44:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-a4d6124d-d38a-4b27-94b4-9bb124a09669 req-7cf4323b-29ea-4cf4-b157-01896ee68de6 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received event network-changed-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:44:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-a4d6124d-d38a-4b27-94b4-9bb124a09669 req-7cf4323b-29ea-4cf4-b157-01896ee68de6 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Refreshing instance network info cache due to event network-changed-8ea2189e-d741-45d3-90a7-e96a7001a3fe. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:44:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a4d6124d-d38a-4b27-94b4-9bb124a09669 req-7cf4323b-29ea-4cf4-b157-01896ee68de6 service nova] Acquiring lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.network.neutron [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updating instance_info_cache with network_info: [{"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Releasing lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:44:34 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Creating image(s)
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Ensure instance console log exists: /opt/stack/data/nova/instances/794b74db-61ea-478d-9d4d-6380fda3a20c/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Start _get_guest_xml network_info=[{"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrEnsfIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '794b74db-61ea-478d-9d4d-6380fda3a20c', 'attached_at': '', 'detached_at': '', 'volume_id': '3053295a-2f62-4f60-a1ec-ceca666e53f7', 'serial': '3053295a-2f62-4f60-a1ec-ceca666e53f7'}, 'delete_on_termination': True, 'attachment_id': '0e8409fc-3612-4491-8852-37f7464b4bec', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a4d6124d-d38a-4b27-94b4-9bb124a09669 req-7cf4323b-29ea-4cf4-b157-01896ee68de6 service nova] Acquired lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.network.neutron [req-a4d6124d-d38a-4b27-94b4-9bb124a09669 req-7cf4323b-29ea-4cf4-b157-01896ee68de6 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Refreshing network info cache for port 8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:44:34 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:44:34 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lazy-loading 'vcpu_model' on Instance uuid 794b74db-61ea-478d-9d4d-6380fda3a20c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrEnsfIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:44:34 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:44:34 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:44:34 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c0be4b-8d54-4564-94e3-14132a8b92eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:44:34 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b028a662-aa87-4e30-aac8-eb4231c2589e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7] added
Aug 17 18:44:34 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cab1e0d-1be5-4a0b-b989-c32f2263d950]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[231e0fea-0a22-49ae-bd6b-7e3d2ddb8088]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrEnsfIc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CrEnsfIc" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7257d022-9e12-4604-9c05-f5c135ad9169]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CrEnsfIc'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[325bbe56-13be-4acb-b011-b82541cd5ce9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2999c850-dd0e-43f6-8108-73aa5d2e2c06]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 18:44:34 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 18:44:34 user nova-compute[72874]:  {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:44:34 user nova-compute[72874]: WARNING os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 18:44:34 user nova-compute[72874]: 
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[185725be-6873-4d63-80e4-d4bc61cc9940]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7, portal: 172.16.0.220,3260]
Aug 17 18:44:34 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7, portal: 172.16.0.220,3260] successful.
Aug 17 18:44:34 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1264522f-dff4-41f0-bb1d-332d1e37e143]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25f63d2-15c2-43db-9407-4709f0ba61d9]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)
Aug 17 18:44:34 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)
Aug 17 18:44:34 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a933f46-feb9-4028-9a38-46e66d951803]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrEnsfIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.network.neutron [req-a4d6124d-d38a-4b27-94b4-9bb124a09669 req-7cf4323b-29ea-4cf4-b157-01896ee68de6 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updated VIF entry in instance network info cache for port 8ea2189e-d741-45d3-90a7-e96a7001a3fe. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG nova.network.neutron [req-a4d6124d-d38a-4b27-94b4-9bb124a09669 req-7cf4323b-29ea-4cf4-b157-01896ee68de6 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updating instance_info_cache with network_info: [{"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:44:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a4d6124d-d38a-4b27-94b4-9bb124a09669 req-7cf4323b-29ea-4cf4-b157-01896ee68de6 service nova] Releasing lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26433303562616662', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433303562616662', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T18:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1706665819',display_name='tempest-TestShelveInstance-server-1706665819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1706665819',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-101218560',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='442712d4c97643208940c3be5ecedd02',ramdisk_id='',reservation_id='r-9y1yy1ch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1461547480',owner_user_name='tempest-TestShelveInstance-1461547480-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:44:21Z,user_data=None,user_id='737b7b45d61a4a4da68539e463bd1483',uuid=794b74db-61ea-478d-9d4d-6380fda3a20c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Converting VIF {"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:59:33,bridge_name='br-int',has_traffic_filtering=True,id=8ea2189e-d741-45d3-90a7-e96a7001a3fe,network=Network(c8d77991-30ad-400e-8a4e-ae2a3f341354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2189e-d7') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lazy-loading 'pci_devices' on Instance uuid 794b74db-61ea-478d-9d4d-6380fda3a20c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:44:35 user nova-compute[72874]:   <uuid>794b74db-61ea-478d-9d4d-6380fda3a20c</uuid>
Aug 17 18:44:35 user nova-compute[72874]:   <name>instance-00000028</name>
Aug 17 18:44:35 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:44:35 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:44:35 user nova-compute[72874]:   <metadata>
Aug 17 18:44:35 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:44:35 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:44:35 user nova-compute[72874]:       <nova:name>tempest-TestShelveInstance-server-1706665819</nova:name>
Aug 17 18:44:35 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:44:34</nova:creationTime>
Aug 17 18:44:35 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:44:35 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:44:35 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:44:35 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:44:35 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:44:35 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:44:35 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:44:35 user nova-compute[72874]:       <nova:owner>
Aug 17 18:44:35 user nova-compute[72874]:         <nova:user uuid="737b7b45d61a4a4da68539e463bd1483">tempest-TestShelveInstance-1461547480-project-member</nova:user>
Aug 17 18:44:35 user nova-compute[72874]:         <nova:project uuid="442712d4c97643208940c3be5ecedd02">tempest-TestShelveInstance-1461547480</nova:project>
Aug 17 18:44:35 user nova-compute[72874]:       </nova:owner>
Aug 17 18:44:35 user nova-compute[72874]:       <nova:ports>
Aug 17 18:44:35 user nova-compute[72874]:         <nova:port uuid="8ea2189e-d741-45d3-90a7-e96a7001a3fe">
Aug 17 18:44:35 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 18:44:35 user nova-compute[72874]:         </nova:port>
Aug 17 18:44:35 user nova-compute[72874]:       </nova:ports>
Aug 17 18:44:35 user nova-compute[72874]:     </nova:instance>
Aug 17 18:44:35 user nova-compute[72874]:   </metadata>
Aug 17 18:44:35 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:44:35 user nova-compute[72874]:     <system>
Aug 17 18:44:35 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:44:35 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:44:35 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:44:35 user nova-compute[72874]:       <entry name="serial">794b74db-61ea-478d-9d4d-6380fda3a20c</entry>
Aug 17 18:44:35 user nova-compute[72874]:       <entry name="uuid">794b74db-61ea-478d-9d4d-6380fda3a20c</entry>
Aug 17 18:44:35 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:44:35 user nova-compute[72874]:     </system>
Aug 17 18:44:35 user nova-compute[72874]:   </sysinfo>
Aug 17 18:44:35 user nova-compute[72874]:   <os>
Aug 17 18:44:35 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:44:35 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:44:35 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:44:35 user nova-compute[72874]:   </os>
Aug 17 18:44:35 user nova-compute[72874]:   <features>
Aug 17 18:44:35 user nova-compute[72874]:     <acpi/>
Aug 17 18:44:35 user nova-compute[72874]:     <apic/>
Aug 17 18:44:35 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:44:35 user nova-compute[72874]:   </features>
Aug 17 18:44:35 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:44:35 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:44:35 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:44:35 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:44:35 user nova-compute[72874]:   </clock>
Aug 17 18:44:35 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:44:35 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:44:35 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:44:35 user nova-compute[72874]:   </cpu>
Aug 17 18:44:35 user nova-compute[72874]:   <devices>
Aug 17 18:44:35 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:44:35 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:44:35 user nova-compute[72874]:       <source dev="/dev/sdb"/>
Aug 17 18:44:35 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:44:35 user nova-compute[72874]:       <serial>3053295a-2f62-4f60-a1ec-ceca666e53f7</serial>
Aug 17 18:44:35 user nova-compute[72874]:     </disk>
Aug 17 18:44:35 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:44:35 user nova-compute[72874]:       <mac address="fa:16:3e:75:59:33"/>
Aug 17 18:44:35 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:44:35 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:44:35 user nova-compute[72874]:       <target dev="tap8ea2189e-d7"/>
Aug 17 18:44:35 user nova-compute[72874]:     </interface>
Aug 17 18:44:35 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:44:35 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/794b74db-61ea-478d-9d4d-6380fda3a20c/console.log" append="off"/>
Aug 17 18:44:35 user nova-compute[72874]:     </serial>
Aug 17 18:44:35 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:44:35 user nova-compute[72874]:     <video>
Aug 17 18:44:35 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:44:35 user nova-compute[72874]:     </video>
Aug 17 18:44:35 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:44:35 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:44:35 user nova-compute[72874]:     </rng>
Aug 17 18:44:35 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:44:35 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:44:35 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:44:35 user nova-compute[72874]:     </memballoon>
Aug 17 18:44:35 user nova-compute[72874]:   </devices>
Aug 17 18:44:35 user nova-compute[72874]: </domain>
Aug 17 18:44:35 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T18:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1706665819',display_name='tempest-TestShelveInstance-server-1706665819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1706665819',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-101218560',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='442712d4c97643208940c3be5ecedd02',ramdisk_id='',reservation_id='r-9y1yy1ch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1461547480',owner_user_name='tempest-TestShelveInstance-1461547480-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:44:21Z,user_data=None,user_id='737b7b45d61a4a4da68539e463bd1483',uuid=794b74db-61ea-478d-9d4d-6380fda3a20c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Converting VIF {"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:59:33,bridge_name='br-int',has_traffic_filtering=True,id=8ea2189e-d741-45d3-90a7-e96a7001a3fe,network=Network(c8d77991-30ad-400e-8a4e-ae2a3f341354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2189e-d7') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG os_vif [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:59:33,bridge_name='br-int',has_traffic_filtering=True,id=8ea2189e-d741-45d3-90a7-e96a7001a3fe,network=Network(c8d77991-30ad-400e-8a4e-ae2a3f341354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2189e-d7') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ea2189e-d7, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ea2189e-d7, col_values=(('external_ids', {'iface-id': '8ea2189e-d741-45d3-90a7-e96a7001a3fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:59:33', 'vm-uuid': '794b74db-61ea-478d-9d4d-6380fda3a20c'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:35 user nova-compute[72874]: INFO os_vif [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:59:33,bridge_name='br-int',has_traffic_filtering=True,id=8ea2189e-d741-45d3-90a7-e96a7001a3fe,network=Network(c8d77991-30ad-400e-8a4e-ae2a3f341354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2189e-d7')
Aug 17 18:44:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:44:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] No VIF found with MAC fa:16:3e:75:59:33, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:44:36 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:44:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-2e528fb6-63a2-4f8a-ac19-4dc8f4d62a4c req-b16580c2-70e3-4379-80a9-67092071c330 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received event network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:44:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2e528fb6-63a2-4f8a-ac19-4dc8f4d62a4c req-b16580c2-70e3-4379-80a9-67092071c330 service nova] Acquiring lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:44:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2e528fb6-63a2-4f8a-ac19-4dc8f4d62a4c req-b16580c2-70e3-4379-80a9-67092071c330 service nova] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:44:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2e528fb6-63a2-4f8a-ac19-4dc8f4d62a4c req-b16580c2-70e3-4379-80a9-67092071c330 service nova] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:44:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-2e528fb6-63a2-4f8a-ac19-4dc8f4d62a4c req-b16580c2-70e3-4379-80a9-67092071c330 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] No waiting events found dispatching network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:44:37 user nova-compute[72874]: WARNING nova.compute.manager [req-2e528fb6-63a2-4f8a-ac19-4dc8f4d62a4c req-b16580c2-70e3-4379-80a9-67092071c330 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received unexpected event network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 18:44:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:38 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:44:38 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:44:38 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297878.8979115, 794b74db-61ea-478d-9d4d-6380fda3a20c => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:44:38 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] VM Resumed (Lifecycle Event)
Aug 17 18:44:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:44:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:44:38 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Instance spawned successfully.
Aug 17 18:44:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:44:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:44:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:44:38 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:44:38 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297878.8999648, 794b74db-61ea-478d-9d4d-6380fda3a20c => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:44:38 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] VM Started (Lifecycle Event)
Aug 17 18:44:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:44:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:44:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0a39a88-4d96-4fd2-a0a7-cffdb41efb3c tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:44:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-ee306ae1-0c41-4b25-b77d-5a2ba4e4311c req-0c4c6765-0c44-4011-ad9e-a1779814614e service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received event network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:44:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ee306ae1-0c41-4b25-b77d-5a2ba4e4311c req-0c4c6765-0c44-4011-ad9e-a1779814614e service nova] Acquiring lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:44:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ee306ae1-0c41-4b25-b77d-5a2ba4e4311c req-0c4c6765-0c44-4011-ad9e-a1779814614e service nova] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:44:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ee306ae1-0c41-4b25-b77d-5a2ba4e4311c req-0c4c6765-0c44-4011-ad9e-a1779814614e service nova] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:44:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-ee306ae1-0c41-4b25-b77d-5a2ba4e4311c req-0c4c6765-0c44-4011-ad9e-a1779814614e service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] No waiting events found dispatching network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:44:39 user nova-compute[72874]: WARNING nova.compute.manager [req-ee306ae1-0c41-4b25-b77d-5a2ba4e4311c req-0c4c6765-0c44-4011-ad9e-a1779814614e service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received unexpected event network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe for instance with vm_state active and task_state None.
Aug 17 18:44:39 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:44:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:44:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-1cbc48a0-476c-46bf-a30b-9875c08d818a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:44:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-1cbc48a0-476c-46bf-a30b-9875c08d818a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:44:39 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:44:39 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Updating instance_info_cache with network_info: [{"id": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "address": "fa:16:3e:14:98:96", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ab5da3-c7", "ovs_interfaceid": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:44:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-1cbc48a0-476c-46bf-a30b-9875c08d818a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:44:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:44:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:41 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-8146d49f-435a-4c34-80f1-b5fe456eb373 req-ce1a90a1-2350-4264-98b7-0329fd4a6273 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Received event network-changed-042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-8146d49f-435a-4c34-80f1-b5fe456eb373 req-ce1a90a1-2350-4264-98b7-0329fd4a6273 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Refreshing instance network info cache due to event network-changed-042c5347-d89a-43b4-9ad0-599397295c03. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8146d49f-435a-4c34-80f1-b5fe456eb373 req-ce1a90a1-2350-4264-98b7-0329fd4a6273 service nova] Acquiring lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8146d49f-435a-4c34-80f1-b5fe456eb373 req-ce1a90a1-2350-4264-98b7-0329fd4a6273 service nova] Acquired lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG nova.network.neutron [req-8146d49f-435a-4c34-80f1-b5fe456eb373 req-ce1a90a1-2350-4264-98b7-0329fd4a6273 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Refreshing network info cache for port 042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG nova.network.neutron [req-8146d49f-435a-4c34-80f1-b5fe456eb373 req-ce1a90a1-2350-4264-98b7-0329fd4a6273 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Updated VIF entry in instance network info cache for port 042c5347-d89a-43b4-9ad0-599397295c03. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG nova.network.neutron [req-8146d49f-435a-4c34-80f1-b5fe456eb373 req-ce1a90a1-2350-4264-98b7-0329fd4a6273 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Updating instance_info_cache with network_info: [{"id": "042c5347-d89a-43b4-9ad0-599397295c03", "address": "fa:16:3e:7a:51:0d", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042c5347-d8", "ovs_interfaceid": "042c5347-d89a-43b4-9ad0-599397295c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8146d49f-435a-4c34-80f1-b5fe456eb373 req-ce1a90a1-2350-4264-98b7-0329fd4a6273 service nova] Releasing lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG nova.objects.instance [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lazy-loading 'flavor' on Instance uuid a3b3069b-a81b-4820-9fa2-c86e7361d8a6 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:44:44 user nova-compute[72874]: INFO nova.compute.manager [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Attaching volume a1b2a012-b0d5-4032-b4ff-0567520dfb5c to /dev/vdb
Aug 17 18:44:44 user nova-compute[72874]: DEBUG os_brick.utils [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b099bbef-51b8-4276-90be-ff4875b22d0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ed9c1e-4e7f-4d14-9ffc-b158d5d599e2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbab1cc2-79bb-4ab7-a8bc-313442265039]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab1d533-4dc8-488f-8448-18d15d5a522f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:44:44 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:44:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e722a68-9ab0-4db6-a3ac-c6267baca4e9]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG os_brick.utils [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:44:44 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Updating existing volume attachment record: eb731f14-719e-4181-be6b-45da6f3e712c {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:44:45 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:44:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:44:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:44:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTvrgpbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:44:55 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:44:55 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:44:55 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcd55da-a898-427f-bc63-42d9e37e3bb5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:44:55 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cb7e16-7485-4904-844f-38d48bf3d4d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c] added
Aug 17 18:44:55 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2cc376-c633-4b52-bebe-f585d47458d4]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[448f88c4-69b0-47a5-b634-5e315cc4e590]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTvrgpbn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hTvrgpbn" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3195be97-b239-4625-b847-df8441d9fb6d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hTvrgpbn'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1c48cc-3c9f-411a-80e8-d7c880087933]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d43feb-5e02-4859-8b83-88b2e56fb75c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)
Aug 17 18:44:55 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)
Aug 17 18:44:55 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73f9494-cb00-48c7-a7ed-11086ed988cc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c, portal: 172.16.0.220,3260]
Aug 17 18:44:55 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c, portal: 172.16.0.220,3260] successful.
Aug 17 18:44:55 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[af033a9d-c716-4536-ba87-282cb85c3fa2]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b595ffd-2d87-4965-a6de-3f1653a22020]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)
Aug 17 18:44:55 user nova-compute[72874]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c (non-flash)
Aug 17 18:44:55 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)
Aug 17 18:44:55 user nova-compute[72874]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c (non-flash)
Aug 17 18:44:55 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c29ac4-e2c1-4390-a1ab-8016a3cc76af]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:44:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:44:56 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:44:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTvrgpbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:44:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:44:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23064653335343839', 'path': '/dev/sdc'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:44:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23064653335343839', 'path': '/dev/sdc'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:44:56 user nova-compute[72874]: DEBUG nova.objects.instance [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lazy-loading 'flavor' on Instance uuid a3b3069b-a81b-4820-9fa2-c86e7361d8a6 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:44:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:44:56 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:44:56 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:44:56 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:44:56 user nova-compute[72874]:   <serial>a1b2a012-b0d5-4032-b4ff-0567520dfb5c</serial>
Aug 17 18:44:56 user nova-compute[72874]: </disk>
Aug 17 18:44:56 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:44:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:44:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:44:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] No VIF found with MAC fa:16:3e:7a:51:0d, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:44:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5ec90754-8b95-4da4-9d58-79f478567b71 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.321s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:44:59 user nova-compute[72874]: INFO nova.compute.manager [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Detaching volume a1b2a012-b0d5-4032-b4ff-0567520dfb5c
Aug 17 18:44:59 user nova-compute[72874]: INFO nova.virt.block_device [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Attempting to driver detach volume a1b2a012-b0d5-4032-b4ff-0567520dfb5c from mountpoint /dev/vdb
Aug 17 18:44:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Attempting to detach device vdb from instance a3b3069b-a81b-4820-9fa2-c86e7361d8a6 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:44:59 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:44:59 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:44:59 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:44:59 user nova-compute[72874]:   <serial>a1b2a012-b0d5-4032-b4ff-0567520dfb5c</serial>
Aug 17 18:44:59 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:44:59 user nova-compute[72874]: </disk>
Aug 17 18:44:59 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:44:59 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Successfully detached device vdb from instance a3b3069b-a81b-4820-9fa2-c86e7361d8a6 from the persistent domain config.
Aug 17 18:44:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a3b3069b-a81b-4820-9fa2-c86e7361d8a6 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:44:59 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:44:59 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:44:59 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:44:59 user nova-compute[72874]:   <serial>a1b2a012-b0d5-4032-b4ff-0567520dfb5c</serial>
Aug 17 18:44:59 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:44:59 user nova-compute[72874]: </disk>
Aug 17 18:44:59 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692297899.8390756, a3b3069b-a81b-4820-9fa2-c86e7361d8a6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a3b3069b-a81b-4820-9fa2-c86e7361d8a6 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:44:59 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Successfully detached device vdb from instance a3b3069b-a81b-4820-9fa2-c86e7361d8a6 from the live domain config.
Aug 17 18:44:59 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hTvrgpbn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:44:59 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:44:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef221832-f9b0-4938-9f4b-7a03b453c714]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[950cc46e-8aec-42e2-ba95-979d4ab6de36]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)
Aug 17 18:44:59 user nova-compute[72874]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c (non-flash)
Aug 17 18:44:59 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)
Aug 17 18:44:59 user nova-compute[72874]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c (non-flash)
Aug 17 18:44:59 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a074ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c'): ({'sdc'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Removing single pathed devices sdc {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5674dfe-cd69-4b76-9bf4-f469f6b627ef]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba2f99d-4163-497f-a2d9-f62a7b3461c4]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Flushing IO for device /dev/sdc {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4e2aee-159a-4cd5-ba05-f24acb5504a3]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:44:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[21db49ec-0bcb-469e-a285-bafef8519401]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b6777b-4f67-4fbf-96ce-cc834e06dda0]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb040e6-b3d8-455d-b92a-9f6f741d3fbd]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c, portal: 172.16.0.220,3260]
Aug 17 18:45:00 user nova-compute[72874]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c, portal: 172.16.0.220,3260] successful.
Aug 17 18:45:00 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1b2a012-b0d5-4032-b4ff-0567520dfb5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aad6c07-602b-4d83-9228-04090cf1fce8]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] <== disconnect_volume: return (285ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lazy-loading 'flavor' on Instance uuid a3b3069b-a81b-4820-9fa2-c86e7361d8a6 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e6179ff7-431a-457a-9362-24622a699117 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.662s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:06 user nova-compute[72874]: INFO nova.compute.manager [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Terminating instance
Aug 17 18:45:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:45:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-ad2cfde7-9e60-4eea-829b-f16785e945a7 req-f9fa7ed7-fb45-40de-aa2b-198abca761fe service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received event network-vif-unplugged-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ad2cfde7-9e60-4eea-829b-f16785e945a7 req-f9fa7ed7-fb45-40de-aa2b-198abca761fe service nova] Acquiring lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ad2cfde7-9e60-4eea-829b-f16785e945a7 req-f9fa7ed7-fb45-40de-aa2b-198abca761fe service nova] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ad2cfde7-9e60-4eea-829b-f16785e945a7 req-f9fa7ed7-fb45-40de-aa2b-198abca761fe service nova] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-ad2cfde7-9e60-4eea-829b-f16785e945a7 req-f9fa7ed7-fb45-40de-aa2b-198abca761fe service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] No waiting events found dispatching network-vif-unplugged-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-ad2cfde7-9e60-4eea-829b-f16785e945a7 req-f9fa7ed7-fb45-40de-aa2b-198abca761fe service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received event network-vif-unplugged-14186d03-6c85-4205-8aba-5a2dae028e7a for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:07 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Instance destroyed successfully.
Aug 17 18:45:07 user nova-compute[72874]: DEBUG nova.objects.instance [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'resources' on Instance uuid 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1766440334',display_name='tempest-ServerRescueNegativeTestJSON-server-1766440334',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1766440334',id=29,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:30:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6287735c21fb4b43b3cbd9e0d742b0ec',ramdisk_id='',reservation_id='r-a00wc4ez',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-717723449',owner_user_name='tempest-ServerRescueNegativeTestJSON-717723449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:30:46Z,user_data=None,user_id='3143ae598e814e359466d90e74f9b00c',uuid=8c589f00-c893-4ff7-86f3-7f7ebd7b17b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converting VIF {"id": "14186d03-6c85-4205-8aba-5a2dae028e7a", "address": "fa:16:3e:1f:11:cf", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap14186d03-6c", "ovs_interfaceid": "14186d03-6c85-4205-8aba-5a2dae028e7a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:11:cf,bridge_name='br-int',has_traffic_filtering=True,id=14186d03-6c85-4205-8aba-5a2dae028e7a,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14186d03-6c') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG os_vif [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:11:cf,bridge_name='br-int',has_traffic_filtering=True,id=14186d03-6c85-4205-8aba-5a2dae028e7a,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14186d03-6c') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap14186d03-6c, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:45:07 user nova-compute[72874]: INFO os_vif [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:11:cf,bridge_name='br-int',has_traffic_filtering=True,id=14186d03-6c85-4205-8aba-5a2dae028e7a,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap14186d03-6c')
Aug 17 18:45:07 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Deleting instance files /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2_del
Aug 17 18:45:07 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Deletion of /opt/stack/data/nova/instances/8c589f00-c893-4ff7-86f3-7f7ebd7b17b2_del complete
Aug 17 18:45:07 user nova-compute[72874]: INFO nova.compute.manager [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 18:45:07 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:45:07 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:45:08 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:45:08 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Took 0.64 seconds to deallocate network for instance.
Aug 17 18:45:08 user nova-compute[72874]: DEBUG nova.compute.manager [req-2f02b730-4af5-4b48-866e-e264e3327a4d req-2ed6e079-cdfe-413d-b0a6-4cc5ee629bcc service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received event network-vif-deleted-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:45:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:08 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:45:08 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:45:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:08 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Deleted allocations for instance 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2
Aug 17 18:45:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-bd4b80d9-c9a9-4a6a-a591-657a8425e36d tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.902s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:09 user nova-compute[72874]: DEBUG nova.compute.manager [req-87b9014c-8b53-4557-a71e-c213e8370b8a req-16a45437-ad7b-4957-9749-dec37eab5ff0 service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received event network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:45:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-87b9014c-8b53-4557-a71e-c213e8370b8a req-16a45437-ad7b-4957-9749-dec37eab5ff0 service nova] Acquiring lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-87b9014c-8b53-4557-a71e-c213e8370b8a req-16a45437-ad7b-4957-9749-dec37eab5ff0 service nova] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-87b9014c-8b53-4557-a71e-c213e8370b8a req-16a45437-ad7b-4957-9749-dec37eab5ff0 service nova] Lock "8c589f00-c893-4ff7-86f3-7f7ebd7b17b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:09 user nova-compute[72874]: DEBUG nova.compute.manager [req-87b9014c-8b53-4557-a71e-c213e8370b8a req-16a45437-ad7b-4957-9749-dec37eab5ff0 service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] No waiting events found dispatching network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:45:09 user nova-compute[72874]: WARNING nova.compute.manager [req-87b9014c-8b53-4557-a71e-c213e8370b8a req-16a45437-ad7b-4957-9749-dec37eab5ff0 service nova] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Received unexpected event network-vif-plugged-14186d03-6c85-4205-8aba-5a2dae028e7a for instance with vm_state deleted and task_state None.
Aug 17 18:45:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:22 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297907.6115189, 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:45:22 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] VM Stopped (Lifecycle Event)
Aug 17 18:45:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-72b6989b-cc09-47c1-9bd5-fe6223a25870 None None] [instance: 8c589f00-c893-4ff7-86f3-7f7ebd7b17b2] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:45:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:45:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:45:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:45:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:45:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:45:29 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:45:30 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:45:30 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:45:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:45:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:45:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:45:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:45:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:45:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:45:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:45:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:45:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:45:31 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:45:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:45:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:45:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:45:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:45:31 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:45:31 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:45:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8396MB free_disk=25.223228454589844GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:45:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance b41da216-4183-404f-8896-58371c3ae61d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:45:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 1cbc48a0-476c-46bf-a30b-9875c08d818a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:45:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance a3b3069b-a81b-4820-9fa2-c86e7361d8a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:45:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 794b74db-61ea-478d-9d4d-6380fda3a20c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:45:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:45:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:45:32 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:45:32 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:45:32 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:45:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:38 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:45:38 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:45:39 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:45:40 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:45:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:45:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:45:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:45:40 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:45:40 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updating instance_info_cache with network_info: [{"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:45:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:45:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:45:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:42 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "1cbc48a0-476c-46bf-a30b-9875c08d818a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "1cbc48a0-476c-46bf-a30b-9875c08d818a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "1cbc48a0-476c-46bf-a30b-9875c08d818a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "1cbc48a0-476c-46bf-a30b-9875c08d818a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "1cbc48a0-476c-46bf-a30b-9875c08d818a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:46 user nova-compute[72874]: INFO nova.compute.manager [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Terminating instance
Aug 17 18:45:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG nova.compute.manager [req-ac081d34-297b-4e39-b3aa-e57099810680 req-a1921dbb-fe11-4daf-8582-759a24d0e9ee service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Received event network-vif-unplugged-e9ab5da3-c723-42e4-b704-b4c68e4dfe55 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ac081d34-297b-4e39-b3aa-e57099810680 req-a1921dbb-fe11-4daf-8582-759a24d0e9ee service nova] Acquiring lock "1cbc48a0-476c-46bf-a30b-9875c08d818a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ac081d34-297b-4e39-b3aa-e57099810680 req-a1921dbb-fe11-4daf-8582-759a24d0e9ee service nova] Lock "1cbc48a0-476c-46bf-a30b-9875c08d818a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ac081d34-297b-4e39-b3aa-e57099810680 req-a1921dbb-fe11-4daf-8582-759a24d0e9ee service nova] Lock "1cbc48a0-476c-46bf-a30b-9875c08d818a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG nova.compute.manager [req-ac081d34-297b-4e39-b3aa-e57099810680 req-a1921dbb-fe11-4daf-8582-759a24d0e9ee service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] No waiting events found dispatching network-vif-unplugged-e9ab5da3-c723-42e4-b704-b4c68e4dfe55 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:45:46 user nova-compute[72874]: DEBUG nova.compute.manager [req-ac081d34-297b-4e39-b3aa-e57099810680 req-a1921dbb-fe11-4daf-8582-759a24d0e9ee service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Received event network-vif-unplugged-e9ab5da3-c723-42e4-b704-b4c68e4dfe55 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:45:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Instance destroyed successfully.
Aug 17 18:45:47 user nova-compute[72874]: DEBUG nova.objects.instance [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lazy-loading 'resources' on Instance uuid 1cbc48a0-476c-46bf-a30b-9875c08d818a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:45:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-186884759',display_name='tempest-ServersNegativeTestJSON-server-186884759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-186884759',id=37,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:36:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a1eab2a4b0d14b11b488bcc6a8638134',ramdisk_id='',reservation_id='r-9uc90pyk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-754663374',owner_user_name='tempest-ServersNegativeTestJSON-754663374-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:36:57Z,user_data=None,user_id='500d14cc838b4812bd7a5d36336ae6ae',uuid=1cbc48a0-476c-46bf-a30b-9875c08d818a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "address": "fa:16:3e:14:98:96", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ab5da3-c7", "ovs_interfaceid": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:45:47 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Converting VIF {"id": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "address": "fa:16:3e:14:98:96", "network": {"id": "518607ac-ae8a-4a0e-823a-0b65d7de624b", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161367287-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a1eab2a4b0d14b11b488bcc6a8638134", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9ab5da3-c7", "ovs_interfaceid": "e9ab5da3-c723-42e4-b704-b4c68e4dfe55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:45:47 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:98:96,bridge_name='br-int',has_traffic_filtering=True,id=e9ab5da3-c723-42e4-b704-b4c68e4dfe55,network=Network(518607ac-ae8a-4a0e-823a-0b65d7de624b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ab5da3-c7') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:45:47 user nova-compute[72874]: DEBUG os_vif [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:98:96,bridge_name='br-int',has_traffic_filtering=True,id=e9ab5da3-c723-42e4-b704-b4c68e4dfe55,network=Network(518607ac-ae8a-4a0e-823a-0b65d7de624b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ab5da3-c7') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:45:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9ab5da3-c7, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:45:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:45:47 user nova-compute[72874]: INFO os_vif [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:98:96,bridge_name='br-int',has_traffic_filtering=True,id=e9ab5da3-c723-42e4-b704-b4c68e4dfe55,network=Network(518607ac-ae8a-4a0e-823a-0b65d7de624b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9ab5da3-c7')
Aug 17 18:45:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Deleting instance files /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a_del
Aug 17 18:45:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Deletion of /opt/stack/data/nova/instances/1cbc48a0-476c-46bf-a30b-9875c08d818a_del complete
Aug 17 18:45:47 user nova-compute[72874]: INFO nova.compute.manager [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 17 18:45:47 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:45:47 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:45:47 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:45:47 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:45:47 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Took 0.57 seconds to deallocate network for instance.
Aug 17 18:45:47 user nova-compute[72874]: DEBUG nova.compute.manager [req-22fb384e-7d47-4979-b49b-76a9cd6768bf req-e3beb6bc-24ad-4d65-8fce-f408141293e5 service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Received event network-vif-deleted-e9ab5da3-c723-42e4-b704-b4c68e4dfe55 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:45:47 user nova-compute[72874]: INFO nova.compute.manager [req-22fb384e-7d47-4979-b49b-76a9cd6768bf req-e3beb6bc-24ad-4d65-8fce-f408141293e5 service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Neutron deleted interface e9ab5da3-c723-42e4-b704-b4c68e4dfe55; detaching it from the instance and deleting it from the info cache
Aug 17 18:45:47 user nova-compute[72874]: DEBUG nova.network.neutron [req-22fb384e-7d47-4979-b49b-76a9cd6768bf req-e3beb6bc-24ad-4d65-8fce-f408141293e5 service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:45:47 user nova-compute[72874]: DEBUG nova.compute.manager [req-22fb384e-7d47-4979-b49b-76a9cd6768bf req-e3beb6bc-24ad-4d65-8fce-f408141293e5 service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Detach interface failed, port_id=e9ab5da3-c723-42e4-b704-b4c68e4dfe55, reason: Instance 1cbc48a0-476c-46bf-a30b-9875c08d818a could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:45:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:48 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:45:48 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:45:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:48 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Deleted allocations for instance 1cbc48a0-476c-46bf-a30b-9875c08d818a
Aug 17 18:45:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8c1231d6-cb12-48a0-a033-385e7d51a60b tempest-ServersNegativeTestJSON-754663374 tempest-ServersNegativeTestJSON-754663374-project-member] Lock "1cbc48a0-476c-46bf-a30b-9875c08d818a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.828s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-5b0ee024-b8e0-4bc6-a48a-e65ebfe67e44 req-70ab463c-c1f0-499c-92b7-9e0cded30f21 service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Received event network-vif-plugged-e9ab5da3-c723-42e4-b704-b4c68e4dfe55 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:45:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5b0ee024-b8e0-4bc6-a48a-e65ebfe67e44 req-70ab463c-c1f0-499c-92b7-9e0cded30f21 service nova] Acquiring lock "1cbc48a0-476c-46bf-a30b-9875c08d818a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5b0ee024-b8e0-4bc6-a48a-e65ebfe67e44 req-70ab463c-c1f0-499c-92b7-9e0cded30f21 service nova] Lock "1cbc48a0-476c-46bf-a30b-9875c08d818a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5b0ee024-b8e0-4bc6-a48a-e65ebfe67e44 req-70ab463c-c1f0-499c-92b7-9e0cded30f21 service nova] Lock "1cbc48a0-476c-46bf-a30b-9875c08d818a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-5b0ee024-b8e0-4bc6-a48a-e65ebfe67e44 req-70ab463c-c1f0-499c-92b7-9e0cded30f21 service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] No waiting events found dispatching network-vif-plugged-e9ab5da3-c723-42e4-b704-b4c68e4dfe55 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:45:48 user nova-compute[72874]: WARNING nova.compute.manager [req-5b0ee024-b8e0-4bc6-a48a-e65ebfe67e44 req-70ab463c-c1f0-499c-92b7-9e0cded30f21 service nova] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Received unexpected event network-vif-plugged-e9ab5da3-c723-42e4-b704-b4c68e4dfe55 for instance with vm_state deleted and task_state None.
Aug 17 18:45:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "b41da216-4183-404f-8896-58371c3ae61d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:57 user nova-compute[72874]: INFO nova.compute.manager [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Terminating instance
Aug 17 18:45:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-15cf6947-0071-4080-bd91-ba1b26eaf650 req-5ecbf52c-37d5-457b-9119-42881d270a27 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-unplugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-15cf6947-0071-4080-bd91-ba1b26eaf650 req-5ecbf52c-37d5-457b-9119-42881d270a27 service nova] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-15cf6947-0071-4080-bd91-ba1b26eaf650 req-5ecbf52c-37d5-457b-9119-42881d270a27 service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-15cf6947-0071-4080-bd91-ba1b26eaf650 req-5ecbf52c-37d5-457b-9119-42881d270a27 service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-15cf6947-0071-4080-bd91-ba1b26eaf650 req-5ecbf52c-37d5-457b-9119-42881d270a27 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] No waiting events found dispatching network-vif-unplugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-15cf6947-0071-4080-bd91-ba1b26eaf650 req-5ecbf52c-37d5-457b-9119-42881d270a27 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-unplugged-e30432ac-cf52-4ce4-a10a-70700297a63e for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:45:57 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: b41da216-4183-404f-8896-58371c3ae61d] Instance destroyed successfully.
Aug 17 18:45:57 user nova-compute[72874]: DEBUG nova.objects.instance [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lazy-loading 'resources' on Instance uuid b41da216-4183-404f-8896-58371c3ae61d {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:28:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-674035551',display_name='tempest-ServerRescueNegativeTestJSON-server-674035551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-674035551',id=28,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:33:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6287735c21fb4b43b3cbd9e0d742b0ec',ramdisk_id='',reservation_id='r-5o49sjrl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-717723449',owner_user_name='tempest-ServerRescueNegativeTestJSON-717723449-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:35:30Z,user_data=None,user_id='3143ae598e814e359466d90e74f9b00c',uuid=b41da216-4183-404f-8896-58371c3ae61d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converting VIF {"id": "e30432ac-cf52-4ce4-a10a-70700297a63e", "address": "fa:16:3e:cd:cd:aa", "network": {"id": "96e13516-d533-4f09-bc6b-2621584fbf91", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1089047774-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6287735c21fb4b43b3cbd9e0d742b0ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape30432ac-cf", "ovs_interfaceid": "e30432ac-cf52-4ce4-a10a-70700297a63e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cd:aa,bridge_name='br-int',has_traffic_filtering=True,id=e30432ac-cf52-4ce4-a10a-70700297a63e,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30432ac-cf') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG os_vif [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cd:aa,bridge_name='br-int',has_traffic_filtering=True,id=e30432ac-cf52-4ce4-a10a-70700297a63e,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30432ac-cf') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape30432ac-cf, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:45:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:45:57 user nova-compute[72874]: INFO os_vif [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:cd:aa,bridge_name='br-int',has_traffic_filtering=True,id=e30432ac-cf52-4ce4-a10a-70700297a63e,network=Network(96e13516-d533-4f09-bc6b-2621584fbf91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape30432ac-cf')
Aug 17 18:45:57 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Deleting instance files /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d_del
Aug 17 18:45:57 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Deletion of /opt/stack/data/nova/instances/b41da216-4183-404f-8896-58371c3ae61d_del complete
Aug 17 18:45:58 user nova-compute[72874]: INFO nova.compute.manager [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] [instance: b41da216-4183-404f-8896-58371c3ae61d] Took 0.63 seconds to destroy the instance on the hypervisor.
Aug 17 18:45:58 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:45:58 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: b41da216-4183-404f-8896-58371c3ae61d] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:45:58 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: b41da216-4183-404f-8896-58371c3ae61d] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:45:58 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: b41da216-4183-404f-8896-58371c3ae61d] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:45:58 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: b41da216-4183-404f-8896-58371c3ae61d] Took 0.51 seconds to deallocate network for instance.
Aug 17 18:45:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-8a2eb66a-133b-4ec7-ba9b-108d73a4366b req-6bdcfa2d-a8eb-4f48-8617-5e68dbbfd276 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-deleted-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:45:58 user nova-compute[72874]: INFO nova.compute.manager [req-8a2eb66a-133b-4ec7-ba9b-108d73a4366b req-6bdcfa2d-a8eb-4f48-8617-5e68dbbfd276 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Neutron deleted interface e30432ac-cf52-4ce4-a10a-70700297a63e; detaching it from the instance and deleting it from the info cache
Aug 17 18:45:58 user nova-compute[72874]: DEBUG nova.network.neutron [req-8a2eb66a-133b-4ec7-ba9b-108d73a4366b req-6bdcfa2d-a8eb-4f48-8617-5e68dbbfd276 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:45:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-8a2eb66a-133b-4ec7-ba9b-108d73a4366b req-6bdcfa2d-a8eb-4f48-8617-5e68dbbfd276 service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Detach interface failed, port_id=e30432ac-cf52-4ce4-a10a-70700297a63e, reason: Instance b41da216-4183-404f-8896-58371c3ae61d could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:45:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:58 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:45:58 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:45:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:58 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Deleted allocations for instance b41da216-4183-404f-8896-58371c3ae61d
Aug 17 18:45:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-e7905abf-0a72-4005-a25f-39991152591e tempest-ServerRescueNegativeTestJSON-717723449 tempest-ServerRescueNegativeTestJSON-717723449-project-member] Lock "b41da216-4183-404f-8896-58371c3ae61d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.483s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:58 user nova-compute[72874]: DEBUG nova.compute.manager [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:45:58 user nova-compute[72874]: INFO nova.compute.manager [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] instance snapshotting
Aug 17 18:45:58 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Beginning live snapshot process
Aug 17 18:45:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json -f qcow2 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:45:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:45:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json -f qcow2 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:45:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json -f qcow2" returned: 0 in 0.313s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:45:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:45:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-9d4baf6e-573f-4745-b0b4-65e76d6f4894 req-039823fb-ef4d-47ee-93f9-2faefa94f69b service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:45:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9d4baf6e-573f-4745-b0b4-65e76d6f4894 req-039823fb-ef4d-47ee-93f9-2faefa94f69b service nova] Acquiring lock "b41da216-4183-404f-8896-58371c3ae61d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:45:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9d4baf6e-573f-4745-b0b4-65e76d6f4894 req-039823fb-ef4d-47ee-93f9-2faefa94f69b service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:45:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9d4baf6e-573f-4745-b0b4-65e76d6f4894 req-039823fb-ef4d-47ee-93f9-2faefa94f69b service nova] Lock "b41da216-4183-404f-8896-58371c3ae61d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:45:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-9d4baf6e-573f-4745-b0b4-65e76d6f4894 req-039823fb-ef4d-47ee-93f9-2faefa94f69b service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] No waiting events found dispatching network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:45:59 user nova-compute[72874]: WARNING nova.compute.manager [req-9d4baf6e-573f-4745-b0b4-65e76d6f4894 req-039823fb-ef4d-47ee-93f9-2faefa94f69b service nova] [instance: b41da216-4183-404f-8896-58371c3ae61d] Received unexpected event network-vif-plugged-e30432ac-cf52-4ce4-a10a-70700297a63e for instance with vm_state deleted and task_state None.
Aug 17 18:45:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:45:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb6opno9r/64d1bdf39d304dcaa39edf8bcf690685.delta 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:45:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb6opno9r/64d1bdf39d304dcaa39edf8bcf690685.delta 1073741824" returned: 0 in 0.051s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:45:59 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 18:46:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] COPY block job progress, current cursor: 65536 final cursor: 75563008 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:46:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72874) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 18:46:01 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 18:46:01 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:46:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb6opno9r/64d1bdf39d304dcaa39edf8bcf690685.delta /opt/stack/data/nova/instances/snapshots/tmpb6opno9r/64d1bdf39d304dcaa39edf8bcf690685 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb6opno9r/64d1bdf39d304dcaa39edf8bcf690685.delta /opt/stack/data/nova/instances/snapshots/tmpb6opno9r/64d1bdf39d304dcaa39edf8bcf690685" returned: 0 in 0.650s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:01 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Snapshot extracted, beginning image upload
Aug 17 18:46:02 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297947.2721772, 1cbc48a0-476c-46bf-a30b-9875c08d818a => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:46:02 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] VM Stopped (Lifecycle Event)
Aug 17 18:46:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-10c1e205-bf7a-4953-8cf4-aeacd9ece465 None None] [instance: 1cbc48a0-476c-46bf-a30b-9875c08d818a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:46:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:03 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Snapshot image upload complete
Aug 17 18:46:03 user nova-compute[72874]: INFO nova.compute.manager [None req-44f2f4de-0d32-4580-b4d8-1e4ce2c3fe21 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Took 5.05 seconds to snapshot the instance on the hypervisor.
Aug 17 18:46:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:46:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:05 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:46:05 user nova-compute[72874]: INFO nova.compute.claims [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Claim successful on node user
Aug 17 18:46:05 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:46:05 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:46:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.328s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:46:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:46:06 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:46:06 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:46:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:46:06 user nova-compute[72874]: DEBUG nova.policy [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '538b882b4c794d9496b2bee673cfd239', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15562548cd9d4848a2a0a4f99e04f11e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:46:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:46:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:46:06 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Creating image(s)
Aug 17 18:46:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "/opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "/opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "fbf9fa7b51885e61ced75cb7260d6194303d86a8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "fbf9fa7b51885e61ced75cb7260d6194303d86a8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8.part --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:07 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Successfully created port: 28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:46:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8.part --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:07 user nova-compute[72874]: DEBUG nova.virt.images [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] cc105af2-598b-4add-96d6-e16046364f8d was qcow2, converting to raw {{(pid=72874) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 18:46:07 user nova-compute[72874]: DEBUG nova.privsep.utils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72874) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 18:46:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8.part /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8.converted {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8.part /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8.converted" returned: 0 in 0.270s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8.converted --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "fbf9fa7b51885e61ced75cb7260d6194303d86a8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.631s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:07 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Successfully updated port: 28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8 --force-share --output=json" returned: 0 in 0.168s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "fbf9fa7b51885e61ced75cb7260d6194303d86a8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "fbf9fa7b51885e61ced75cb7260d6194303d86a8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "refresh_cache-4fff1e38-fe0a-41e0-82ce-a2657a8bd598" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquired lock "refresh_cache-4fff1e38-fe0a-41e0-82ce-a2657a8bd598" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.compute.manager [req-1027a3d4-655d-466c-8aae-8b56d09f5bc5 req-bc916e9b-9203-40ac-a6d6-d9517948b8c2 service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received event network-changed-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.compute.manager [req-1027a3d4-655d-466c-8aae-8b56d09f5bc5 req-bc916e9b-9203-40ac-a6d6-d9517948b8c2 service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Refreshing instance network info cache due to event network-changed-28eef906-87af-40e8-b07f-80dadce3ef2d. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1027a3d4-655d-466c-8aae-8b56d09f5bc5 req-bc916e9b-9203-40ac-a6d6-d9517948b8c2 service nova] Acquiring lock "refresh_cache-4fff1e38-fe0a-41e0-82ce-a2657a8bd598" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8 --force-share --output=json" returned: 0 in 0.196s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8,backing_fmt=raw /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8,backing_fmt=raw /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk 1073741824" returned: 0 in 0.048s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "fbf9fa7b51885e61ced75cb7260d6194303d86a8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8 --force-share --output=json" returned: 0 in 0.177s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lazy-loading 'migration_context' on Instance uuid 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Ensure instance console log exists: /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Updating instance_info_cache with network_info: [{"id": "28eef906-87af-40e8-b07f-80dadce3ef2d", "address": "fa:16:3e:dd:5d:a0", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28eef906-87", "ovs_interfaceid": "28eef906-87af-40e8-b07f-80dadce3ef2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Releasing lock "refresh_cache-4fff1e38-fe0a-41e0-82ce-a2657a8bd598" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Instance network_info: |[{"id": "28eef906-87af-40e8-b07f-80dadce3ef2d", "address": "fa:16:3e:dd:5d:a0", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28eef906-87", "ovs_interfaceid": "28eef906-87af-40e8-b07f-80dadce3ef2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1027a3d4-655d-466c-8aae-8b56d09f5bc5 req-bc916e9b-9203-40ac-a6d6-d9517948b8c2 service nova] Acquired lock "refresh_cache-4fff1e38-fe0a-41e0-82ce-a2657a8bd598" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.network.neutron [req-1027a3d4-655d-466c-8aae-8b56d09f5bc5 req-bc916e9b-9203-40ac-a6d6-d9517948b8c2 service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Refreshing network info cache for port 28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Start _get_guest_xml network_info=[{"id": "28eef906-87af-40e8-b07f-80dadce3ef2d", "address": "fa:16:3e:dd:5d:a0", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28eef906-87", "ovs_interfaceid": "28eef906-87af-40e8-b07f-80dadce3ef2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='53bea69045fc6c215088ec57e7cfe756',container_format='bare',created_at=2023-08-17T18:45:59Z,direct_url=<?>,disk_format='qcow2',id=cc105af2-598b-4add-96d6-e16046364f8d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2054403278',owner='15562548cd9d4848a2a0a4f99e04f11e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T18:46:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': 'cc105af2-598b-4add-96d6-e16046364f8d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:46:08 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:46:08 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='53bea69045fc6c215088ec57e7cfe756',container_format='bare',created_at=2023-08-17T18:45:59Z,direct_url=<?>,disk_format='qcow2',id=cc105af2-598b-4add-96d6-e16046364f8d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2054403278',owner='15562548cd9d4848a2a0a4f99e04f11e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T18:46:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:46:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-481536443',display_name='tempest-TestStampPattern-server-481536443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-481536443',id=42,image_ref='cc105af2-598b-4add-96d6-e16046364f8d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqhsRm9d1hAMSVz4vVR/PRgiZqjbXEj4l6p6aJ986tXYCYQVHYhbILnl0Ackxz/vvYoRWCnZ4khK5jTOhMQdsdT0QSQXnRiZkts9kxWBDFdSV7ZIWMf6h9Yk2mJ+vjM0w==',key_name='tempest-TestStampPattern-902745170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15562548cd9d4848a2a0a4f99e04f11e',ramdisk_id='',reservation_id='r-ijlkzojv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a3b3069b-a81b-4820-9fa2-c86e7361d8a6',image_min_disk='1',image_min_ram='0',image_owner_id='15562548cd9d4848a2a0a4f99e04f11e',image_owner_project_name='tempest-TestStampPattern-221411575',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-221411575-project-member',image_user_id='538b882b4c794d9496b2bee673cfd239',network_allocated='True',owner_project_name='tempest-TestStampPattern-221411575',owner_user_name='tempest-TestStampPattern-221411575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:46:06Z,user_data=None,user_id='538b882b4c794d9496b2bee673cfd239',uuid=4fff1e38-fe0a-41e0-82ce-a2657a8bd598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28eef906-87af-40e8-b07f-80dadce3ef2d", "address": "fa:16:3e:dd:5d:a0", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28eef906-87", "ovs_interfaceid": "28eef906-87af-40e8-b07f-80dadce3ef2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Converting VIF {"id": "28eef906-87af-40e8-b07f-80dadce3ef2d", "address": "fa:16:3e:dd:5d:a0", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28eef906-87", "ovs_interfaceid": "28eef906-87af-40e8-b07f-80dadce3ef2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:5d:a0,bridge_name='br-int',has_traffic_filtering=True,id=28eef906-87af-40e8-b07f-80dadce3ef2d,network=Network(7ccf040b-9956-46c7-bf3f-52c6d0356865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28eef906-87') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:46:08 user nova-compute[72874]:   <uuid>4fff1e38-fe0a-41e0-82ce-a2657a8bd598</uuid>
Aug 17 18:46:08 user nova-compute[72874]:   <name>instance-0000002a</name>
Aug 17 18:46:08 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:46:08 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:46:08 user nova-compute[72874]:   <metadata>
Aug 17 18:46:08 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:46:08 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:46:08 user nova-compute[72874]:       <nova:name>tempest-TestStampPattern-server-481536443</nova:name>
Aug 17 18:46:08 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:46:08</nova:creationTime>
Aug 17 18:46:08 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:46:08 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:46:08 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:46:08 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:46:08 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:46:08 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:46:08 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:46:08 user nova-compute[72874]:       <nova:owner>
Aug 17 18:46:08 user nova-compute[72874]:         <nova:user uuid="538b882b4c794d9496b2bee673cfd239">tempest-TestStampPattern-221411575-project-member</nova:user>
Aug 17 18:46:08 user nova-compute[72874]:         <nova:project uuid="15562548cd9d4848a2a0a4f99e04f11e">tempest-TestStampPattern-221411575</nova:project>
Aug 17 18:46:08 user nova-compute[72874]:       </nova:owner>
Aug 17 18:46:08 user nova-compute[72874]:       <nova:root type="image" uuid="cc105af2-598b-4add-96d6-e16046364f8d"/>
Aug 17 18:46:08 user nova-compute[72874]:       <nova:ports>
Aug 17 18:46:08 user nova-compute[72874]:         <nova:port uuid="28eef906-87af-40e8-b07f-80dadce3ef2d">
Aug 17 18:46:08 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 18:46:08 user nova-compute[72874]:         </nova:port>
Aug 17 18:46:08 user nova-compute[72874]:       </nova:ports>
Aug 17 18:46:08 user nova-compute[72874]:     </nova:instance>
Aug 17 18:46:08 user nova-compute[72874]:   </metadata>
Aug 17 18:46:08 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:46:08 user nova-compute[72874]:     <system>
Aug 17 18:46:08 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:46:08 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:46:08 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:46:08 user nova-compute[72874]:       <entry name="serial">4fff1e38-fe0a-41e0-82ce-a2657a8bd598</entry>
Aug 17 18:46:08 user nova-compute[72874]:       <entry name="uuid">4fff1e38-fe0a-41e0-82ce-a2657a8bd598</entry>
Aug 17 18:46:08 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:46:08 user nova-compute[72874]:     </system>
Aug 17 18:46:08 user nova-compute[72874]:   </sysinfo>
Aug 17 18:46:08 user nova-compute[72874]:   <os>
Aug 17 18:46:08 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:46:08 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:46:08 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:46:08 user nova-compute[72874]:   </os>
Aug 17 18:46:08 user nova-compute[72874]:   <features>
Aug 17 18:46:08 user nova-compute[72874]:     <acpi/>
Aug 17 18:46:08 user nova-compute[72874]:     <apic/>
Aug 17 18:46:08 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:46:08 user nova-compute[72874]:   </features>
Aug 17 18:46:08 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:46:08 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:46:08 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:46:08 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:46:08 user nova-compute[72874]:   </clock>
Aug 17 18:46:08 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:46:08 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:46:08 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:46:08 user nova-compute[72874]:   </cpu>
Aug 17 18:46:08 user nova-compute[72874]:   <devices>
Aug 17 18:46:08 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:46:08 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:46:08 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk"/>
Aug 17 18:46:08 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:46:08 user nova-compute[72874]:     </disk>
Aug 17 18:46:08 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:46:08 user nova-compute[72874]:       <mac address="fa:16:3e:dd:5d:a0"/>
Aug 17 18:46:08 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:46:08 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:46:08 user nova-compute[72874]:       <target dev="tap28eef906-87"/>
Aug 17 18:46:08 user nova-compute[72874]:     </interface>
Aug 17 18:46:08 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:46:08 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/console.log" append="off"/>
Aug 17 18:46:08 user nova-compute[72874]:     </serial>
Aug 17 18:46:08 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:46:08 user nova-compute[72874]:     <video>
Aug 17 18:46:08 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:46:08 user nova-compute[72874]:     </video>
Aug 17 18:46:08 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:46:08 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:46:08 user nova-compute[72874]:     </rng>
Aug 17 18:46:08 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:46:08 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:46:08 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:46:08 user nova-compute[72874]:     </memballoon>
Aug 17 18:46:08 user nova-compute[72874]:   </devices>
Aug 17 18:46:08 user nova-compute[72874]: </domain>
Aug 17 18:46:08 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:46:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-481536443',display_name='tempest-TestStampPattern-server-481536443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-481536443',id=42,image_ref='cc105af2-598b-4add-96d6-e16046364f8d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqhsRm9d1hAMSVz4vVR/PRgiZqjbXEj4l6p6aJ986tXYCYQVHYhbILnl0Ackxz/vvYoRWCnZ4khK5jTOhMQdsdT0QSQXnRiZkts9kxWBDFdSV7ZIWMf6h9Yk2mJ+vjM0w==',key_name='tempest-TestStampPattern-902745170',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='15562548cd9d4848a2a0a4f99e04f11e',ramdisk_id='',reservation_id='r-ijlkzojv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a3b3069b-a81b-4820-9fa2-c86e7361d8a6',image_min_disk='1',image_min_ram='0',image_owner_id='15562548cd9d4848a2a0a4f99e04f11e',image_owner_project_name='tempest-TestStampPattern-221411575',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-221411575-project-member',image_user_id='538b882b4c794d9496b2bee673cfd239',network_allocated='True',owner_project_name='tempest-TestStampPattern-221411575',owner_user_name='tempest-TestStampPattern-221411575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:46:06Z,user_data=None,user_id='538b882b4c794d9496b2bee673cfd239',uuid=4fff1e38-fe0a-41e0-82ce-a2657a8bd598,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28eef906-87af-40e8-b07f-80dadce3ef2d", "address": "fa:16:3e:dd:5d:a0", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28eef906-87", "ovs_interfaceid": "28eef906-87af-40e8-b07f-80dadce3ef2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Converting VIF {"id": "28eef906-87af-40e8-b07f-80dadce3ef2d", "address": "fa:16:3e:dd:5d:a0", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28eef906-87", "ovs_interfaceid": "28eef906-87af-40e8-b07f-80dadce3ef2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:5d:a0,bridge_name='br-int',has_traffic_filtering=True,id=28eef906-87af-40e8-b07f-80dadce3ef2d,network=Network(7ccf040b-9956-46c7-bf3f-52c6d0356865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28eef906-87') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG os_vif [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:5d:a0,bridge_name='br-int',has_traffic_filtering=True,id=28eef906-87af-40e8-b07f-80dadce3ef2d,network=Network(7ccf040b-9956-46c7-bf3f-52c6d0356865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28eef906-87') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28eef906-87, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28eef906-87, col_values=(('external_ids', {'iface-id': '28eef906-87af-40e8-b07f-80dadce3ef2d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:5d:a0', 'vm-uuid': '4fff1e38-fe0a-41e0-82ce-a2657a8bd598'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:08 user nova-compute[72874]: INFO os_vif [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:5d:a0,bridge_name='br-int',has_traffic_filtering=True,id=28eef906-87af-40e8-b07f-80dadce3ef2d,network=Network(7ccf040b-9956-46c7-bf3f-52c6d0356865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28eef906-87')
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:46:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] No VIF found with MAC fa:16:3e:dd:5d:a0, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:46:09 user nova-compute[72874]: DEBUG nova.network.neutron [req-1027a3d4-655d-466c-8aae-8b56d09f5bc5 req-bc916e9b-9203-40ac-a6d6-d9517948b8c2 service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Updated VIF entry in instance network info cache for port 28eef906-87af-40e8-b07f-80dadce3ef2d. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:46:09 user nova-compute[72874]: DEBUG nova.network.neutron [req-1027a3d4-655d-466c-8aae-8b56d09f5bc5 req-bc916e9b-9203-40ac-a6d6-d9517948b8c2 service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Updating instance_info_cache with network_info: [{"id": "28eef906-87af-40e8-b07f-80dadce3ef2d", "address": "fa:16:3e:dd:5d:a0", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28eef906-87", "ovs_interfaceid": "28eef906-87af-40e8-b07f-80dadce3ef2d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:46:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1027a3d4-655d-466c-8aae-8b56d09f5bc5 req-bc916e9b-9203-40ac-a6d6-d9517948b8c2 service nova] Releasing lock "refresh_cache-4fff1e38-fe0a-41e0-82ce-a2657a8bd598" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:46:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-c4ab3384-58e3-4cf9-8d46-fc8f05f5c47c req-2104deac-98ee-43dd-9bb3-6fa47e2895b9 service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received event network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:46:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c4ab3384-58e3-4cf9-8d46-fc8f05f5c47c req-2104deac-98ee-43dd-9bb3-6fa47e2895b9 service nova] Acquiring lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c4ab3384-58e3-4cf9-8d46-fc8f05f5c47c req-2104deac-98ee-43dd-9bb3-6fa47e2895b9 service nova] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c4ab3384-58e3-4cf9-8d46-fc8f05f5c47c req-2104deac-98ee-43dd-9bb3-6fa47e2895b9 service nova] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-c4ab3384-58e3-4cf9-8d46-fc8f05f5c47c req-2104deac-98ee-43dd-9bb3-6fa47e2895b9 service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] No waiting events found dispatching network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:46:10 user nova-compute[72874]: WARNING nova.compute.manager [req-c4ab3384-58e3-4cf9-8d46-fc8f05f5c47c req-2104deac-98ee-43dd-9bb3-6fa47e2895b9 service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received unexpected event network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d for instance with vm_state building and task_state spawning.
Aug 17 18:46:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "794b74db-61ea-478d-9d4d-6380fda3a20c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:11 user nova-compute[72874]: INFO nova.compute.manager [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Terminating instance
Aug 17 18:46:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:46:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297972.149319, 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:46:12 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] VM Resumed (Lifecycle Event)
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:46:12 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Instance spawned successfully.
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:46:12 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692297972.150697, 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:46:12 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] VM Started (Lifecycle Event)
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received event network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] Acquiring lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] No waiting events found dispatching network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:46:12 user nova-compute[72874]: WARNING nova.compute.manager [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received unexpected event network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d for instance with vm_state building and task_state spawning.
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received event network-changed-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Refreshing instance network info cache due to event network-changed-8ea2189e-d741-45d3-90a7-e96a7001a3fe. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] Acquiring lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] Acquired lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.network.neutron [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Refreshing network info cache for port 8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:46:12 user nova-compute[72874]: INFO nova.compute.manager [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Took 6.07 seconds to spawn the instance on the hypervisor.
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:46:12 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:46:12 user nova-compute[72874]: INFO nova.compute.manager [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Took 6.75 seconds to build instance.
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3bca0b1d-7b2e-4da7-8f8b-1ff0e7a25876 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.840s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:12 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Instance destroyed successfully.
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.objects.instance [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lazy-loading 'resources' on Instance uuid 794b74db-61ea-478d-9d4d-6380fda3a20c {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T18:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1706665819',display_name='tempest-TestShelveInstance-server-1706665819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1706665819',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqy6nYYaqyNvje0gkLPcdEvXj/bISglLAvp7zAI8ZcdQeUFMPS3/Qsw2b6NirZ7f0MDmJNWYLhK28eOGKzhjiheFnFHZb7HcGrNbGLTtcCzWaJ+AHusJELx1RsmVZ7f5A==',key_name='tempest-TestShelveInstance-101218560',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:44:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='442712d4c97643208940c3be5ecedd02',ramdisk_id='',reservation_id='r-9y1yy1ch',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1461547480',owner_user_name='tempest-TestShelveInstance-1461547480-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:44:39Z,user_data=None,user_id='737b7b45d61a4a4da68539e463bd1483',uuid=794b74db-61ea-478d-9d4d-6380fda3a20c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Converting VIF {"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:59:33,bridge_name='br-int',has_traffic_filtering=True,id=8ea2189e-d741-45d3-90a7-e96a7001a3fe,network=Network(c8d77991-30ad-400e-8a4e-ae2a3f341354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2189e-d7') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_vif [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:59:33,bridge_name='br-int',has_traffic_filtering=True,id=8ea2189e-d741-45d3-90a7-e96a7001a3fe,network=Network(c8d77991-30ad-400e-8a4e-ae2a3f341354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2189e-d7') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ea2189e-d7, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:46:12 user nova-compute[72874]: INFO os_vif [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:59:33,bridge_name='br-int',has_traffic_filtering=True,id=8ea2189e-d741-45d3-90a7-e96a7001a3fe,network=Network(c8d77991-30ad-400e-8a4e-ae2a3f341354),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ea2189e-d7')
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CrEnsfIc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:46:12 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d79cdf42-758f-462f-8144-1134661614cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d964bf-82bc-4c55-98b1-8e8ded4f0b22]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)
Aug 17 18:46:12 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 (non-flash)
Aug 17 18:46:12 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a0508550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3077a618-fa1b-456c-949d-2aba8e17632b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[31323c35-624f-42d3-a508-f44282bba4f3]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7be9e61-9532-4517-b8c0-de856c1bc1bd]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.network.neutron [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updated VIF entry in instance network info cache for port 8ea2189e-d741-45d3-90a7-e96a7001a3fe. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.network.neutron [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updating instance_info_cache with network_info: [{"id": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "address": "fa:16:3e:75:59:33", "network": {"id": "c8d77991-30ad-400e-8a4e-ae2a3f341354", "bridge": "br-int", "label": "tempest-TestShelveInstance-1378755407-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "442712d4c97643208940c3be5ecedd02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ea2189e-d7", "ovs_interfaceid": "8ea2189e-d741-45d3-90a7-e96a7001a3fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[430f365c-90d4-49a4-a0e3-10ebe6b727a6]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOda9dac44-d305bafb56a134f8', '/dev/disk/by-id/scsi-26433303562616662', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_da9dac44') {{(pid=83588) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c880149-c1de-45df-92f6-f6ba47a043c9]: (4, None) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] Releasing lock "refresh_cache-794b74db-61ea-478d-9d4d-6380fda3a20c" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received event network-vif-unplugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] Acquiring lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] No waiting events found dispatching network-vif-unplugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.compute.manager [req-d8f41d1a-ffaa-4849-a3a1-32104e195915 req-9ccff356-969d-4e24-9cfe-570674e965dd service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received event network-vif-unplugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6ad7e1-148d-46e7-8508-d7167dcd163f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0027988c-40c7-42a5-bc7b-fa27dcff7fce]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7, portal: 172.16.0.220,3260]
Aug 17 18:46:12 user nova-compute[72874]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7, portal: 172.16.0.220,3260] successful.
Aug 17 18:46:12 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3053295a-2f62-4f60-a1ec-ceca666e53f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[322447f7-a744-43ef-b018-1cf466a1af9a]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] <== disconnect_volume: return (282ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:46:12 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Deleting instance files /opt/stack/data/nova/instances/794b74db-61ea-478d-9d4d-6380fda3a20c_del
Aug 17 18:46:12 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Deletion of /opt/stack/data/nova/instances/794b74db-61ea-478d-9d4d-6380fda3a20c_del complete
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297957.9241266, b41da216-4183-404f-8896-58371c3ae61d => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:46:12 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: b41da216-4183-404f-8896-58371c3ae61d] VM Stopped (Lifecycle Event)
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6c92e2e8-371d-439b-91c7-1c71348ba18d None None] [instance: b41da216-4183-404f-8896-58371c3ae61d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:46:12 user nova-compute[72874]: INFO nova.compute.manager [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 17 18:46:12 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:46:12 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:46:13 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:46:13 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Took 0.59 seconds to deallocate network for instance.
Aug 17 18:46:13 user nova-compute[72874]: DEBUG nova.compute.manager [req-bce12a8f-14f5-4aec-ac57-9416fd039ac4 req-5c5b20cb-b1c0-4bec-aaf3-2158f56d3496 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received event network-vif-deleted-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:46:14 user nova-compute[72874]: DEBUG nova.compute.manager [req-5652d1f3-0292-4b2b-8407-bbbd7cb331df req-3c5dfe9a-e840-4704-aa5c-c89a7247a163 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received event network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:46:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5652d1f3-0292-4b2b-8407-bbbd7cb331df req-3c5dfe9a-e840-4704-aa5c-c89a7247a163 service nova] Acquiring lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5652d1f3-0292-4b2b-8407-bbbd7cb331df req-3c5dfe9a-e840-4704-aa5c-c89a7247a163 service nova] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5652d1f3-0292-4b2b-8407-bbbd7cb331df req-3c5dfe9a-e840-4704-aa5c-c89a7247a163 service nova] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:14 user nova-compute[72874]: DEBUG nova.compute.manager [req-5652d1f3-0292-4b2b-8407-bbbd7cb331df req-3c5dfe9a-e840-4704-aa5c-c89a7247a163 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] No waiting events found dispatching network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:46:14 user nova-compute[72874]: WARNING nova.compute.manager [req-5652d1f3-0292-4b2b-8407-bbbd7cb331df req-3c5dfe9a-e840-4704-aa5c-c89a7247a163 service nova] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Received unexpected event network-vif-plugged-8ea2189e-d741-45d3-90a7-e96a7001a3fe for instance with vm_state active and task_state deleting.
Aug 17 18:46:14 user nova-compute[72874]: INFO nova.compute.manager [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Took 0.88 seconds to detach 1 volumes for instance.
Aug 17 18:46:14 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Deleting volume: 3053295a-2f62-4f60-a1ec-ceca666e53f7 {{(pid=72874) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 18:46:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:14 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:46:14 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:46:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:14 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Deleted allocations for instance 794b74db-61ea-478d-9d4d-6380fda3a20c
Aug 17 18:46:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf9401e-2003-4c48-acdd-1b8f00f960a7 tempest-TestShelveInstance-1461547480 tempest-TestShelveInstance-1461547480-project-member] Lock "794b74db-61ea-478d-9d4d-6380fda3a20c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.059s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:46:27 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692297972.5927098, 794b74db-61ea-478d-9d4d-6380fda3a20c => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:46:27 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] VM Stopped (Lifecycle Event)
Aug 17 18:46:27 user nova-compute[72874]: DEBUG nova.compute.manager [None req-ed24aca2-0b92-4416-b2fb-7297d97cacbb None None] [instance: 794b74db-61ea-478d-9d4d-6380fda3a20c] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:46:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:46:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:46:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:46:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:46:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:30 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:46:30 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:46:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:30 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:30 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:46:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:30 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:31 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:46:31 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:46:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8524MB free_disk=25.12499237060547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:46:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance a3b3069b-a81b-4820-9fa2-c86e7361d8a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:46:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:46:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:46:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:46:31 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:46:31 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:46:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:46:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:32 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:46:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:38 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:46:39 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:46:39 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:46:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:41 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:46:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:46:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:46:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:46:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:46:41 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:46:41 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid a3b3069b-a81b-4820-9fa2-c86e7361d8a6 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:46:41 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Updating instance_info_cache with network_info: [{"id": "042c5347-d89a-43b4-9ad0-599397295c03", "address": "fa:16:3e:7a:51:0d", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042c5347-d8", "ovs_interfaceid": "042c5347-d89a-43b4-9ad0-599397295c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:46:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:46:41 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:46:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:42 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:46:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:46:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:48 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:46:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:46:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:46:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:46:50 user nova-compute[72874]: INFO nova.compute.claims [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Claim successful on node user
Aug 17 18:46:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:46:51 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:46:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG nova.policy [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04b47a0411fa4642bfc5aa08f48919c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8e6936f2004a5cbb90e1e26f3ec28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:46:51 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Creating image(s)
Aug 17 18:46:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "/opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "/opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.189s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk 1073741824" returned: 0 in 0.047s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:52 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:46:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:46:52 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Successfully created port: f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:46:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:46:52 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Cannot resize image /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:46:52 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'migration_context' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:46:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:46:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Ensure instance console log exists: /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:46:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Successfully updated port: f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquired lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-f64689bc-b750-406d-98de-0949dbcebe3f req-3645f9b9-e9d3-42d1-89d5-e6c5bee829a8 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received event network-changed-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-f64689bc-b750-406d-98de-0949dbcebe3f req-3645f9b9-e9d3-42d1-89d5-e6c5bee829a8 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Refreshing instance network info cache due to event network-changed-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f64689bc-b750-406d-98de-0949dbcebe3f req-3645f9b9-e9d3-42d1-89d5-e6c5bee829a8 service nova] Acquiring lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updating instance_info_cache with network_info: [{"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Releasing lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Instance network_info: |[{"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f64689bc-b750-406d-98de-0949dbcebe3f req-3645f9b9-e9d3-42d1-89d5-e6c5bee829a8 service nova] Acquired lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.network.neutron [req-f64689bc-b750-406d-98de-0949dbcebe3f req-3645f9b9-e9d3-42d1-89d5-e6c5bee829a8 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Refreshing network info cache for port f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Start _get_guest_xml network_info=[{"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:46:53 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:46:53 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1371027525',display_name='tempest-AttachVolumeTestJSON-server-1371027525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1371027525',id=43,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdYfs/sLUHWSa/zvMpaUBe7Xc8Lp+dlZ+f30CtjbQ0OE5px5SGs8/VJAlNvxluJTvxKRCJtg4fLA7lBgSn8v6Si0I44hT1DD+ksfJGKy/yMOfXst7dOgevQ5DBh7zmIPw==',key_name='tempest-keypair-1286931965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d8e6936f2004a5cbb90e1e26f3ec28d',ramdisk_id='',reservation_id='r-7syakzfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-385757460',owner_user_name='tempest-AttachVolumeTestJSON-385757460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:46:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b47a0411fa4642bfc5aa08f48919c9',uuid=5a26e8ee-a875-4eb7-b924-c5c8962263b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converting VIF {"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:46:53 user nova-compute[72874]:   <uuid>5a26e8ee-a875-4eb7-b924-c5c8962263b1</uuid>
Aug 17 18:46:53 user nova-compute[72874]:   <name>instance-0000002b</name>
Aug 17 18:46:53 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:46:53 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:46:53 user nova-compute[72874]:   <metadata>
Aug 17 18:46:53 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:46:53 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:46:53 user nova-compute[72874]:       <nova:name>tempest-AttachVolumeTestJSON-server-1371027525</nova:name>
Aug 17 18:46:53 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:46:53</nova:creationTime>
Aug 17 18:46:53 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:46:53 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:46:53 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:46:53 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:46:53 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:46:53 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:46:53 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:46:53 user nova-compute[72874]:       <nova:owner>
Aug 17 18:46:53 user nova-compute[72874]:         <nova:user uuid="04b47a0411fa4642bfc5aa08f48919c9">tempest-AttachVolumeTestJSON-385757460-project-member</nova:user>
Aug 17 18:46:53 user nova-compute[72874]:         <nova:project uuid="4d8e6936f2004a5cbb90e1e26f3ec28d">tempest-AttachVolumeTestJSON-385757460</nova:project>
Aug 17 18:46:53 user nova-compute[72874]:       </nova:owner>
Aug 17 18:46:53 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:46:53 user nova-compute[72874]:       <nova:ports>
Aug 17 18:46:53 user nova-compute[72874]:         <nova:port uuid="f8cb8b2c-5fed-45a5-a03e-865b8bfcea41">
Aug 17 18:46:53 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 18:46:53 user nova-compute[72874]:         </nova:port>
Aug 17 18:46:53 user nova-compute[72874]:       </nova:ports>
Aug 17 18:46:53 user nova-compute[72874]:     </nova:instance>
Aug 17 18:46:53 user nova-compute[72874]:   </metadata>
Aug 17 18:46:53 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:46:53 user nova-compute[72874]:     <system>
Aug 17 18:46:53 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:46:53 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:46:53 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:46:53 user nova-compute[72874]:       <entry name="serial">5a26e8ee-a875-4eb7-b924-c5c8962263b1</entry>
Aug 17 18:46:53 user nova-compute[72874]:       <entry name="uuid">5a26e8ee-a875-4eb7-b924-c5c8962263b1</entry>
Aug 17 18:46:53 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:46:53 user nova-compute[72874]:     </system>
Aug 17 18:46:53 user nova-compute[72874]:   </sysinfo>
Aug 17 18:46:53 user nova-compute[72874]:   <os>
Aug 17 18:46:53 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:46:53 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:46:53 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:46:53 user nova-compute[72874]:   </os>
Aug 17 18:46:53 user nova-compute[72874]:   <features>
Aug 17 18:46:53 user nova-compute[72874]:     <acpi/>
Aug 17 18:46:53 user nova-compute[72874]:     <apic/>
Aug 17 18:46:53 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:46:53 user nova-compute[72874]:   </features>
Aug 17 18:46:53 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:46:53 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:46:53 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:46:53 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:46:53 user nova-compute[72874]:   </clock>
Aug 17 18:46:53 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:46:53 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:46:53 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:46:53 user nova-compute[72874]:   </cpu>
Aug 17 18:46:53 user nova-compute[72874]:   <devices>
Aug 17 18:46:53 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:46:53 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:46:53 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk"/>
Aug 17 18:46:53 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:46:53 user nova-compute[72874]:     </disk>
Aug 17 18:46:53 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:46:53 user nova-compute[72874]:       <mac address="fa:16:3e:24:1d:06"/>
Aug 17 18:46:53 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:46:53 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:46:53 user nova-compute[72874]:       <target dev="tapf8cb8b2c-5f"/>
Aug 17 18:46:53 user nova-compute[72874]:     </interface>
Aug 17 18:46:53 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:46:53 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/console.log" append="off"/>
Aug 17 18:46:53 user nova-compute[72874]:     </serial>
Aug 17 18:46:53 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:46:53 user nova-compute[72874]:     <video>
Aug 17 18:46:53 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:46:53 user nova-compute[72874]:     </video>
Aug 17 18:46:53 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:46:53 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:46:53 user nova-compute[72874]:     </rng>
Aug 17 18:46:53 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:46:53 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:46:53 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:46:53 user nova-compute[72874]:     </memballoon>
Aug 17 18:46:53 user nova-compute[72874]:   </devices>
Aug 17 18:46:53 user nova-compute[72874]: </domain>
Aug 17 18:46:53 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1371027525',display_name='tempest-AttachVolumeTestJSON-server-1371027525',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1371027525',id=43,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdYfs/sLUHWSa/zvMpaUBe7Xc8Lp+dlZ+f30CtjbQ0OE5px5SGs8/VJAlNvxluJTvxKRCJtg4fLA7lBgSn8v6Si0I44hT1DD+ksfJGKy/yMOfXst7dOgevQ5DBh7zmIPw==',key_name='tempest-keypair-1286931965',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d8e6936f2004a5cbb90e1e26f3ec28d',ramdisk_id='',reservation_id='r-7syakzfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-385757460',owner_user_name='tempest-AttachVolumeTestJSON-385757460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:46:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b47a0411fa4642bfc5aa08f48919c9',uuid=5a26e8ee-a875-4eb7-b924-c5c8962263b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converting VIF {"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG os_vif [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8cb8b2c-5f, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf8cb8b2c-5f, col_values=(('external_ids', {'iface-id': 'f8cb8b2c-5fed-45a5-a03e-865b8bfcea41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:1d:06', 'vm-uuid': '5a26e8ee-a875-4eb7-b924-c5c8962263b1'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:53 user nova-compute[72874]: INFO os_vif [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f')
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:46:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] No VIF found with MAC fa:16:3e:24:1d:06, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:46:54 user nova-compute[72874]: DEBUG nova.network.neutron [req-f64689bc-b750-406d-98de-0949dbcebe3f req-3645f9b9-e9d3-42d1-89d5-e6c5bee829a8 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updated VIF entry in instance network info cache for port f8cb8b2c-5fed-45a5-a03e-865b8bfcea41. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:46:54 user nova-compute[72874]: DEBUG nova.network.neutron [req-f64689bc-b750-406d-98de-0949dbcebe3f req-3645f9b9-e9d3-42d1-89d5-e6c5bee829a8 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updating instance_info_cache with network_info: [{"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:46:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f64689bc-b750-406d-98de-0949dbcebe3f req-3645f9b9-e9d3-42d1-89d5-e6c5bee829a8 service nova] Releasing lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:46:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-92e79340-516b-4950-a6ce-c681ad4d07e4 req-727cbc37-8806-42e6-ab6f-f0ddc5d3974b service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:46:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-92e79340-516b-4950-a6ce-c681ad4d07e4 req-727cbc37-8806-42e6-ab6f-f0ddc5d3974b service nova] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-92e79340-516b-4950-a6ce-c681ad4d07e4 req-727cbc37-8806-42e6-ab6f-f0ddc5d3974b service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-92e79340-516b-4950-a6ce-c681ad4d07e4 req-727cbc37-8806-42e6-ab6f-f0ddc5d3974b service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-92e79340-516b-4950-a6ce-c681ad4d07e4 req-727cbc37-8806-42e6-ab6f-f0ddc5d3974b service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] No waiting events found dispatching network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:46:55 user nova-compute[72874]: WARNING nova.compute.manager [req-92e79340-516b-4950-a6ce-c681ad4d07e4 req-727cbc37-8806-42e6-ab6f-f0ddc5d3974b service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received unexpected event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 for instance with vm_state building and task_state spawning.
Aug 17 18:46:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692298017.1197202, 5a26e8ee-a875-4eb7-b924-c5c8962263b1 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:46:57 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] VM Resumed (Lifecycle Event)
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-8d029fc1-5412-4ac3-830d-636ad4c86865 req-7f344ec8-7d8e-442f-9aa3-ba96bacb08f4 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:46:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8d029fc1-5412-4ac3-830d-636ad4c86865 req-7f344ec8-7d8e-442f-9aa3-ba96bacb08f4 service nova] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:46:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8d029fc1-5412-4ac3-830d-636ad4c86865 req-7f344ec8-7d8e-442f-9aa3-ba96bacb08f4 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:46:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8d029fc1-5412-4ac3-830d-636ad4c86865 req-7f344ec8-7d8e-442f-9aa3-ba96bacb08f4 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.compute.manager [req-8d029fc1-5412-4ac3-830d-636ad4c86865 req-7f344ec8-7d8e-442f-9aa3-ba96bacb08f4 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] No waiting events found dispatching network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:46:57 user nova-compute[72874]: WARNING nova.compute.manager [req-8d029fc1-5412-4ac3-830d-636ad4c86865 req-7f344ec8-7d8e-442f-9aa3-ba96bacb08f4 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received unexpected event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 for instance with vm_state building and task_state spawning.
Aug 17 18:46:57 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Instance spawned successfully.
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:46:57 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692298017.1218472, 5a26e8ee-a875-4eb7-b924-c5c8962263b1 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:46:57 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] VM Started (Lifecycle Event)
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:46:57 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:46:57 user nova-compute[72874]: INFO nova.compute.manager [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 17 18:46:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:46:57 user nova-compute[72874]: INFO nova.compute.manager [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Took 6.46 seconds to build instance.
Aug 17 18:46:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16aad901-f206-4cdb-a335-a28ec0fe70cf tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.568s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:46:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:31 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:47:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:47:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:47:31 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:47:31 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:47:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:47:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:47:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:47:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:47:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:47:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:47:31 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:47:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:47:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:47:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:47:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:47:32 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:47:32 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:47:32 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:47:32 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8526MB free_disk=25.092464447021484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:47:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:47:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:47:32 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance a3b3069b-a81b-4820-9fa2-c86e7361d8a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:47:32 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:47:32 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 5a26e8ee-a875-4eb7-b924-c5c8962263b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:47:32 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:47:32 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:47:33 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:47:33 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:47:33 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:47:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.263s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:47:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:34 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:47:34 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:47:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:40 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:47:40 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:47:40 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:47:42 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:47:42 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:47:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:47:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-4fff1e38-fe0a-41e0-82ce-a2657a8bd598" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:47:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-4fff1e38-fe0a-41e0-82ce-a2657a8bd598" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:47:42 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:47:42 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Updating instance_info_cache with network_info: [{"id": "28eef906-87af-40e8-b07f-80dadce3ef2d", "address": "fa:16:3e:dd:5d:a0", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28eef906-87", "ovs_interfaceid": "28eef906-87af-40e8-b07f-80dadce3ef2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:47:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-4fff1e38-fe0a-41e0-82ce-a2657a8bd598" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:47:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:47:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:47:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:47:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:47:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:47:50 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:47:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 18:47:50 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:47:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:47:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:47:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:47:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:47:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:47:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:47:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:47:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-e54abff5-1184-4584-bfbb-8488fbf8de70 req-60479126-1f69-4db4-8d86-f36dccb4654a service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received event network-changed-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:47:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-e54abff5-1184-4584-bfbb-8488fbf8de70 req-60479126-1f69-4db4-8d86-f36dccb4654a service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Refreshing instance network info cache due to event network-changed-28eef906-87af-40e8-b07f-80dadce3ef2d. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:47:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e54abff5-1184-4584-bfbb-8488fbf8de70 req-60479126-1f69-4db4-8d86-f36dccb4654a service nova] Acquiring lock "refresh_cache-4fff1e38-fe0a-41e0-82ce-a2657a8bd598" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:47:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e54abff5-1184-4584-bfbb-8488fbf8de70 req-60479126-1f69-4db4-8d86-f36dccb4654a service nova] Acquired lock "refresh_cache-4fff1e38-fe0a-41e0-82ce-a2657a8bd598" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:47:58 user nova-compute[72874]: DEBUG nova.network.neutron [req-e54abff5-1184-4584-bfbb-8488fbf8de70 req-60479126-1f69-4db4-8d86-f36dccb4654a service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Refreshing network info cache for port 28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG nova.objects.instance [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lazy-loading 'flavor' on Instance uuid 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG nova.network.neutron [req-e54abff5-1184-4584-bfbb-8488fbf8de70 req-60479126-1f69-4db4-8d86-f36dccb4654a service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Updated VIF entry in instance network info cache for port 28eef906-87af-40e8-b07f-80dadce3ef2d. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG nova.network.neutron [req-e54abff5-1184-4584-bfbb-8488fbf8de70 req-60479126-1f69-4db4-8d86-f36dccb4654a service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Updating instance_info_cache with network_info: [{"id": "28eef906-87af-40e8-b07f-80dadce3ef2d", "address": "fa:16:3e:dd:5d:a0", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28eef906-87", "ovs_interfaceid": "28eef906-87af-40e8-b07f-80dadce3ef2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e54abff5-1184-4584-bfbb-8488fbf8de70 req-60479126-1f69-4db4-8d86-f36dccb4654a service nova] Releasing lock "refresh_cache-4fff1e38-fe0a-41e0-82ce-a2657a8bd598" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:47:59 user nova-compute[72874]: INFO nova.compute.manager [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Attaching volume d0754a8d-d18f-4b1c-87d1-837a29654525 to /dev/vdb
Aug 17 18:47:59 user nova-compute[72874]: DEBUG os_brick.utils [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa08856-2a68-482c-a6e6-cb6a22a8179a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3a84ee-3282-47ca-823a-3c9d09593e53]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4420474c-ed3e-4a42-b699-ca9be74c25fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e9756e-1079-46a9-8523-fa5aad4a1fbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:47:59 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:47:59 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fda85de-e4bc-4ad1-a8ca-3d279e4d6707]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG os_brick.utils [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:47:59 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Updating existing volume attachment record: 187e19d8-7f64-4719-9801-a499965b1159 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:48:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:48:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 18:48:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] There are 0 instances to clean {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 18:48:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPmcMgwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:48:09 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:48:09 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:48:09 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d1d8ed-7087-49b0-8c3a-61170c9cddfe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:48:09 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31b08ca-1c17-4c9f-a150-68933fd243c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525] added
Aug 17 18:48:09 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[584d449c-083e-4c39-92f2-bd73b9544daf]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c5b52c-62d4-4ce5-920d-dfd9189f3446]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SPmcMgwo {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SPmcMgwo" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08e7dd5-f9da-4c97-ab16-0a598336335e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SPmcMgwo'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[024f6058-c699-4806-a57e-df527ea137cf]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15981e3-271b-49d6-b479-8cbb1e1ebeed]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 18:48:09 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 18:48:09 user nova-compute[72874]:  {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:48:09 user nova-compute[72874]: WARNING os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 18:48:09 user nova-compute[72874]: 
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf273179-1a8b-4c6d-a755-14a7188f9e81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525, portal: 172.16.0.220,3260]
Aug 17 18:48:09 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525, portal: 172.16.0.220,3260] successful.
Aug 17 18:48:09 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0e848b-5d9a-497d-b3e3-7da41ff16716]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[559659ba-0b21-41f4-b9a9-8014ba4c5c2c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 (non-flash)
Aug 17 18:48:09 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 (non-flash)
Aug 17 18:48:09 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.233s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4c4621-1eb7-4c44-8c62-1cfdab38be30]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:48:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPmcMgwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:48:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.270s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:48:10 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23866663961343964', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:48:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866663961343964', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:48:10 user nova-compute[72874]: DEBUG nova.objects.instance [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lazy-loading 'flavor' on Instance uuid 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:48:10 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:48:10 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:48:10 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 18:48:10 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:48:10 user nova-compute[72874]:   <serial>d0754a8d-d18f-4b1c-87d1-837a29654525</serial>
Aug 17 18:48:10 user nova-compute[72874]: </disk>
Aug 17 18:48:10 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:48:11 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:48:11 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:48:11 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] No VIF found with MAC fa:16:3e:dd:5d:a0, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:48:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-f815215c-c208-49c9-b1e0-06bc0aba2ef1 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.134s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:48:13 user nova-compute[72874]: INFO nova.compute.manager [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Detaching volume d0754a8d-d18f-4b1c-87d1-837a29654525
Aug 17 18:48:13 user nova-compute[72874]: INFO nova.virt.block_device [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Attempting to driver detach volume d0754a8d-d18f-4b1c-87d1-837a29654525 from mountpoint /dev/vdb
Aug 17 18:48:13 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Attempting to detach device vdb from instance 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:48:13 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:48:13 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 18:48:13 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:48:13 user nova-compute[72874]:   <serial>d0754a8d-d18f-4b1c-87d1-837a29654525</serial>
Aug 17 18:48:13 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:48:13 user nova-compute[72874]: </disk>
Aug 17 18:48:13 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:48:13 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Successfully detached device vdb from instance 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 from the persistent domain config.
Aug 17 18:48:13 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:48:13 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:48:13 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 18:48:13 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:48:13 user nova-compute[72874]:   <serial>d0754a8d-d18f-4b1c-87d1-837a29654525</serial>
Aug 17 18:48:13 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:48:13 user nova-compute[72874]: </disk>
Aug 17 18:48:13 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692298093.8489685, 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:48:13 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Successfully detached device vdb from instance 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 from the live domain config.
Aug 17 18:48:13 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SPmcMgwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:48:13 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:48:13 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a970af-a8b6-43a3-bcb2-496a4b749fc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[481b59f0-8cff-4e41-900c-a389f4c9b8b5]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 (non-flash)
Aug 17 18:48:13 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 (non-flash)
Aug 17 18:48:13 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c041c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca276ff-d25d-4f98-b31f-c923df5de29a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[454ba151-a4e3-4e4f-9339-f20771655c7e]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[799f4ed3-720b-48ce-b23d-712dc9042cf0]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:48:13 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7233cc53-d555-4e94-8df6-ea72335d6c6d]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2564c7-740c-4bb0-9cbf-850ba128e34e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab28cea9-1bbf-489a-a397-a42a13312a5a]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525, portal: 172.16.0.220,3260]
Aug 17 18:48:14 user nova-compute[72874]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525, portal: 172.16.0.220,3260] successful.
Aug 17 18:48:14 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0754a8d-d18f-4b1c-87d1-837a29654525 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb2065a-a794-4c8a-9661-b586dc6f3d6c]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] <== disconnect_volume: return (258ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lazy-loading 'flavor' on Instance uuid 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:48:14 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16b921e9-cd7a-425e-a860-dbf25f6df669 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.623s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:48:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:48:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:48:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:48:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:48:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:33 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:48:33 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:48:33 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:48:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:48:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:48:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:48:33 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:48:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:34 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:48:34 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:48:34 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8622MB free_disk=25.082733154296875GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:48:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:48:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:48:35 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance a3b3069b-a81b-4820-9fa2-c86e7361d8a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:48:35 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:48:35 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 5a26e8ee-a875-4eb7-b924-c5c8962263b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:48:35 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:48:35 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:48:35 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing inventories for resource provider b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 18:48:35 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Updating ProviderTree inventory for provider b677d836-b01b-4674-8972-53d526f1b5f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 18:48:35 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Updating inventory in ProviderTree for provider b677d836-b01b-4674-8972-53d526f1b5f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 18:48:35 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing aggregate associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, aggregates: None {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 18:48:35 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing trait associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, traits: HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 18:48:35 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:48:35 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:48:35 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:48:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.523s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:48:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:48:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:48:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:48:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:48:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-aea020ba-8e4b-49a8-803d-b7fabbb35911 req-f567f3ea-0ad5-4d85-94aa-54e1f8ebcb59 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received event network-changed-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:48:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-aea020ba-8e4b-49a8-803d-b7fabbb35911 req-f567f3ea-0ad5-4d85-94aa-54e1f8ebcb59 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Refreshing instance network info cache due to event network-changed-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:48:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-aea020ba-8e4b-49a8-803d-b7fabbb35911 req-f567f3ea-0ad5-4d85-94aa-54e1f8ebcb59 service nova] Acquiring lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:48:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-aea020ba-8e4b-49a8-803d-b7fabbb35911 req-f567f3ea-0ad5-4d85-94aa-54e1f8ebcb59 service nova] Acquired lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:48:42 user nova-compute[72874]: DEBUG nova.network.neutron [req-aea020ba-8e4b-49a8-803d-b7fabbb35911 req-f567f3ea-0ad5-4d85-94aa-54e1f8ebcb59 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Refreshing network info cache for port f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:48:42 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:48:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:48:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:48:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:48:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:48:42 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:48:42 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid a3b3069b-a81b-4820-9fa2-c86e7361d8a6 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:48:42 user nova-compute[72874]: DEBUG nova.network.neutron [req-aea020ba-8e4b-49a8-803d-b7fabbb35911 req-f567f3ea-0ad5-4d85-94aa-54e1f8ebcb59 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updated VIF entry in instance network info cache for port f8cb8b2c-5fed-45a5-a03e-865b8bfcea41. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:48:42 user nova-compute[72874]: DEBUG nova.network.neutron [req-aea020ba-8e4b-49a8-803d-b7fabbb35911 req-f567f3ea-0ad5-4d85-94aa-54e1f8ebcb59 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updating instance_info_cache with network_info: [{"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:48:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-aea020ba-8e4b-49a8-803d-b7fabbb35911 req-f567f3ea-0ad5-4d85-94aa-54e1f8ebcb59 service nova] Releasing lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:48:43 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Updating instance_info_cache with network_info: [{"id": "042c5347-d89a-43b4-9ad0-599397295c03", "address": "fa:16:3e:7a:51:0d", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042c5347-d8", "ovs_interfaceid": "042c5347-d89a-43b4-9ad0-599397295c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:48:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:48:43 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:48:43 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:48:43 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:48:43 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:48:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:43 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG nova.objects.instance [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'flavor' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:48:46 user nova-compute[72874]: INFO nova.compute.manager [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Attaching volume 77890318-fc21-49dc-9e95-443be10c69c7 to /dev/vdb
Aug 17 18:48:46 user nova-compute[72874]: DEBUG os_brick.utils [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e2f57a-56a9-474f-91ad-eb769d894c70]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b3a4d5-3b40-4733-9049-6b082b26ff63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdb5bc3-24ba-4e95-9dd7-29ab181e9d77]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[30546035-fd1c-4f27-8339-0399039f7661]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:48:46 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:48:46 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1213b63f-c4a3-4584-b3b8-bc87c6d0db19]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG os_brick.utils [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:48:46 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updating existing volume attachment record: f263e8b3-4124-45c5-96db-1979b2e131e8 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:48:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:48:50 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:48:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:48:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzrZJEoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:48:56 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:48:56 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:48:56 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e1a1f9-ace6-4645-9ddd-0f9ab0a7bca4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:48:56 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1d8e91-3845-4ce4-993f-c602a48492b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7] added
Aug 17 18:48:56 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7771d0a8-537f-4465-be3c-e3e2ae1731cd]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7cfdc7-9dc8-4592-b03e-82bd8d6e2ecd]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WzrZJEoK {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WzrZJEoK" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b91334-fa38-4a1d-9985-bdab1c93f120]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WzrZJEoK'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3366c09d-ad8c-493a-93ca-4f02c3d2f5aa]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6306197-6d18-4500-bd2d-b4222ed02758]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 18:48:56 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 18:48:56 user nova-compute[72874]:  {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:48:56 user nova-compute[72874]: WARNING os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 18:48:56 user nova-compute[72874]: 
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3196029b-78d0-49c4-a08a-ace1d66dd97e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7, portal: 172.16.0.220,3260]
Aug 17 18:48:56 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7, portal: 172.16.0.220,3260] successful.
Aug 17 18:48:56 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f34295c-f2a3-4a7d-9cee-9f01075d4bcb]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcda2a2-6033-4481-9394-7b81f71ecc8a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)
Aug 17 18:48:56 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)
Aug 17 18:48:56 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6a1257-7c42-448d-bc1f-007235384ea5]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:48:56 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzrZJEoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:48:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.269s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:48:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23536303538623433', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:48:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536303538623433', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:48:57 user nova-compute[72874]: DEBUG nova.objects.instance [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'flavor' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:48:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:48:57 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:48:57 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 18:48:57 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:48:57 user nova-compute[72874]:   <serial>77890318-fc21-49dc-9e95-443be10c69c7</serial>
Aug 17 18:48:57 user nova-compute[72874]: </disk>
Aug 17 18:48:57 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:48:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:48:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:48:58 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] No VIF found with MAC fa:16:3e:24:1d:06, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:48:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-86057cba-79a4-488a-a266-c052156cf063 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.037s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:48:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:48:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:48:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:48:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:48:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-27a91253-66b9-4f52-a875-2a11f7768a7e tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:48:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-27a91253-66b9-4f52-a875-2a11f7768a7e tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:48:59 user nova-compute[72874]: DEBUG nova.compute.manager [None req-27a91253-66b9-4f52-a875-2a11f7768a7e tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:48:59 user nova-compute[72874]: DEBUG nova.compute.manager [None req-27a91253-66b9-4f52-a875-2a11f7768a7e tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72874) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 18:48:59 user nova-compute[72874]: DEBUG nova.objects.instance [None req-27a91253-66b9-4f52-a875-2a11f7768a7e tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'flavor' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:48:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:48:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-ef4b94b3-76b5-4bf6-8b27-5f37ee3d9f9d req-58ba1007-470b-4c4d-92fd-542204afd7f3 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received event network-vif-unplugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:48:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ef4b94b3-76b5-4bf6-8b27-5f37ee3d9f9d req-58ba1007-470b-4c4d-92fd-542204afd7f3 service nova] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:48:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ef4b94b3-76b5-4bf6-8b27-5f37ee3d9f9d req-58ba1007-470b-4c4d-92fd-542204afd7f3 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:48:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ef4b94b3-76b5-4bf6-8b27-5f37ee3d9f9d req-58ba1007-470b-4c4d-92fd-542204afd7f3 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:48:59 user nova-compute[72874]: DEBUG nova.compute.manager [req-ef4b94b3-76b5-4bf6-8b27-5f37ee3d9f9d req-58ba1007-470b-4c4d-92fd-542204afd7f3 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] No waiting events found dispatching network-vif-unplugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:48:59 user nova-compute[72874]: WARNING nova.compute.manager [req-ef4b94b3-76b5-4bf6-8b27-5f37ee3d9f9d req-58ba1007-470b-4c4d-92fd-542204afd7f3 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received unexpected event network-vif-unplugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 for instance with vm_state active and task_state powering-off.
Aug 17 18:48:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:00 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Instance destroyed successfully.
Aug 17 18:49:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-27a91253-66b9-4f52-a875-2a11f7768a7e tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:49:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-27a91253-66b9-4f52-a875-2a11f7768a7e tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.846s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:49:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-9abcfbd1-e0bc-4d51-8d6e-4ee7a4165686 req-d667c3c6-112d-49a7-b9c5-3ca16b4e41b5 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:49:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9abcfbd1-e0bc-4d51-8d6e-4ee7a4165686 req-d667c3c6-112d-49a7-b9c5-3ca16b4e41b5 service nova] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:49:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9abcfbd1-e0bc-4d51-8d6e-4ee7a4165686 req-d667c3c6-112d-49a7-b9c5-3ca16b4e41b5 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:49:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9abcfbd1-e0bc-4d51-8d6e-4ee7a4165686 req-d667c3c6-112d-49a7-b9c5-3ca16b4e41b5 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:49:01 user nova-compute[72874]: DEBUG nova.compute.manager [req-9abcfbd1-e0bc-4d51-8d6e-4ee7a4165686 req-d667c3c6-112d-49a7-b9c5-3ca16b4e41b5 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] No waiting events found dispatching network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:49:01 user nova-compute[72874]: WARNING nova.compute.manager [req-9abcfbd1-e0bc-4d51-8d6e-4ee7a4165686 req-d667c3c6-112d-49a7-b9c5-3ca16b4e41b5 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received unexpected event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 for instance with vm_state stopped and task_state None.
Aug 17 18:49:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG nova.compute.manager [req-1f53778a-bbfd-46f0-ae4b-0c22fa9d014a req-ac4d1384-3c29-430e-b7a1-dc7b212b53ea service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received event network-changed-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG nova.compute.manager [req-1f53778a-bbfd-46f0-ae4b-0c22fa9d014a req-ac4d1384-3c29-430e-b7a1-dc7b212b53ea service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Refreshing instance network info cache due to event network-changed-28eef906-87af-40e8-b07f-80dadce3ef2d. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1f53778a-bbfd-46f0-ae4b-0c22fa9d014a req-ac4d1384-3c29-430e-b7a1-dc7b212b53ea service nova] Acquiring lock "refresh_cache-4fff1e38-fe0a-41e0-82ce-a2657a8bd598" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1f53778a-bbfd-46f0-ae4b-0c22fa9d014a req-ac4d1384-3c29-430e-b7a1-dc7b212b53ea service nova] Acquired lock "refresh_cache-4fff1e38-fe0a-41e0-82ce-a2657a8bd598" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG nova.network.neutron [req-1f53778a-bbfd-46f0-ae4b-0c22fa9d014a req-ac4d1384-3c29-430e-b7a1-dc7b212b53ea service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Refreshing network info cache for port 28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:49:04 user nova-compute[72874]: INFO nova.compute.manager [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Terminating instance
Aug 17 18:49:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG nova.compute.manager [req-48efd030-5c1b-40b7-8f57-ba39d67d93d8 req-70699369-3c40-4468-be21-0a9c8ed5b6de service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received event network-vif-unplugged-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-48efd030-5c1b-40b7-8f57-ba39d67d93d8 req-70699369-3c40-4468-be21-0a9c8ed5b6de service nova] Acquiring lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-48efd030-5c1b-40b7-8f57-ba39d67d93d8 req-70699369-3c40-4468-be21-0a9c8ed5b6de service nova] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-48efd030-5c1b-40b7-8f57-ba39d67d93d8 req-70699369-3c40-4468-be21-0a9c8ed5b6de service nova] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG nova.compute.manager [req-48efd030-5c1b-40b7-8f57-ba39d67d93d8 req-70699369-3c40-4468-be21-0a9c8ed5b6de service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] No waiting events found dispatching network-vif-unplugged-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG nova.compute.manager [req-48efd030-5c1b-40b7-8f57-ba39d67d93d8 req-70699369-3c40-4468-be21-0a9c8ed5b6de service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received event network-vif-unplugged-28eef906-87af-40e8-b07f-80dadce3ef2d for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG nova.network.neutron [req-1f53778a-bbfd-46f0-ae4b-0c22fa9d014a req-ac4d1384-3c29-430e-b7a1-dc7b212b53ea service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Updated VIF entry in instance network info cache for port 28eef906-87af-40e8-b07f-80dadce3ef2d. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG nova.network.neutron [req-1f53778a-bbfd-46f0-ae4b-0c22fa9d014a req-ac4d1384-3c29-430e-b7a1-dc7b212b53ea service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Updating instance_info_cache with network_info: [{"id": "28eef906-87af-40e8-b07f-80dadce3ef2d", "address": "fa:16:3e:dd:5d:a0", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28eef906-87", "ovs_interfaceid": "28eef906-87af-40e8-b07f-80dadce3ef2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1f53778a-bbfd-46f0-ae4b-0c22fa9d014a req-ac4d1384-3c29-430e-b7a1-dc7b212b53ea service nova] Releasing lock "refresh_cache-4fff1e38-fe0a-41e0-82ce-a2657a8bd598" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:04 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Instance destroyed successfully.
Aug 17 18:49:04 user nova-compute[72874]: DEBUG nova.objects.instance [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lazy-loading 'resources' on Instance uuid 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:46:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-481536443',display_name='tempest-TestStampPattern-server-481536443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-481536443',id=42,image_ref='cc105af2-598b-4add-96d6-e16046364f8d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqhsRm9d1hAMSVz4vVR/PRgiZqjbXEj4l6p6aJ986tXYCYQVHYhbILnl0Ackxz/vvYoRWCnZ4khK5jTOhMQdsdT0QSQXnRiZkts9kxWBDFdSV7ZIWMf6h9Yk2mJ+vjM0w==',key_name='tempest-TestStampPattern-902745170',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:46:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15562548cd9d4848a2a0a4f99e04f11e',ramdisk_id='',reservation_id='r-ijlkzojv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a3b3069b-a81b-4820-9fa2-c86e7361d8a6',image_min_disk='1',image_min_ram='0',image_owner_id='15562548cd9d4848a2a0a4f99e04f11e',image_owner_project_name='tempest-TestStampPattern-221411575',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-221411575-project-member',image_user_id='538b882b4c794d9496b2bee673cfd239',owner_project_name='tempest-TestStampPattern-221411575',owner_user_name='tempest-TestStampPattern-221411575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:46:12Z,user_data=None,user_id='538b882b4c794d9496b2bee673cfd239',uuid=4fff1e38-fe0a-41e0-82ce-a2657a8bd598,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28eef906-87af-40e8-b07f-80dadce3ef2d", "address": "fa:16:3e:dd:5d:a0", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28eef906-87", "ovs_interfaceid": "28eef906-87af-40e8-b07f-80dadce3ef2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Converting VIF {"id": "28eef906-87af-40e8-b07f-80dadce3ef2d", "address": "fa:16:3e:dd:5d:a0", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28eef906-87", "ovs_interfaceid": "28eef906-87af-40e8-b07f-80dadce3ef2d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:5d:a0,bridge_name='br-int',has_traffic_filtering=True,id=28eef906-87af-40e8-b07f-80dadce3ef2d,network=Network(7ccf040b-9956-46c7-bf3f-52c6d0356865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28eef906-87') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG os_vif [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:5d:a0,bridge_name='br-int',has_traffic_filtering=True,id=28eef906-87af-40e8-b07f-80dadce3ef2d,network=Network(7ccf040b-9956-46c7-bf3f-52c6d0356865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28eef906-87') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28eef906-87, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:49:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:04 user nova-compute[72874]: INFO os_vif [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:5d:a0,bridge_name='br-int',has_traffic_filtering=True,id=28eef906-87af-40e8-b07f-80dadce3ef2d,network=Network(7ccf040b-9956-46c7-bf3f-52c6d0356865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28eef906-87')
Aug 17 18:49:04 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Deleting instance files /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598_del
Aug 17 18:49:04 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Deletion of /opt/stack/data/nova/instances/4fff1e38-fe0a-41e0-82ce-a2657a8bd598_del complete
Aug 17 18:49:05 user nova-compute[72874]: INFO nova.compute.manager [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 17 18:49:05 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:49:05 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:49:05 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:49:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:05 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:49:05 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Took 0.58 seconds to deallocate network for instance.
Aug 17 18:49:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:49:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:49:05 user nova-compute[72874]: DEBUG nova.compute.manager [req-c94a5747-f4e3-4fb3-bda0-2e0f17e0f9ed req-c4fc64ba-6331-4360-b4f2-9f6a07278cf5 service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received event network-vif-deleted-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:49:05 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:49:05 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:49:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:49:05 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Deleted allocations for instance 4fff1e38-fe0a-41e0-82ce-a2657a8bd598
Aug 17 18:49:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1722478c-2d97-46dd-9b39-571b3a647907 tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.807s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received event network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] Acquiring lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] No waiting events found dispatching network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:49:06 user nova-compute[72874]: WARNING nova.compute.manager [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received unexpected event network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d for instance with vm_state deleted and task_state None.
Aug 17 18:49:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received event network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] Acquiring lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] No waiting events found dispatching network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:49:06 user nova-compute[72874]: WARNING nova.compute.manager [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received unexpected event network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d for instance with vm_state deleted and task_state None.
Aug 17 18:49:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received event network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] Acquiring lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] No waiting events found dispatching network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:49:06 user nova-compute[72874]: WARNING nova.compute.manager [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received unexpected event network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d for instance with vm_state deleted and task_state None.
Aug 17 18:49:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received event network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] Acquiring lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] Lock "4fff1e38-fe0a-41e0-82ce-a2657a8bd598-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:49:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] No waiting events found dispatching network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:49:06 user nova-compute[72874]: WARNING nova.compute.manager [req-53daa8b0-d28a-4641-9c68-380591f94454 req-5d6cb2a4-9054-4ec6-a922-d9ec46cb8e8c service nova] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Received unexpected event network-vif-plugged-28eef906-87af-40e8-b07f-80dadce3ef2d for instance with vm_state deleted and task_state None.
Aug 17 18:49:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:49:15 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692298140.047138, 5a26e8ee-a875-4eb7-b924-c5c8962263b1 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:49:15 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] VM Stopped (Lifecycle Event)
Aug 17 18:49:15 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9d4e5eea-8ecd-48de-8676-0d09c76a6e06 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:49:15 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9d4e5eea-8ecd-48de-8676-0d09c76a6e06 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:49:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:19 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692298144.9003413, 4fff1e38-fe0a-41e0-82ce-a2657a8bd598 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:49:19 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] VM Stopped (Lifecycle Event)
Aug 17 18:49:19 user nova-compute[72874]: DEBUG nova.compute.manager [None req-24d4147c-76e5-46b8-8336-39f939b5ab5b None None] [instance: 4fff1e38-fe0a-41e0-82ce-a2657a8bd598] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:49:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:49:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:49:33 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:49:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:49:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:49:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:49:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:49:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:35 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:49:35 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:49:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:49:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:49:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:49:35 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:49:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:49:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:49:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:49:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:49:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:49:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:49:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:49:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:49:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:49:36 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:49:36 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:49:36 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=25.082721710205078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:49:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:49:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:49:36 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance a3b3069b-a81b-4820-9fa2-c86e7361d8a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:49:36 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 5a26e8ee-a875-4eb7-b924-c5c8962263b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:49:36 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:49:36 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:49:36 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:49:36 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:49:36 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:49:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:49:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:42 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:49:42 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:49:43 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:49:44 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:49:44 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:49:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:49:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:49:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:49:44 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:49:44 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updating instance_info_cache with network_info: [{"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:49:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:49:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:49:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:50 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:49:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:49:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:49:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG nova.compute.manager [req-63e69ff0-f5f9-4fb3-b528-58a51c6bfaaf req-45b5b327-0f05-45a5-8e83-32f884279448 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Received event network-changed-042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG nova.compute.manager [req-63e69ff0-f5f9-4fb3-b528-58a51c6bfaaf req-45b5b327-0f05-45a5-8e83-32f884279448 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Refreshing instance network info cache due to event network-changed-042c5347-d89a-43b4-9ad0-599397295c03. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-63e69ff0-f5f9-4fb3-b528-58a51c6bfaaf req-45b5b327-0f05-45a5-8e83-32f884279448 service nova] Acquiring lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-63e69ff0-f5f9-4fb3-b528-58a51c6bfaaf req-45b5b327-0f05-45a5-8e83-32f884279448 service nova] Acquired lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG nova.network.neutron [req-63e69ff0-f5f9-4fb3-b528-58a51c6bfaaf req-45b5b327-0f05-45a5-8e83-32f884279448 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Refreshing network info cache for port 042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:50:08 user nova-compute[72874]: INFO nova.compute.manager [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Terminating instance
Aug 17 18:50:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG nova.network.neutron [req-63e69ff0-f5f9-4fb3-b528-58a51c6bfaaf req-45b5b327-0f05-45a5-8e83-32f884279448 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Updated VIF entry in instance network info cache for port 042c5347-d89a-43b4-9ad0-599397295c03. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG nova.network.neutron [req-63e69ff0-f5f9-4fb3-b528-58a51c6bfaaf req-45b5b327-0f05-45a5-8e83-32f884279448 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Updating instance_info_cache with network_info: [{"id": "042c5347-d89a-43b4-9ad0-599397295c03", "address": "fa:16:3e:7a:51:0d", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042c5347-d8", "ovs_interfaceid": "042c5347-d89a-43b4-9ad0-599397295c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-63e69ff0-f5f9-4fb3-b528-58a51c6bfaaf req-45b5b327-0f05-45a5-8e83-32f884279448 service nova] Releasing lock "refresh_cache-a3b3069b-a81b-4820-9fa2-c86e7361d8a6" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:08 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Instance destroyed successfully.
Aug 17 18:50:08 user nova-compute[72874]: DEBUG nova.objects.instance [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lazy-loading 'resources' on Instance uuid a3b3069b-a81b-4820-9fa2-c86e7361d8a6 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:42:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-452600302',display_name='tempest-TestStampPattern-server-452600302',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-452600302',id=41,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqhsRm9d1hAMSVz4vVR/PRgiZqjbXEj4l6p6aJ986tXYCYQVHYhbILnl0Ackxz/vvYoRWCnZ4khK5jTOhMQdsdT0QSQXnRiZkts9kxWBDFdSV7ZIWMf6h9Yk2mJ+vjM0w==',key_name='tempest-TestStampPattern-902745170',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:42:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='15562548cd9d4848a2a0a4f99e04f11e',ramdisk_id='',reservation_id='r-0bqi20mo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-221411575',owner_user_name='tempest-TestStampPattern-221411575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:46:04Z,user_data=None,user_id='538b882b4c794d9496b2bee673cfd239',uuid=a3b3069b-a81b-4820-9fa2-c86e7361d8a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "042c5347-d89a-43b4-9ad0-599397295c03", "address": "fa:16:3e:7a:51:0d", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042c5347-d8", "ovs_interfaceid": "042c5347-d89a-43b4-9ad0-599397295c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Converting VIF {"id": "042c5347-d89a-43b4-9ad0-599397295c03", "address": "fa:16:3e:7a:51:0d", "network": {"id": "7ccf040b-9956-46c7-bf3f-52c6d0356865", "bridge": "br-int", "label": "tempest-TestStampPattern-604585000-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "15562548cd9d4848a2a0a4f99e04f11e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap042c5347-d8", "ovs_interfaceid": "042c5347-d89a-43b4-9ad0-599397295c03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:51:0d,bridge_name='br-int',has_traffic_filtering=True,id=042c5347-d89a-43b4-9ad0-599397295c03,network=Network(7ccf040b-9956-46c7-bf3f-52c6d0356865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap042c5347-d8') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG os_vif [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:51:0d,bridge_name='br-int',has_traffic_filtering=True,id=042c5347-d89a-43b4-9ad0-599397295c03,network=Network(7ccf040b-9956-46c7-bf3f-52c6d0356865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap042c5347-d8') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap042c5347-d8, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:50:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:08 user nova-compute[72874]: INFO os_vif [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:51:0d,bridge_name='br-int',has_traffic_filtering=True,id=042c5347-d89a-43b4-9ad0-599397295c03,network=Network(7ccf040b-9956-46c7-bf3f-52c6d0356865),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap042c5347-d8')
Aug 17 18:50:08 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Deleting instance files /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6_del
Aug 17 18:50:08 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Deletion of /opt/stack/data/nova/instances/a3b3069b-a81b-4820-9fa2-c86e7361d8a6_del complete
Aug 17 18:50:09 user nova-compute[72874]: INFO nova.compute.manager [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 18:50:09 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:50:09 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:50:09 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-46027303-2197-432d-8809-67a68e947fd8 req-1ca8965a-d864-48fd-b626-12025843cf8c service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Received event network-vif-unplugged-042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-46027303-2197-432d-8809-67a68e947fd8 req-1ca8965a-d864-48fd-b626-12025843cf8c service nova] Acquiring lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-46027303-2197-432d-8809-67a68e947fd8 req-1ca8965a-d864-48fd-b626-12025843cf8c service nova] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-46027303-2197-432d-8809-67a68e947fd8 req-1ca8965a-d864-48fd-b626-12025843cf8c service nova] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-46027303-2197-432d-8809-67a68e947fd8 req-1ca8965a-d864-48fd-b626-12025843cf8c service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] No waiting events found dispatching network-vif-unplugged-042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-46027303-2197-432d-8809-67a68e947fd8 req-1ca8965a-d864-48fd-b626-12025843cf8c service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Received event network-vif-unplugged-042c5347-d89a-43b4-9ad0-599397295c03 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-46027303-2197-432d-8809-67a68e947fd8 req-1ca8965a-d864-48fd-b626-12025843cf8c service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Received event network-vif-plugged-042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-46027303-2197-432d-8809-67a68e947fd8 req-1ca8965a-d864-48fd-b626-12025843cf8c service nova] Acquiring lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-46027303-2197-432d-8809-67a68e947fd8 req-1ca8965a-d864-48fd-b626-12025843cf8c service nova] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-46027303-2197-432d-8809-67a68e947fd8 req-1ca8965a-d864-48fd-b626-12025843cf8c service nova] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-46027303-2197-432d-8809-67a68e947fd8 req-1ca8965a-d864-48fd-b626-12025843cf8c service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] No waiting events found dispatching network-vif-plugged-042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:50:10 user nova-compute[72874]: WARNING nova.compute.manager [req-46027303-2197-432d-8809-67a68e947fd8 req-1ca8965a-d864-48fd-b626-12025843cf8c service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Received unexpected event network-vif-plugged-042c5347-d89a-43b4-9ad0-599397295c03 for instance with vm_state active and task_state deleting.
Aug 17 18:50:10 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:50:10 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Took 1.27 seconds to deallocate network for instance.
Aug 17 18:50:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-48a68552-8482-43e0-b074-2a27ca717d5f req-1d20ffbc-2d73-42e2-a7cc-6a6b26881be1 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Received event network-vif-deleted-042c5347-d89a-43b4-9ad0-599397295c03 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:50:10 user nova-compute[72874]: INFO nova.compute.manager [req-48a68552-8482-43e0-b074-2a27ca717d5f req-1d20ffbc-2d73-42e2-a7cc-6a6b26881be1 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Neutron deleted interface 042c5347-d89a-43b4-9ad0-599397295c03; detaching it from the instance and deleting it from the info cache
Aug 17 18:50:10 user nova-compute[72874]: DEBUG nova.network.neutron [req-48a68552-8482-43e0-b074-2a27ca717d5f req-1d20ffbc-2d73-42e2-a7cc-6a6b26881be1 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-48a68552-8482-43e0-b074-2a27ca717d5f req-1d20ffbc-2d73-42e2-a7cc-6a6b26881be1 service nova] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Detach interface failed, port_id=042c5347-d89a-43b4-9ad0-599397295c03, reason: Instance a3b3069b-a81b-4820-9fa2-c86e7361d8a6 could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:50:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:50:10 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Deleted allocations for instance a3b3069b-a81b-4820-9fa2-c86e7361d8a6
Aug 17 18:50:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2803c82d-bc73-416d-aa0f-1b3cbabc469a tempest-TestStampPattern-221411575 tempest-TestStampPattern-221411575-project-member] Lock "a3b3069b-a81b-4820-9fa2-c86e7361d8a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.487s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:50:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:50:23 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692298208.942135, a3b3069b-a81b-4820-9fa2-c86e7361d8a6 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:50:23 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] VM Stopped (Lifecycle Event)
Aug 17 18:50:23 user nova-compute[72874]: DEBUG nova.compute.manager [None req-0a5a21d6-f447-49d8-875d-795cb580ca15 None None] [instance: a3b3069b-a81b-4820-9fa2-c86e7361d8a6] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:50:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:50:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:50:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:50:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:50:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:50:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:50:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:50:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:50:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:50:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:35 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:50:37 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:50:37 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:50:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:50:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:50:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:50:37 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:50:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:37 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:50:38 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:50:38 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:50:38 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8946MB free_disk=25.207313537597656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:50:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:50:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:50:38 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 5a26e8ee-a875-4eb7-b924-c5c8962263b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:50:38 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:50:38 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:50:38 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:50:38 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:50:38 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:50:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:50:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:43 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:50:43 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:50:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:44 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:50:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:50:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:50:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:50:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:50:44 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:50:44 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:50:44 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updating instance_info_cache with network_info: [{"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:50:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:50:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:50:45 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:50:45 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:50:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:49 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'flavor' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:50:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:50:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquired lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:50:49 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:50:49 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'info_cache' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updating instance_info_cache with network_info: [{"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Releasing lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:50:50 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Instance destroyed successfully.
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'resources' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1371027525',display_name='tempest-AttachVolumeTestJSON-server-1371027525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1371027525',id=43,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdYfs/sLUHWSa/zvMpaUBe7Xc8Lp+dlZ+f30CtjbQ0OE5px5SGs8/VJAlNvxluJTvxKRCJtg4fLA7lBgSn8v6Si0I44hT1DD+ksfJGKy/yMOfXst7dOgevQ5DBh7zmIPw==',key_name='tempest-keypair-1286931965',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:46:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4d8e6936f2004a5cbb90e1e26f3ec28d',ramdisk_id='',reservation_id='r-7syakzfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-385757460',owner_user_name='tempest-AttachVolumeTestJSON-385757460-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b47a0411fa4642bfc5aa08f48919c9',uuid=5a26e8ee-a875-4eb7-b924-c5c8962263b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converting VIF {"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_vif [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8cb8b2c-5f, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:50:50 user nova-compute[72874]: INFO os_vif [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f')
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzrZJEoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:50:50 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab83a55-3b41-4b53-991a-874135da3016]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[109fbdd0-dd21-4b2d-b24b-183e4e73f644]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)
Aug 17 18:50:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)
Aug 17 18:50:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a0567010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[090f026b-16cb-4827-bf89-bc6b03aa555e]: (4, ('path checker states:\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5244d5-ac75-4271-a86a-d79ba444eab7]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cae1ee-b1bc-4e9a-9645-1b2265762fc9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[28087a2c-523d-4ead-9dcb-365f06bb2155]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ca7bda-89b6-4d99-bebb-fb6a735deb91]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de123f6-33fb-4064-bf83-9fb2dbae0761]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7, portal: 172.16.0.220,3260]
Aug 17 18:50:50 user nova-compute[72874]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7, portal: 172.16.0.220,3260] successful.
Aug 17 18:50:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[760c7c88-30bd-495a-a3f2-110418d0e180]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.250s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] <== disconnect_volume: return (251ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Start _get_guest_xml network_info=[{"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzrZJEoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5a26e8ee-a875-4eb7-b924-c5c8962263b1', 'attached_at': '', 'detached_at': '', 'volume_id': '77890318-fc21-49dc-9e95-443be10c69c7', 'serial': '77890318-fc21-49dc-9e95-443be10c69c7'}, 'delete_on_termination': False, 'attachment_id': 'f263e8b3-4124-45c5-96db-1979b2e131e8', 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'numa_topology' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:50:50 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:50:50 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzrZJEoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:50:50 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:50:50 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:50:50 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f12b8fa-61eb-4afb-9604-1a528643383a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:50:50 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70c7563-b68a-4f97-986f-e7c0202428c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7] added
Aug 17 18:50:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:50:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a98ae5-8be3-4229-9b88-05c3662debe2]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3cd93d-1c63-4655-bd77-70342c27f595]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WzrZJEoK {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WzrZJEoK" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2540aa-4a95-479c-8768-30a3056bef46]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WzrZJEoK'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ef1c00-dc8c-4126-970a-003c917f5995]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f57f7cb-f6eb-47ad-9a96-b66d17380662]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 18:50:51 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 18:50:51 user nova-compute[72874]:  {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:50:51 user nova-compute[72874]: WARNING os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 18:50:51 user nova-compute[72874]: 
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d9338c-ace6-4dad-a7c1-8135016419db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7, portal: 172.16.0.220,3260]
Aug 17 18:50:51 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7, portal: 172.16.0.220,3260] successful.
Aug 17 18:50:51 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[910c2eea-914c-4b2e-b78e-16a3e2c7841a]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07fdcfe-fdef-4c48-b377-d63b8a3fa1d9]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)
Aug 17 18:50:51 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)
Aug 17 18:50:51 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.230s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e181ef-d568-4323-b06f-f7c3bb9eeff2]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:50:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzrZJEoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.260s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] <== connect_volume: return (1261ms) {'type': 'block', 'scsi_wwn': '23536303538623433', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536303538623433', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1371027525',display_name='tempest-AttachVolumeTestJSON-server-1371027525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1371027525',id=43,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdYfs/sLUHWSa/zvMpaUBe7Xc8Lp+dlZ+f30CtjbQ0OE5px5SGs8/VJAlNvxluJTvxKRCJtg4fLA7lBgSn8v6Si0I44hT1DD+ksfJGKy/yMOfXst7dOgevQ5DBh7zmIPw==',key_name='tempest-keypair-1286931965',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:46:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4d8e6936f2004a5cbb90e1e26f3ec28d',ramdisk_id='',reservation_id='r-7syakzfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-385757460',owner_user_name='tempest-AttachVolumeTestJSON-385757460-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b47a0411fa4642bfc5aa08f48919c9',uuid=5a26e8ee-a875-4eb7-b924-c5c8962263b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converting VIF {"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:50:52 user nova-compute[72874]:   <uuid>5a26e8ee-a875-4eb7-b924-c5c8962263b1</uuid>
Aug 17 18:50:52 user nova-compute[72874]:   <name>instance-0000002b</name>
Aug 17 18:50:52 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:50:52 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:50:52 user nova-compute[72874]:   <metadata>
Aug 17 18:50:52 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:50:52 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:50:52 user nova-compute[72874]:       <nova:name>tempest-AttachVolumeTestJSON-server-1371027525</nova:name>
Aug 17 18:50:52 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:50:50</nova:creationTime>
Aug 17 18:50:52 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:50:52 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:50:52 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:50:52 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:50:52 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:50:52 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:50:52 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:50:52 user nova-compute[72874]:       <nova:owner>
Aug 17 18:50:52 user nova-compute[72874]:         <nova:user uuid="04b47a0411fa4642bfc5aa08f48919c9">tempest-AttachVolumeTestJSON-385757460-project-member</nova:user>
Aug 17 18:50:52 user nova-compute[72874]:         <nova:project uuid="4d8e6936f2004a5cbb90e1e26f3ec28d">tempest-AttachVolumeTestJSON-385757460</nova:project>
Aug 17 18:50:52 user nova-compute[72874]:       </nova:owner>
Aug 17 18:50:52 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:50:52 user nova-compute[72874]:       <nova:ports>
Aug 17 18:50:52 user nova-compute[72874]:         <nova:port uuid="f8cb8b2c-5fed-45a5-a03e-865b8bfcea41">
Aug 17 18:50:52 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 18:50:52 user nova-compute[72874]:         </nova:port>
Aug 17 18:50:52 user nova-compute[72874]:       </nova:ports>
Aug 17 18:50:52 user nova-compute[72874]:     </nova:instance>
Aug 17 18:50:52 user nova-compute[72874]:   </metadata>
Aug 17 18:50:52 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:50:52 user nova-compute[72874]:     <system>
Aug 17 18:50:52 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:50:52 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:50:52 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:50:52 user nova-compute[72874]:       <entry name="serial">5a26e8ee-a875-4eb7-b924-c5c8962263b1</entry>
Aug 17 18:50:52 user nova-compute[72874]:       <entry name="uuid">5a26e8ee-a875-4eb7-b924-c5c8962263b1</entry>
Aug 17 18:50:52 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:50:52 user nova-compute[72874]:     </system>
Aug 17 18:50:52 user nova-compute[72874]:   </sysinfo>
Aug 17 18:50:52 user nova-compute[72874]:   <os>
Aug 17 18:50:52 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:50:52 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:50:52 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:50:52 user nova-compute[72874]:   </os>
Aug 17 18:50:52 user nova-compute[72874]:   <features>
Aug 17 18:50:52 user nova-compute[72874]:     <acpi/>
Aug 17 18:50:52 user nova-compute[72874]:     <apic/>
Aug 17 18:50:52 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:50:52 user nova-compute[72874]:   </features>
Aug 17 18:50:52 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:50:52 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:50:52 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:50:52 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:50:52 user nova-compute[72874]:   </clock>
Aug 17 18:50:52 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:50:52 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:50:52 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:50:52 user nova-compute[72874]:   </cpu>
Aug 17 18:50:52 user nova-compute[72874]:   <devices>
Aug 17 18:50:52 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:50:52 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:50:52 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk"/>
Aug 17 18:50:52 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:50:52 user nova-compute[72874]:     </disk>
Aug 17 18:50:52 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:50:52 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:50:52 user nova-compute[72874]:       <source dev="/dev/sdb"/>
Aug 17 18:50:52 user nova-compute[72874]:       <target dev="vdb" bus="virtio"/>
Aug 17 18:50:52 user nova-compute[72874]:       <serial>77890318-fc21-49dc-9e95-443be10c69c7</serial>
Aug 17 18:50:52 user nova-compute[72874]:     </disk>
Aug 17 18:50:52 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:50:52 user nova-compute[72874]:       <mac address="fa:16:3e:24:1d:06"/>
Aug 17 18:50:52 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:50:52 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:50:52 user nova-compute[72874]:       <target dev="tapf8cb8b2c-5f"/>
Aug 17 18:50:52 user nova-compute[72874]:     </interface>
Aug 17 18:50:52 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:50:52 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/console.log" append="off"/>
Aug 17 18:50:52 user nova-compute[72874]:     </serial>
Aug 17 18:50:52 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:50:52 user nova-compute[72874]:     <video>
Aug 17 18:50:52 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:50:52 user nova-compute[72874]:     </video>
Aug 17 18:50:52 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:50:52 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:50:52 user nova-compute[72874]:     </rng>
Aug 17 18:50:52 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:50:52 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:50:52 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:50:52 user nova-compute[72874]:     </memballoon>
Aug 17 18:50:52 user nova-compute[72874]:   </devices>
Aug 17 18:50:52 user nova-compute[72874]: </domain>
Aug 17 18:50:52 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.172s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:50:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:50:53 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:50:53 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Cannot resize image /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:50:53 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'migration_context' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:50:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1371027525',display_name='tempest-AttachVolumeTestJSON-server-1371027525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1371027525',id=43,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdYfs/sLUHWSa/zvMpaUBe7Xc8Lp+dlZ+f30CtjbQ0OE5px5SGs8/VJAlNvxluJTvxKRCJtg4fLA7lBgSn8v6Si0I44hT1DD+ksfJGKy/yMOfXst7dOgevQ5DBh7zmIPw==',key_name='tempest-keypair-1286931965',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:46:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='4d8e6936f2004a5cbb90e1e26f3ec28d',ramdisk_id='',reservation_id='r-7syakzfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-385757460',owner_user_name='tempest-AttachVolumeTestJSON-385757460-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b47a0411fa4642bfc5aa08f48919c9',uuid=5a26e8ee-a875-4eb7-b924-c5c8962263b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:50:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converting VIF {"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:50:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:50:53 user nova-compute[72874]: DEBUG os_vif [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:50:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:50:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:50:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8cb8b2c-5f, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:50:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf8cb8b2c-5f, col_values=(('external_ids', {'iface-id': 'f8cb8b2c-5fed-45a5-a03e-865b8bfcea41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:1d:06', 'vm-uuid': '5a26e8ee-a875-4eb7-b924-c5c8962263b1'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:50:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:50:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:53 user nova-compute[72874]: INFO os_vif [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f')
Aug 17 18:50:54 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:50:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-1255b31e-e493-49cb-b14c-8ebd168315bc req-d08d184f-f289-430b-8aac-2e1fea5506b2 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:50:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1255b31e-e493-49cb-b14c-8ebd168315bc req-d08d184f-f289-430b-8aac-2e1fea5506b2 service nova] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:50:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1255b31e-e493-49cb-b14c-8ebd168315bc req-d08d184f-f289-430b-8aac-2e1fea5506b2 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:50:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1255b31e-e493-49cb-b14c-8ebd168315bc req-d08d184f-f289-430b-8aac-2e1fea5506b2 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:50:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-1255b31e-e493-49cb-b14c-8ebd168315bc req-d08d184f-f289-430b-8aac-2e1fea5506b2 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] No waiting events found dispatching network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:50:54 user nova-compute[72874]: WARNING nova.compute.manager [req-1255b31e-e493-49cb-b14c-8ebd168315bc req-d08d184f-f289-430b-8aac-2e1fea5506b2 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received unexpected event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 for instance with vm_state stopped and task_state powering-on.
Aug 17 18:50:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:50:56 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692298256.4032538, 5a26e8ee-a875-4eb7-b924-c5c8962263b1 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:50:56 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] VM Resumed (Lifecycle Event)
Aug 17 18:50:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:50:56 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Instance rebooted successfully.
Aug 17 18:50:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3e54c42a-67b3-4d32-a855-9a89dc3a0e0c tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:50:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:50:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:50:56 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 18:50:56 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692298256.4071512, 5a26e8ee-a875-4eb7-b924-c5c8962263b1 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:50:56 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] VM Started (Lifecycle Event)
Aug 17 18:50:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:50:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:50:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-7f7b3469-8045-459d-98b8-a2ffcc344746 req-49c07580-51d7-427d-8406-baa48d72dd25 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:50:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7f7b3469-8045-459d-98b8-a2ffcc344746 req-49c07580-51d7-427d-8406-baa48d72dd25 service nova] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:50:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7f7b3469-8045-459d-98b8-a2ffcc344746 req-49c07580-51d7-427d-8406-baa48d72dd25 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:50:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7f7b3469-8045-459d-98b8-a2ffcc344746 req-49c07580-51d7-427d-8406-baa48d72dd25 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:50:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-7f7b3469-8045-459d-98b8-a2ffcc344746 req-49c07580-51d7-427d-8406-baa48d72dd25 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] No waiting events found dispatching network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:50:56 user nova-compute[72874]: WARNING nova.compute.manager [req-7f7b3469-8045-459d-98b8-a2ffcc344746 req-49c07580-51d7-427d-8406-baa48d72dd25 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received unexpected event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 for instance with vm_state active and task_state None.
Aug 17 18:50:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:37 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:51:37 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:51:37 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:51:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:51:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:51:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:51:37 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:51:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:51:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:51:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:51:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:51:37 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:51:38 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:51:38 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:51:38 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8806MB free_disk=25.204105377197266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:51:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:51:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:51:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:38 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 5a26e8ee-a875-4eb7-b924-c5c8962263b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:51:38 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:51:38 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:51:38 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:51:38 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:51:38 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:51:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:51:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:43 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:51:45 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "9c458df7-d3d0-4f7d-b972-9f643427cf87" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "9c458df7-d3d0-4f7d-b972-9f643427cf87" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:51:46 user nova-compute[72874]: INFO nova.compute.claims [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Claim successful on node user
Aug 17 18:51:46 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.231s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:51:46 user nova-compute[72874]: DEBUG nova.network.neutron [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:51:46 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:51:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:51:46 user nova-compute[72874]: INFO nova.virt.block_device [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Booting with volume snapshot d4645865-668c-40b2-83fb-8dbd3d8367be at /dev/vda
Aug 17 18:51:46 user nova-compute[72874]: DEBUG nova.policy [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73cdc5d076a14395ad1958394f0c48e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41b302a39da4ab18c463789f2a73dd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:51:47 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updating instance_info_cache with network_info: [{"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:51:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:51:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:51:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:51:47 user nova-compute[72874]: DEBUG nova.network.neutron [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Successfully created port: f93fd5ac-fa02-48d4-ad64-f1dda6a61320 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:51:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:48 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:51:48 user nova-compute[72874]: DEBUG nova.network.neutron [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Successfully updated port: f93fd5ac-fa02-48d4-ad64-f1dda6a61320 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:51:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "refresh_cache-9c458df7-d3d0-4f7d-b972-9f643427cf87" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:51:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquired lock "refresh_cache-9c458df7-d3d0-4f7d-b972-9f643427cf87" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:51:48 user nova-compute[72874]: DEBUG nova.network.neutron [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:51:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-56955b69-a3de-49bf-af5c-ae6e29bc4024 req-85294685-50c8-4e0d-816d-04ff34a484dd service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Received event network-changed-f93fd5ac-fa02-48d4-ad64-f1dda6a61320 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:51:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-56955b69-a3de-49bf-af5c-ae6e29bc4024 req-85294685-50c8-4e0d-816d-04ff34a484dd service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Refreshing instance network info cache due to event network-changed-f93fd5ac-fa02-48d4-ad64-f1dda6a61320. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:51:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-56955b69-a3de-49bf-af5c-ae6e29bc4024 req-85294685-50c8-4e0d-816d-04ff34a484dd service nova] Acquiring lock "refresh_cache-9c458df7-d3d0-4f7d-b972-9f643427cf87" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:51:48 user nova-compute[72874]: DEBUG nova.network.neutron [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:51:49 user nova-compute[72874]: DEBUG nova.network.neutron [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Updating instance_info_cache with network_info: [{"id": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "address": "fa:16:3e:ac:15:8e", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fd5ac-fa", "ovs_interfaceid": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:51:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Releasing lock "refresh_cache-9c458df7-d3d0-4f7d-b972-9f643427cf87" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:51:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Instance network_info: |[{"id": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "address": "fa:16:3e:ac:15:8e", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fd5ac-fa", "ovs_interfaceid": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:51:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-56955b69-a3de-49bf-af5c-ae6e29bc4024 req-85294685-50c8-4e0d-816d-04ff34a484dd service nova] Acquired lock "refresh_cache-9c458df7-d3d0-4f7d-b972-9f643427cf87" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:51:49 user nova-compute[72874]: DEBUG nova.network.neutron [req-56955b69-a3de-49bf-af5c-ae6e29bc4024 req-85294685-50c8-4e0d-816d-04ff34a484dd service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Refreshing network info cache for port f93fd5ac-fa02-48d4-ad64-f1dda6a61320 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:51:49 user nova-compute[72874]: DEBUG nova.network.neutron [req-56955b69-a3de-49bf-af5c-ae6e29bc4024 req-85294685-50c8-4e0d-816d-04ff34a484dd service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Updated VIF entry in instance network info cache for port f93fd5ac-fa02-48d4-ad64-f1dda6a61320. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:51:49 user nova-compute[72874]: DEBUG nova.network.neutron [req-56955b69-a3de-49bf-af5c-ae6e29bc4024 req-85294685-50c8-4e0d-816d-04ff34a484dd service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Updating instance_info_cache with network_info: [{"id": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "address": "fa:16:3e:ac:15:8e", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fd5ac-fa", "ovs_interfaceid": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:51:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-56955b69-a3de-49bf-af5c-ae6e29bc4024 req-85294685-50c8-4e0d-816d-04ff34a484dd service nova] Releasing lock "refresh_cache-9c458df7-d3d0-4f7d-b972-9f643427cf87" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:51:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG os_brick.utils [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ab7a3e-8f0e-43c0-a98b-cc7b636f1ebe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[52905f6f-9950-49d2-b2d4-0766a8258874]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b26b9c-621b-48bc-b8c3-572bd3f785a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ef88af-646f-4b52-b2e1-05f8c71b13e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:51:52 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:51:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1e3bcf-cbdd-42a5-9ca8-ee57900be5e2]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG os_brick.utils [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:51:52 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Updating existing volume attachment record: 54881828-eb7e-49d8-af43-ca81caeb2529 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:51:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:54 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:51:54 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:51:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:51:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:52:02 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Creating image(s)
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Ensure instance console log exists: /opt/stack/data/nova/instances/9c458df7-d3d0-4f7d-b972-9f643427cf87/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Start _get_guest_xml network_info=[{"id": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "address": "fa:16:3e:ac:15:8e", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fd5ac-fa", "ovs_interfaceid": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTRBOxLu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9c458df7-d3d0-4f7d-b972-9f643427cf87', 'attached_at': '', 'detached_at': '', 'volume_id': 'd81048df-a5c4-4c3e-96d9-152acf7e0ae3', 'serial': 'd81048df-a5c4-4c3e-96d9-152acf7e0ae3'}, 'delete_on_termination': True, 'attachment_id': '54881828-eb7e-49d8-af43-ca81caeb2529', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:52:02 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:52:02 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTRBOxLu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:52:02 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:52:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:52:02 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:52:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:52:02 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:52:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f794b3-c29b-408f-a552-5176e3c5a6b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:52:02 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af35fca-b71a-41fd-ba85-16075b305640]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3] added
Aug 17 18:52:02 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd071cb0-5132-40d4-bab1-2b027029ed1c]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:52:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6fed82-1ed6-45a1-9161-6a348f324730]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NTRBOxLu {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NTRBOxLu" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f0e293-59ac-4067-a95e-1cc67cd2e68b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NTRBOxLu'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3185b06c-3567-45e6-bdb4-ed9e9eb91295]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ff4e53-ae02-422f-94ff-4fa0967c7590]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)
Aug 17 18:52:03 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)
Aug 17 18:52:03 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[496b8924-da58-41db-a507-2678f7e5f7b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3, portal: 172.16.0.220,3260]
Aug 17 18:52:03 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3, portal: 172.16.0.220,3260] successful.
Aug 17 18:52:03 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[995f477f-f884-44c0-aaa6-77c67831771f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae07e97-bf1c-4219-9fca-9ea60603fde8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)
Aug 17 18:52:03 user nova-compute[72874]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 (non-flash)
Aug 17 18:52:03 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)
Aug 17 18:52:03 user nova-compute[72874]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 (non-flash)
Aug 17 18:52:03 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f1064b-23b6-474d-ab95-34708c52aca8]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:52:03 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTRBOxLu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26363663166663937', 'path': '/dev/sdc'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363663166663937', 'path': '/dev/sdc'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1620933105',display_name='tempest-TestVolumeBootPattern-server-1620933105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1620933105',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-4weg0fte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:51:47Z,user_data=None,user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=9c458df7-d3d0-4f7d-b972-9f643427cf87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "address": "fa:16:3e:ac:15:8e", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fd5ac-fa", "ovs_interfaceid": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "address": "fa:16:3e:ac:15:8e", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fd5ac-fa", "ovs_interfaceid": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:15:8e,bridge_name='br-int',has_traffic_filtering=True,id=f93fd5ac-fa02-48d4-ad64-f1dda6a61320,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93fd5ac-fa') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG nova.objects.instance [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c458df7-d3d0-4f7d-b972-9f643427cf87 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:52:04 user nova-compute[72874]:   <uuid>9c458df7-d3d0-4f7d-b972-9f643427cf87</uuid>
Aug 17 18:52:04 user nova-compute[72874]:   <name>instance-0000002c</name>
Aug 17 18:52:04 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:52:04 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:52:04 user nova-compute[72874]:   <metadata>
Aug 17 18:52:04 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:52:04 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:52:04 user nova-compute[72874]:       <nova:name>tempest-TestVolumeBootPattern-server-1620933105</nova:name>
Aug 17 18:52:04 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:52:02</nova:creationTime>
Aug 17 18:52:04 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:52:04 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:52:04 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:52:04 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:52:04 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:52:04 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:52:04 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:52:04 user nova-compute[72874]:       <nova:owner>
Aug 17 18:52:04 user nova-compute[72874]:         <nova:user uuid="73cdc5d076a14395ad1958394f0c48e4">tempest-TestVolumeBootPattern-414332602-project-member</nova:user>
Aug 17 18:52:04 user nova-compute[72874]:         <nova:project uuid="f41b302a39da4ab18c463789f2a73dd5">tempest-TestVolumeBootPattern-414332602</nova:project>
Aug 17 18:52:04 user nova-compute[72874]:       </nova:owner>
Aug 17 18:52:04 user nova-compute[72874]:       <nova:ports>
Aug 17 18:52:04 user nova-compute[72874]:         <nova:port uuid="f93fd5ac-fa02-48d4-ad64-f1dda6a61320">
Aug 17 18:52:04 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 18:52:04 user nova-compute[72874]:         </nova:port>
Aug 17 18:52:04 user nova-compute[72874]:       </nova:ports>
Aug 17 18:52:04 user nova-compute[72874]:     </nova:instance>
Aug 17 18:52:04 user nova-compute[72874]:   </metadata>
Aug 17 18:52:04 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:52:04 user nova-compute[72874]:     <system>
Aug 17 18:52:04 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:52:04 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:52:04 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:52:04 user nova-compute[72874]:       <entry name="serial">9c458df7-d3d0-4f7d-b972-9f643427cf87</entry>
Aug 17 18:52:04 user nova-compute[72874]:       <entry name="uuid">9c458df7-d3d0-4f7d-b972-9f643427cf87</entry>
Aug 17 18:52:04 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:52:04 user nova-compute[72874]:     </system>
Aug 17 18:52:04 user nova-compute[72874]:   </sysinfo>
Aug 17 18:52:04 user nova-compute[72874]:   <os>
Aug 17 18:52:04 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:52:04 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:52:04 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:52:04 user nova-compute[72874]:   </os>
Aug 17 18:52:04 user nova-compute[72874]:   <features>
Aug 17 18:52:04 user nova-compute[72874]:     <acpi/>
Aug 17 18:52:04 user nova-compute[72874]:     <apic/>
Aug 17 18:52:04 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:52:04 user nova-compute[72874]:   </features>
Aug 17 18:52:04 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:52:04 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:52:04 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:52:04 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:52:04 user nova-compute[72874]:   </clock>
Aug 17 18:52:04 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:52:04 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:52:04 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:52:04 user nova-compute[72874]:   </cpu>
Aug 17 18:52:04 user nova-compute[72874]:   <devices>
Aug 17 18:52:04 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:52:04 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:52:04 user nova-compute[72874]:       <source dev="/dev/sdc"/>
Aug 17 18:52:04 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:52:04 user nova-compute[72874]:       <serial>d81048df-a5c4-4c3e-96d9-152acf7e0ae3</serial>
Aug 17 18:52:04 user nova-compute[72874]:     </disk>
Aug 17 18:52:04 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:52:04 user nova-compute[72874]:       <mac address="fa:16:3e:ac:15:8e"/>
Aug 17 18:52:04 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:52:04 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:52:04 user nova-compute[72874]:       <target dev="tapf93fd5ac-fa"/>
Aug 17 18:52:04 user nova-compute[72874]:     </interface>
Aug 17 18:52:04 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:52:04 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/9c458df7-d3d0-4f7d-b972-9f643427cf87/console.log" append="off"/>
Aug 17 18:52:04 user nova-compute[72874]:     </serial>
Aug 17 18:52:04 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:52:04 user nova-compute[72874]:     <video>
Aug 17 18:52:04 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:52:04 user nova-compute[72874]:     </video>
Aug 17 18:52:04 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:52:04 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:52:04 user nova-compute[72874]:     </rng>
Aug 17 18:52:04 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:52:04 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:52:04 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:52:04 user nova-compute[72874]:     </memballoon>
Aug 17 18:52:04 user nova-compute[72874]:   </devices>
Aug 17 18:52:04 user nova-compute[72874]: </domain>
Aug 17 18:52:04 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1620933105',display_name='tempest-TestVolumeBootPattern-server-1620933105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1620933105',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-4weg0fte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:51:47Z,user_data=None,user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=9c458df7-d3d0-4f7d-b972-9f643427cf87,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "address": "fa:16:3e:ac:15:8e", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fd5ac-fa", "ovs_interfaceid": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "address": "fa:16:3e:ac:15:8e", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fd5ac-fa", "ovs_interfaceid": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:15:8e,bridge_name='br-int',has_traffic_filtering=True,id=f93fd5ac-fa02-48d4-ad64-f1dda6a61320,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93fd5ac-fa') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG os_vif [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:15:8e,bridge_name='br-int',has_traffic_filtering=True,id=f93fd5ac-fa02-48d4-ad64-f1dda6a61320,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93fd5ac-fa') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf93fd5ac-fa, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf93fd5ac-fa, col_values=(('external_ids', {'iface-id': 'f93fd5ac-fa02-48d4-ad64-f1dda6a61320', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:15:8e', 'vm-uuid': '9c458df7-d3d0-4f7d-b972-9f643427cf87'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:04 user nova-compute[72874]: INFO os_vif [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:15:8e,bridge_name='br-int',has_traffic_filtering=True,id=f93fd5ac-fa02-48d4-ad64-f1dda6a61320,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93fd5ac-fa')
Aug 17 18:52:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:52:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] No VIF found with MAC fa:16:3e:ac:15:8e, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:52:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:05 user nova-compute[72874]: DEBUG nova.compute.manager [req-4a4565de-7c10-46a8-bb41-6e5b5e48659f req-c892f020-17e1-417c-bcdb-0562fc391622 service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Received event network-vif-plugged-f93fd5ac-fa02-48d4-ad64-f1dda6a61320 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:52:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4a4565de-7c10-46a8-bb41-6e5b5e48659f req-c892f020-17e1-417c-bcdb-0562fc391622 service nova] Acquiring lock "9c458df7-d3d0-4f7d-b972-9f643427cf87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:52:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4a4565de-7c10-46a8-bb41-6e5b5e48659f req-c892f020-17e1-417c-bcdb-0562fc391622 service nova] Lock "9c458df7-d3d0-4f7d-b972-9f643427cf87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:52:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4a4565de-7c10-46a8-bb41-6e5b5e48659f req-c892f020-17e1-417c-bcdb-0562fc391622 service nova] Lock "9c458df7-d3d0-4f7d-b972-9f643427cf87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:52:05 user nova-compute[72874]: DEBUG nova.compute.manager [req-4a4565de-7c10-46a8-bb41-6e5b5e48659f req-c892f020-17e1-417c-bcdb-0562fc391622 service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] No waiting events found dispatching network-vif-plugged-f93fd5ac-fa02-48d4-ad64-f1dda6a61320 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:52:05 user nova-compute[72874]: WARNING nova.compute.manager [req-4a4565de-7c10-46a8-bb41-6e5b5e48659f req-c892f020-17e1-417c-bcdb-0562fc391622 service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Received unexpected event network-vif-plugged-f93fd5ac-fa02-48d4-ad64-f1dda6a61320 for instance with vm_state building and task_state spawning.
Aug 17 18:52:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Verify base images {{(pid=72874) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72874) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Image id 7fe37517-c232-4d7a-939d-c3edde21bc31 yields fingerprint 010be14c1b17d264a77a65496aad88ac8a54bb22 {{(pid=72874) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] image 7fe37517-c232-4d7a-939d-c3edde21bc31 at (/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22): checking
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] image 7fe37517-c232-4d7a-939d-c3edde21bc31 at (/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22): image is in use {{(pid=72874) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] 9c458df7-d3d0-4f7d-b972-9f643427cf87 is a valid instance name {{(pid=72874) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] 5a26e8ee-a875-4eb7-b924-c5c8962263b1 is a valid instance name {{(pid=72874) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] 5a26e8ee-a875-4eb7-b924-c5c8962263b1 has a disk file {{(pid=72874) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 5a26e8ee-a875-4eb7-b924-c5c8962263b1 is backed by 010be14c1b17d264a77a65496aad88ac8a54bb22 {{(pid=72874) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 17 18:52:07 user nova-compute[72874]: WARNING nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Unknown base file: /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98
Aug 17 18:52:07 user nova-compute[72874]: WARNING nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc
Aug 17 18:52:07 user nova-compute[72874]: WARNING nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8
Aug 17 18:52:07 user nova-compute[72874]: WARNING nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f
Aug 17 18:52:07 user nova-compute[72874]: WARNING nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7
Aug 17 18:52:07 user nova-compute[72874]: WARNING nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Unknown base file: /opt/stack/data/nova/instances/_base/31f0344b24e5a1c26bd94e55a349038dc3853362
Aug 17 18:52:07 user nova-compute[72874]: WARNING nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0
Aug 17 18:52:07 user nova-compute[72874]: WARNING nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Unknown base file: /opt/stack/data/nova/instances/_base/050cf5fc9e6e604ccfa1aed447e3473b1b937429
Aug 17 18:52:07 user nova-compute[72874]: WARNING nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Active base files: /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Removable base files: /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98 /opt/stack/data/nova/instances/_base/1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8 /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7 /opt/stack/data/nova/instances/_base/31f0344b24e5a1c26bd94e55a349038dc3853362 /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0 /opt/stack/data/nova/instances/_base/050cf5fc9e6e604ccfa1aed447e3473b1b937429 /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/01c407a0d5a2122bb361b9a096e8b1ea9189ff98
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1d08e8b00bad8895828e2dae400d8e4ddbe3c4fc
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fbf9fa7b51885e61ced75cb7260d6194303d86a8
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cefc8daedd7c2e637fd9bbbc5a0e5180caa7061f
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ec9a9ab938a3a37d9f42c20a72223ab0caa920c7
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/31f0344b24e5a1c26bd94e55a349038dc3853362
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3b087e331dfbdbd2afe8b285be8595185197f7b0
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/050cf5fc9e6e604ccfa1aed447e3473b1b937429
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b0d3b085f79b171fa991e817f72e3e3551487f62
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Verification complete {{(pid=72874) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Verify swap images {{(pid=72874) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.imagecache [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Verify ephemeral images {{(pid=72874) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692298327.6695592, 9c458df7-d3d0-4f7d-b972-9f643427cf87 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] VM Resumed (Lifecycle Event)
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Instance spawned successfully.
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692298327.6718156, 9c458df7-d3d0-4f7d-b972-9f643427cf87 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] VM Started (Lifecycle Event)
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.compute.manager [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Took 4.94 seconds to spawn the instance on the hypervisor.
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-1d616298-49bb-41db-98c6-d6edf3adb522 req-d66977fe-1ad8-42ae-99e0-a4c8f911941f service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Received event network-vif-plugged-f93fd5ac-fa02-48d4-ad64-f1dda6a61320 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1d616298-49bb-41db-98c6-d6edf3adb522 req-d66977fe-1ad8-42ae-99e0-a4c8f911941f service nova] Acquiring lock "9c458df7-d3d0-4f7d-b972-9f643427cf87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1d616298-49bb-41db-98c6-d6edf3adb522 req-d66977fe-1ad8-42ae-99e0-a4c8f911941f service nova] Lock "9c458df7-d3d0-4f7d-b972-9f643427cf87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1d616298-49bb-41db-98c6-d6edf3adb522 req-d66977fe-1ad8-42ae-99e0-a4c8f911941f service nova] Lock "9c458df7-d3d0-4f7d-b972-9f643427cf87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:52:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-1d616298-49bb-41db-98c6-d6edf3adb522 req-d66977fe-1ad8-42ae-99e0-a4c8f911941f service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] No waiting events found dispatching network-vif-plugged-f93fd5ac-fa02-48d4-ad64-f1dda6a61320 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:52:07 user nova-compute[72874]: WARNING nova.compute.manager [req-1d616298-49bb-41db-98c6-d6edf3adb522 req-d66977fe-1ad8-42ae-99e0-a4c8f911941f service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Received unexpected event network-vif-plugged-f93fd5ac-fa02-48d4-ad64-f1dda6a61320 for instance with vm_state building and task_state spawning.
Aug 17 18:52:07 user nova-compute[72874]: INFO nova.compute.manager [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Took 21.64 seconds to build instance.
Aug 17 18:52:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-5b8baace-9dc6-4bbc-8548-d3928e903539 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "9c458df7-d3d0-4f7d-b972-9f643427cf87" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.736s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:52:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:52:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:52:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:52:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:52:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:38 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:52:38 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:52:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:52:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:52:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:52:38 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:52:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:52:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:52:39 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:52:39 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:52:39 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8637MB free_disk=25.20214080810547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:52:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:52:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:52:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:39 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 5a26e8ee-a875-4eb7-b924-c5c8962263b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:52:39 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 9c458df7-d3d0-4f7d-b972-9f643427cf87 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:52:39 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:52:39 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:52:39 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:52:39 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:52:39 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:52:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:52:40 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:52:41 user nova-compute[72874]: INFO nova.compute.manager [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Detaching volume 77890318-fc21-49dc-9e95-443be10c69c7
Aug 17 18:52:41 user nova-compute[72874]: INFO nova.virt.block_device [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Attempting to driver detach volume 77890318-fc21-49dc-9e95-443be10c69c7 from mountpoint /dev/vdb
Aug 17 18:52:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Attempting to detach device vdb from instance 5a26e8ee-a875-4eb7-b924-c5c8962263b1 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:52:41 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:52:41 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 18:52:41 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:52:41 user nova-compute[72874]:   <serial>77890318-fc21-49dc-9e95-443be10c69c7</serial>
Aug 17 18:52:41 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 18:52:41 user nova-compute[72874]: </disk>
Aug 17 18:52:41 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:52:41 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Successfully detached device vdb from instance 5a26e8ee-a875-4eb7-b924-c5c8962263b1 from the persistent domain config.
Aug 17 18:52:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5a26e8ee-a875-4eb7-b924-c5c8962263b1 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:52:41 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:52:41 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 18:52:41 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:52:41 user nova-compute[72874]:   <serial>77890318-fc21-49dc-9e95-443be10c69c7</serial>
Aug 17 18:52:41 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 18:52:41 user nova-compute[72874]: </disk>
Aug 17 18:52:41 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692298361.7096472, 5a26e8ee-a875-4eb7-b924-c5c8962263b1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:52:41 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Successfully detached device vdb from instance 5a26e8ee-a875-4eb7-b924-c5c8962263b1 from the live domain config.
Aug 17 18:52:41 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzrZJEoK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:52:41 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:52:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[675b5f4f-90a0-43ee-8a56-3863c55ef79c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0462f58c-8a92-42cb-8a2a-7d75076ae94f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)
Aug 17 18:52:41 user nova-compute[72874]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 (non-flash)
Aug 17 18:52:41 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 (non-flash)
Aug 17 18:52:41 user nova-compute[72874]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 (non-flash)
Aug 17 18:52:41 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a06ad000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec683b5-e850-4be0-8f4c-af594f0bc83f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db01da6-8db5-48df-ba67-c8a4813ddf00]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b619caa6-49a9-4c5c-aa76-83e75f212d7e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5675dcde-eebb-41ff-b9d5-f8e636ffec2d]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7061d8cf-9988-43a8-91d3-e5b526467ab5]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded4830f-00f9-4ae1-830a-218ddaac42e0]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7, portal: 172.16.0.220,3260]
Aug 17 18:52:41 user nova-compute[72874]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7, portal: 172.16.0.220,3260] successful.
Aug 17 18:52:41 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77890318-fc21-49dc-9e95-443be10c69c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:52:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51b0b2c-8473-4cb2-8630-2ab6cd36731a]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:52:42 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:52:42 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:52:42 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] <== disconnect_volume: return (279ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:52:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:52:42 user nova-compute[72874]: DEBUG nova.objects.instance [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'flavor' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:52:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0c5b598f-8c68-49ea-8ba0-40239b65a5c0 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.670s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:52:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8dbb19d4-ca31-49aa-9434-b714c89bb770 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:52:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8dbb19d4-ca31-49aa-9434-b714c89bb770 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:52:43 user nova-compute[72874]: DEBUG nova.compute.manager [None req-8dbb19d4-ca31-49aa-9434-b714c89bb770 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:52:43 user nova-compute[72874]: DEBUG nova.compute.manager [None req-8dbb19d4-ca31-49aa-9434-b714c89bb770 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72874) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 18:52:43 user nova-compute[72874]: DEBUG nova.objects.instance [None req-8dbb19d4-ca31-49aa-9434-b714c89bb770 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'flavor' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:52:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-1edf9f4b-7738-4cbb-a6b3-df905dfda1bc req-57923659-002b-4255-aaec-4719466a997c service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received event network-vif-unplugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:52:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1edf9f4b-7738-4cbb-a6b3-df905dfda1bc req-57923659-002b-4255-aaec-4719466a997c service nova] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:52:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1edf9f4b-7738-4cbb-a6b3-df905dfda1bc req-57923659-002b-4255-aaec-4719466a997c service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:52:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1edf9f4b-7738-4cbb-a6b3-df905dfda1bc req-57923659-002b-4255-aaec-4719466a997c service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:52:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-1edf9f4b-7738-4cbb-a6b3-df905dfda1bc req-57923659-002b-4255-aaec-4719466a997c service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] No waiting events found dispatching network-vif-unplugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:52:43 user nova-compute[72874]: WARNING nova.compute.manager [req-1edf9f4b-7738-4cbb-a6b3-df905dfda1bc req-57923659-002b-4255-aaec-4719466a997c service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received unexpected event network-vif-unplugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 for instance with vm_state active and task_state powering-off.
Aug 17 18:52:44 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:52:44 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Instance destroyed successfully.
Aug 17 18:52:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-8dbb19d4-ca31-49aa-9434-b714c89bb770 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:52:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8dbb19d4-ca31-49aa-9434-b714c89bb770 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.821s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:52:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:45 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:52:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-8e07c0aa-5d6e-4701-bd87-fe57d631a5a3 req-fe19d762-5647-424e-9cd1-b6abf9030276 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:52:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8e07c0aa-5d6e-4701-bd87-fe57d631a5a3 req-fe19d762-5647-424e-9cd1-b6abf9030276 service nova] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:52:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8e07c0aa-5d6e-4701-bd87-fe57d631a5a3 req-fe19d762-5647-424e-9cd1-b6abf9030276 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:52:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8e07c0aa-5d6e-4701-bd87-fe57d631a5a3 req-fe19d762-5647-424e-9cd1-b6abf9030276 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:52:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-8e07c0aa-5d6e-4701-bd87-fe57d631a5a3 req-fe19d762-5647-424e-9cd1-b6abf9030276 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] No waiting events found dispatching network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:52:45 user nova-compute[72874]: WARNING nova.compute.manager [req-8e07c0aa-5d6e-4701-bd87-fe57d631a5a3 req-fe19d762-5647-424e-9cd1-b6abf9030276 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received unexpected event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 for instance with vm_state stopped and task_state None.
Aug 17 18:52:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:46 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:52:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:52:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:52:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:52:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:52:46 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:52:46 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:52:46 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updating instance_info_cache with network_info: [{"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:52:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:52:46 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:52:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:52:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:52:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:52:54 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:52:54 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:52:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:52:55 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:52:56 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:52:56 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:52:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 18:52:59 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692298364.1713207, 5a26e8ee-a875-4eb7-b924-c5c8962263b1 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:52:59 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] VM Stopped (Lifecycle Event)
Aug 17 18:52:59 user nova-compute[72874]: DEBUG nova.compute.manager [None req-58d8e1ef-115e-4673-a7f8-0e553fbe06ea None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:52:59 user nova-compute[72874]: DEBUG nova.compute.manager [None req-58d8e1ef-115e-4673-a7f8-0e553fbe06ea None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:52:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:53:04 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:53:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 18:53:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] There are 0 instances to clean {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 18:53:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:53:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:53:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:53:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:53:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:53:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:53:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:53:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:53:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid 9c458df7-d3d0-4f7d-b972-9f643427cf87 {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 18:53:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:53:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:53:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "9c458df7-d3d0-4f7d-b972-9f643427cf87" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:53:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "9c458df7-d3d0-4f7d-b972-9f643427cf87" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:53:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "9c458df7-d3d0-4f7d-b972-9f643427cf87" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:53:16 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:53:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "9c458df7-d3d0-4f7d-b972-9f643427cf87" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:53:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "9c458df7-d3d0-4f7d-b972-9f643427cf87" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:53:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "9c458df7-d3d0-4f7d-b972-9f643427cf87-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:53:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "9c458df7-d3d0-4f7d-b972-9f643427cf87-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:53:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "9c458df7-d3d0-4f7d-b972-9f643427cf87-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:53:36 user nova-compute[72874]: INFO nova.compute.manager [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Terminating instance
Aug 17 18:53:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:53:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-251c2efb-f156-4a29-a80c-9b95f99ccdc6 req-cddf0708-7f20-4749-8721-bdd39c2ecad2 service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Received event network-vif-unplugged-f93fd5ac-fa02-48d4-ad64-f1dda6a61320 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-251c2efb-f156-4a29-a80c-9b95f99ccdc6 req-cddf0708-7f20-4749-8721-bdd39c2ecad2 service nova] Acquiring lock "9c458df7-d3d0-4f7d-b972-9f643427cf87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-251c2efb-f156-4a29-a80c-9b95f99ccdc6 req-cddf0708-7f20-4749-8721-bdd39c2ecad2 service nova] Lock "9c458df7-d3d0-4f7d-b972-9f643427cf87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-251c2efb-f156-4a29-a80c-9b95f99ccdc6 req-cddf0708-7f20-4749-8721-bdd39c2ecad2 service nova] Lock "9c458df7-d3d0-4f7d-b972-9f643427cf87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-251c2efb-f156-4a29-a80c-9b95f99ccdc6 req-cddf0708-7f20-4749-8721-bdd39c2ecad2 service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] No waiting events found dispatching network-vif-unplugged-f93fd5ac-fa02-48d4-ad64-f1dda6a61320 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-251c2efb-f156-4a29-a80c-9b95f99ccdc6 req-cddf0708-7f20-4749-8721-bdd39c2ecad2 service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Received event network-vif-unplugged-f93fd5ac-fa02-48d4-ad64-f1dda6a61320 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:37 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Instance destroyed successfully.
Aug 17 18:53:37 user nova-compute[72874]: DEBUG nova.objects.instance [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lazy-loading 'resources' on Instance uuid 9c458df7-d3d0-4f7d-b972-9f643427cf87 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1620933105',display_name='tempest-TestVolumeBootPattern-server-1620933105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1620933105',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:52:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-4weg0fte',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:52:08Z,user_data=None,user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=9c458df7-d3d0-4f7d-b972-9f643427cf87,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "address": "fa:16:3e:ac:15:8e", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fd5ac-fa", "ovs_interfaceid": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "address": "fa:16:3e:ac:15:8e", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf93fd5ac-fa", "ovs_interfaceid": "f93fd5ac-fa02-48d4-ad64-f1dda6a61320", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:15:8e,bridge_name='br-int',has_traffic_filtering=True,id=f93fd5ac-fa02-48d4-ad64-f1dda6a61320,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93fd5ac-fa') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_vif [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:15:8e,bridge_name='br-int',has_traffic_filtering=True,id=f93fd5ac-fa02-48d4-ad64-f1dda6a61320,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93fd5ac-fa') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf93fd5ac-fa, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:37 user nova-compute[72874]: INFO os_vif [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:15:8e,bridge_name='br-int',has_traffic_filtering=True,id=f93fd5ac-fa02-48d4-ad64-f1dda6a61320,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf93fd5ac-fa')
Aug 17 18:53:37 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NTRBOxLu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:53:37 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf651cd-aa74-41ac-a221-a456e6cc26a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[870c614b-150c-45eb-b9ca-021f311bcec6]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 (non-flash)
Aug 17 18:53:37 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 (non-flash)
Aug 17 18:53:37 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a06ac790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3'): ({'sdc'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Removing single pathed devices sdc {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c86697e-f753-4e5c-b0df-94c8fbc511bc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[decd0ae6-a520-4e53-abab-8d49c7b53c75]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flushing IO for device /dev/sdc {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de82a79-0670-476a-a239-d86832e5566f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.030s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d73b1e-43da-43e4-b1b7-c6ed80d1b0f0]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26363663166663937', '/dev/disk/by-id/scsi-1SCST_BIO4927df32-ccf1ff97dcb30a87', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_4927df32') {{(pid=83588) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca16f593-e6fa-4934-bf72-4483a0af8a77]: (4, None) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7988bff-a76c-4b6e-aa54-29d4114064ff]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b11c01-4864-4085-90b1-f4bf2252d94d]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3, portal: 172.16.0.220,3260]
Aug 17 18:53:37 user nova-compute[72874]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3, portal: 172.16.0.220,3260] successful.
Aug 17 18:53:37 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d81048df-a5c4-4c3e-96d9-152acf7e0ae3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[377ce688-02c0-477d-b51e-fdfde0ead422]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.262s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== disconnect_volume: return (263ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:53:37 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Deleting instance files /opt/stack/data/nova/instances/9c458df7-d3d0-4f7d-b972-9f643427cf87_del
Aug 17 18:53:37 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Deletion of /opt/stack/data/nova/instances/9c458df7-d3d0-4f7d-b972-9f643427cf87_del complete
Aug 17 18:53:37 user nova-compute[72874]: INFO nova.compute.manager [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 17 18:53:37 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:53:37 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:53:38 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:53:38 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Took 0.57 seconds to deallocate network for instance.
Aug 17 18:53:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-833bcc91-d142-4997-b0ab-1ba0d6e89f02 req-de342bf2-b8db-4774-95fb-f4f4b416f385 service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Received event network-vif-deleted-f93fd5ac-fa02-48d4-ad64-f1dda6a61320 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:53:38 user nova-compute[72874]: INFO nova.compute.manager [req-833bcc91-d142-4997-b0ab-1ba0d6e89f02 req-de342bf2-b8db-4774-95fb-f4f4b416f385 service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Neutron deleted interface f93fd5ac-fa02-48d4-ad64-f1dda6a61320; detaching it from the instance and deleting it from the info cache
Aug 17 18:53:38 user nova-compute[72874]: DEBUG nova.network.neutron [req-833bcc91-d142-4997-b0ab-1ba0d6e89f02 req-de342bf2-b8db-4774-95fb-f4f4b416f385 service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:53:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-833bcc91-d142-4997-b0ab-1ba0d6e89f02 req-de342bf2-b8db-4774-95fb-f4f4b416f385 service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Detach interface failed, port_id=f93fd5ac-fa02-48d4-ad64-f1dda6a61320, reason: Instance 9c458df7-d3d0-4f7d-b972-9f643427cf87 could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:53:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-1255d5e2-c245-493f-b61e-193b8f8b53a7 req-01ccfe8c-79a3-4638-816d-5f802c5ae381 service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Received event network-vif-plugged-f93fd5ac-fa02-48d4-ad64-f1dda6a61320 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:53:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1255d5e2-c245-493f-b61e-193b8f8b53a7 req-01ccfe8c-79a3-4638-816d-5f802c5ae381 service nova] Acquiring lock "9c458df7-d3d0-4f7d-b972-9f643427cf87-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:53:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1255d5e2-c245-493f-b61e-193b8f8b53a7 req-01ccfe8c-79a3-4638-816d-5f802c5ae381 service nova] Lock "9c458df7-d3d0-4f7d-b972-9f643427cf87-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:53:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1255d5e2-c245-493f-b61e-193b8f8b53a7 req-01ccfe8c-79a3-4638-816d-5f802c5ae381 service nova] Lock "9c458df7-d3d0-4f7d-b972-9f643427cf87-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:53:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-1255d5e2-c245-493f-b61e-193b8f8b53a7 req-01ccfe8c-79a3-4638-816d-5f802c5ae381 service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] No waiting events found dispatching network-vif-plugged-f93fd5ac-fa02-48d4-ad64-f1dda6a61320 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:53:39 user nova-compute[72874]: WARNING nova.compute.manager [req-1255d5e2-c245-493f-b61e-193b8f8b53a7 req-01ccfe8c-79a3-4638-816d-5f802c5ae381 service nova] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Received unexpected event network-vif-plugged-f93fd5ac-fa02-48d4-ad64-f1dda6a61320 for instance with vm_state active and task_state deleting.
Aug 17 18:53:39 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:53:39 user nova-compute[72874]: INFO nova.compute.manager [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Took 0.79 seconds to detach 1 volumes for instance.
Aug 17 18:53:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Deleting volume: d81048df-a5c4-4c3e-96d9-152acf7e0ae3 {{(pid=72874) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 18:53:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:53:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:53:39 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Refreshing inventories for resource provider b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 18:53:39 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Updating ProviderTree inventory for provider b677d836-b01b-4674-8972-53d526f1b5f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 18:53:39 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Updating inventory in ProviderTree for provider b677d836-b01b-4674-8972-53d526f1b5f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 18:53:39 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Refreshing aggregate associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, aggregates: None {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 18:53:39 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Refreshing trait associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, traits: HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 18:53:39 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:53:39 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:53:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:53:39 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Deleted allocations for instance 9c458df7-d3d0-4f7d-b972-9f643427cf87
Aug 17 18:53:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4003f3c8-7e5d-4fe2-b396-d209543cc1aa tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "9c458df7-d3d0-4f7d-b972-9f643427cf87" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.125s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:53:40 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:53:40 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:53:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:53:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:53:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:53:40 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:53:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:53:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:53:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:53:40 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:53:40 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:53:40 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:53:40 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8917MB free_disk=25.201129913330078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:53:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:53:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:53:41 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 5a26e8ee-a875-4eb7-b924-c5c8962263b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:53:41 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:53:41 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:53:41 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:53:41 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:53:41 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:53:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:53:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:45 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:53:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:53:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:53:47 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Didn't find any instances for network info cache update. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 18:53:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:53:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:53:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:53:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:53:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:53:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:48 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:53:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:53:52 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692298417.54172, 9c458df7-d3d0-4f7d-b972-9f643427cf87 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:53:52 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] VM Stopped (Lifecycle Event)
Aug 17 18:53:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-0cc47c84-cf78-41a5-8cda-d40df41492b0 None None] [instance: 9c458df7-d3d0-4f7d-b972-9f643427cf87] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:53:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:53:56 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:53:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:53:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:54:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:54:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:54:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:54:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:54:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:54:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:54:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.objects.instance [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'flavor' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquired lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.network.neutron [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.objects.instance [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'info_cache' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.network.neutron [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updating instance_info_cache with network_info: [{"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Releasing lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:54:34 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Instance destroyed successfully.
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.objects.instance [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'resources' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1371027525',display_name='tempest-AttachVolumeTestJSON-server-1371027525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1371027525',id=43,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdYfs/sLUHWSa/zvMpaUBe7Xc8Lp+dlZ+f30CtjbQ0OE5px5SGs8/VJAlNvxluJTvxKRCJtg4fLA7lBgSn8v6Si0I44hT1DD+ksfJGKy/yMOfXst7dOgevQ5DBh7zmIPw==',key_name='tempest-keypair-1286931965',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:46:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4d8e6936f2004a5cbb90e1e26f3ec28d',ramdisk_id='',reservation_id='r-7syakzfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-385757460',owner_user_name='tempest-AttachVolumeTestJSON-385757460-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:52:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b47a0411fa4642bfc5aa08f48919c9',uuid=5a26e8ee-a875-4eb7-b924-c5c8962263b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converting VIF {"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG os_vif [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8cb8b2c-5f, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:54:34 user nova-compute[72874]: INFO os_vif [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f')
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Start _get_guest_xml network_info=[{"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.objects.instance [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'numa_topology' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:54:34 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:54:34 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.objects.instance [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1371027525',display_name='tempest-AttachVolumeTestJSON-server-1371027525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1371027525',id=43,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdYfs/sLUHWSa/zvMpaUBe7Xc8Lp+dlZ+f30CtjbQ0OE5px5SGs8/VJAlNvxluJTvxKRCJtg4fLA7lBgSn8v6Si0I44hT1DD+ksfJGKy/yMOfXst7dOgevQ5DBh7zmIPw==',key_name='tempest-keypair-1286931965',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:46:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4d8e6936f2004a5cbb90e1e26f3ec28d',ramdisk_id='',reservation_id='r-7syakzfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-385757460',owner_user_name='tempest-AttachVolumeTestJSON-385757460-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:52:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b47a0411fa4642bfc5aa08f48919c9',uuid=5a26e8ee-a875-4eb7-b924-c5c8962263b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converting VIF {"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.objects.instance [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:54:34 user nova-compute[72874]:   <uuid>5a26e8ee-a875-4eb7-b924-c5c8962263b1</uuid>
Aug 17 18:54:34 user nova-compute[72874]:   <name>instance-0000002b</name>
Aug 17 18:54:34 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:54:34 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:54:34 user nova-compute[72874]:   <metadata>
Aug 17 18:54:34 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:54:34 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:54:34 user nova-compute[72874]:       <nova:name>tempest-AttachVolumeTestJSON-server-1371027525</nova:name>
Aug 17 18:54:34 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:54:34</nova:creationTime>
Aug 17 18:54:34 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:54:34 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:54:34 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:54:34 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:54:34 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:54:34 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:54:34 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:54:34 user nova-compute[72874]:       <nova:owner>
Aug 17 18:54:34 user nova-compute[72874]:         <nova:user uuid="04b47a0411fa4642bfc5aa08f48919c9">tempest-AttachVolumeTestJSON-385757460-project-member</nova:user>
Aug 17 18:54:34 user nova-compute[72874]:         <nova:project uuid="4d8e6936f2004a5cbb90e1e26f3ec28d">tempest-AttachVolumeTestJSON-385757460</nova:project>
Aug 17 18:54:34 user nova-compute[72874]:       </nova:owner>
Aug 17 18:54:34 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:54:34 user nova-compute[72874]:       <nova:ports>
Aug 17 18:54:34 user nova-compute[72874]:         <nova:port uuid="f8cb8b2c-5fed-45a5-a03e-865b8bfcea41">
Aug 17 18:54:34 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 18:54:34 user nova-compute[72874]:         </nova:port>
Aug 17 18:54:34 user nova-compute[72874]:       </nova:ports>
Aug 17 18:54:34 user nova-compute[72874]:     </nova:instance>
Aug 17 18:54:34 user nova-compute[72874]:   </metadata>
Aug 17 18:54:34 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:54:34 user nova-compute[72874]:     <system>
Aug 17 18:54:34 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:54:34 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:54:34 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:54:34 user nova-compute[72874]:       <entry name="serial">5a26e8ee-a875-4eb7-b924-c5c8962263b1</entry>
Aug 17 18:54:34 user nova-compute[72874]:       <entry name="uuid">5a26e8ee-a875-4eb7-b924-c5c8962263b1</entry>
Aug 17 18:54:34 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:54:34 user nova-compute[72874]:     </system>
Aug 17 18:54:34 user nova-compute[72874]:   </sysinfo>
Aug 17 18:54:34 user nova-compute[72874]:   <os>
Aug 17 18:54:34 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:54:34 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:54:34 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:54:34 user nova-compute[72874]:   </os>
Aug 17 18:54:34 user nova-compute[72874]:   <features>
Aug 17 18:54:34 user nova-compute[72874]:     <acpi/>
Aug 17 18:54:34 user nova-compute[72874]:     <apic/>
Aug 17 18:54:34 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:54:34 user nova-compute[72874]:   </features>
Aug 17 18:54:34 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:54:34 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:54:34 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:54:34 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:54:34 user nova-compute[72874]:   </clock>
Aug 17 18:54:34 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:54:34 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:54:34 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:54:34 user nova-compute[72874]:   </cpu>
Aug 17 18:54:34 user nova-compute[72874]:   <devices>
Aug 17 18:54:34 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:54:34 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:54:34 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk"/>
Aug 17 18:54:34 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:54:34 user nova-compute[72874]:     </disk>
Aug 17 18:54:34 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:54:34 user nova-compute[72874]:       <mac address="fa:16:3e:24:1d:06"/>
Aug 17 18:54:34 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:54:34 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:54:34 user nova-compute[72874]:       <target dev="tapf8cb8b2c-5f"/>
Aug 17 18:54:34 user nova-compute[72874]:     </interface>
Aug 17 18:54:34 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:54:34 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/console.log" append="off"/>
Aug 17 18:54:34 user nova-compute[72874]:     </serial>
Aug 17 18:54:34 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:54:34 user nova-compute[72874]:     <video>
Aug 17 18:54:34 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:54:34 user nova-compute[72874]:     </video>
Aug 17 18:54:34 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:54:34 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:54:34 user nova-compute[72874]:     </rng>
Aug 17 18:54:34 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:54:34 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:54:34 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:54:34 user nova-compute[72874]:     </memballoon>
Aug 17 18:54:34 user nova-compute[72874]:   </devices>
Aug 17 18:54:34 user nova-compute[72874]: </domain>
Aug 17 18:54:34 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:54:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG nova.objects.instance [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.177s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Cannot resize image /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG nova.objects.instance [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'migration_context' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1371027525',display_name='tempest-AttachVolumeTestJSON-server-1371027525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1371027525',id=43,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdYfs/sLUHWSa/zvMpaUBe7Xc8Lp+dlZ+f30CtjbQ0OE5px5SGs8/VJAlNvxluJTvxKRCJtg4fLA7lBgSn8v6Si0I44hT1DD+ksfJGKy/yMOfXst7dOgevQ5DBh7zmIPw==',key_name='tempest-keypair-1286931965',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:46:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='4d8e6936f2004a5cbb90e1e26f3ec28d',ramdisk_id='',reservation_id='r-7syakzfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-385757460',owner_user_name='tempest-AttachVolumeTestJSON-385757460-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:52:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b47a0411fa4642bfc5aa08f48919c9',uuid=5a26e8ee-a875-4eb7-b924-c5c8962263b1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converting VIF {"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG os_vif [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8cb8b2c-5f, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf8cb8b2c-5f, col_values=(('external_ids', {'iface-id': 'f8cb8b2c-5fed-45a5-a03e-865b8bfcea41', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:1d:06', 'vm-uuid': '5a26e8ee-a875-4eb7-b924-c5c8962263b1'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:54:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:35 user nova-compute[72874]: INFO os_vif [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f')
Aug 17 18:54:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-fc3c75cc-9a65-4d7a-b21a-9c501a76f416 req-5dbd9c46-86ec-42e8-afa2-f62048986a71 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:54:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fc3c75cc-9a65-4d7a-b21a-9c501a76f416 req-5dbd9c46-86ec-42e8-afa2-f62048986a71 service nova] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:54:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fc3c75cc-9a65-4d7a-b21a-9c501a76f416 req-5dbd9c46-86ec-42e8-afa2-f62048986a71 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:54:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-fc3c75cc-9a65-4d7a-b21a-9c501a76f416 req-5dbd9c46-86ec-42e8-afa2-f62048986a71 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:54:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-fc3c75cc-9a65-4d7a-b21a-9c501a76f416 req-5dbd9c46-86ec-42e8-afa2-f62048986a71 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] No waiting events found dispatching network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:54:37 user nova-compute[72874]: WARNING nova.compute.manager [req-fc3c75cc-9a65-4d7a-b21a-9c501a76f416 req-5dbd9c46-86ec-42e8-afa2-f62048986a71 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received unexpected event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 for instance with vm_state stopped and task_state powering-on.
Aug 17 18:54:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:39 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692298479.039979, 5a26e8ee-a875-4eb7-b924-c5c8962263b1 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:54:39 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] VM Resumed (Lifecycle Event)
Aug 17 18:54:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:54:39 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Instance rebooted successfully.
Aug 17 18:54:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-dcb07b14-dcb9-4bc8-a715-856e68477753 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:54:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:54:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:54:39 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 18:54:39 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692298479.0412557, 5a26e8ee-a875-4eb7-b924-c5c8962263b1 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:54:39 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] VM Started (Lifecycle Event)
Aug 17 18:54:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:54:39 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:54:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-67013f06-5fa1-44f3-b58c-386509f8f258 req-6870b908-2698-4b71-bc54-68f4abfffec2 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:54:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-67013f06-5fa1-44f3-b58c-386509f8f258 req-6870b908-2698-4b71-bc54-68f4abfffec2 service nova] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:54:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-67013f06-5fa1-44f3-b58c-386509f8f258 req-6870b908-2698-4b71-bc54-68f4abfffec2 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:54:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-67013f06-5fa1-44f3-b58c-386509f8f258 req-6870b908-2698-4b71-bc54-68f4abfffec2 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:54:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-67013f06-5fa1-44f3-b58c-386509f8f258 req-6870b908-2698-4b71-bc54-68f4abfffec2 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] No waiting events found dispatching network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:54:39 user nova-compute[72874]: WARNING nova.compute.manager [req-67013f06-5fa1-44f3-b58c-386509f8f258 req-6870b908-2698-4b71-bc54-68f4abfffec2 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received unexpected event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 for instance with vm_state active and task_state None.
Aug 17 18:54:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:41 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:54:42 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:54:42 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:54:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:54:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:54:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:54:42 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:54:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:54:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:54:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:54:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:54:43 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:54:43 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:54:43 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8877MB free_disk=25.191783905029297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:54:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:54:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:54:43 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 5a26e8ee-a875-4eb7-b924-c5c8962263b1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:54:43 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:54:43 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:54:43 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:54:43 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:54:43 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:54:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:54:45 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:54:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:48 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:54:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:54:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:54:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:54:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:54:48 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:54:48 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:54:48 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updating instance_info_cache with network_info: [{"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:54:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:54:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:54:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:54:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:54:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:54:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:54:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:54:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:54:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:54:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:54:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:54:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:54:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:54:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:54:53 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:54:53 user nova-compute[72874]: INFO nova.compute.claims [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Claim successful on node user
Aug 17 18:54:53 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:54:53 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:54:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.226s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:54:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:54:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:54:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:54:53 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:54:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:54:54 user nova-compute[72874]: INFO nova.virt.block_device [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Booting with volume bdd618c9-3765-4380-a933-86b0a38bbdef at /dev/vda
Aug 17 18:54:54 user nova-compute[72874]: DEBUG nova.policy [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73cdc5d076a14395ad1958394f0c48e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41b302a39da4ab18c463789f2a73dd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG os_brick.utils [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f838e39b-6087-49eb-b6d8-c2df9f9c3674]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5709632-fe4c-41a5-97da-714bfa9f9c0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe305774-bf16-445c-920c-2b65ed778479]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a321077-7748-48f2-a6ad-c925ecdb6487]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:54:54 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:54:54 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c2d26f-a291-4447-96ed-b1c8e4325430]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG os_brick.utils [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Updating existing volume attachment record: a963cbd7-3533-4379-80d6-99d1d9821c44 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:54:54 user nova-compute[72874]: DEBUG nova.network.neutron [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Successfully created port: f25fb1ed-c869-4d45-b859-50a9f757b481 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:54:55 user nova-compute[72874]: DEBUG nova.network.neutron [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Successfully updated port: f25fb1ed-c869-4d45-b859-50a9f757b481 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:54:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "refresh_cache-60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:54:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquired lock "refresh_cache-60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:54:55 user nova-compute[72874]: DEBUG nova.network.neutron [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:54:55 user nova-compute[72874]: DEBUG nova.network.neutron [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:54:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-7dadbc39-becc-4e4f-a1b2-7fd64d04fa53 req-eeea916a-25a3-4e08-be5f-51694edac553 service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Received event network-changed-f25fb1ed-c869-4d45-b859-50a9f757b481 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:54:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-7dadbc39-becc-4e4f-a1b2-7fd64d04fa53 req-eeea916a-25a3-4e08-be5f-51694edac553 service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Refreshing instance network info cache due to event network-changed-f25fb1ed-c869-4d45-b859-50a9f757b481. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:54:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7dadbc39-becc-4e4f-a1b2-7fd64d04fa53 req-eeea916a-25a3-4e08-be5f-51694edac553 service nova] Acquiring lock "refresh_cache-60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:54:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:55 user nova-compute[72874]: DEBUG nova.network.neutron [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Updating instance_info_cache with network_info: [{"id": "f25fb1ed-c869-4d45-b859-50a9f757b481", "address": "fa:16:3e:20:0a:ef", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25fb1ed-c8", "ovs_interfaceid": "f25fb1ed-c869-4d45-b859-50a9f757b481", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:54:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Releasing lock "refresh_cache-60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:54:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Instance network_info: |[{"id": "f25fb1ed-c869-4d45-b859-50a9f757b481", "address": "fa:16:3e:20:0a:ef", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25fb1ed-c8", "ovs_interfaceid": "f25fb1ed-c869-4d45-b859-50a9f757b481", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:54:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7dadbc39-becc-4e4f-a1b2-7fd64d04fa53 req-eeea916a-25a3-4e08-be5f-51694edac553 service nova] Acquired lock "refresh_cache-60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:54:55 user nova-compute[72874]: DEBUG nova.network.neutron [req-7dadbc39-becc-4e4f-a1b2-7fd64d04fa53 req-eeea916a-25a3-4e08-be5f-51694edac553 service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Refreshing network info cache for port f25fb1ed-c869-4d45-b859-50a9f757b481 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:54:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:54:56 user nova-compute[72874]: DEBUG nova.network.neutron [req-7dadbc39-becc-4e4f-a1b2-7fd64d04fa53 req-eeea916a-25a3-4e08-be5f-51694edac553 service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Updated VIF entry in instance network info cache for port f25fb1ed-c869-4d45-b859-50a9f757b481. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:54:56 user nova-compute[72874]: DEBUG nova.network.neutron [req-7dadbc39-becc-4e4f-a1b2-7fd64d04fa53 req-eeea916a-25a3-4e08-be5f-51694edac553 service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Updating instance_info_cache with network_info: [{"id": "f25fb1ed-c869-4d45-b859-50a9f757b481", "address": "fa:16:3e:20:0a:ef", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25fb1ed-c8", "ovs_interfaceid": "f25fb1ed-c869-4d45-b859-50a9f757b481", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:54:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7dadbc39-becc-4e4f-a1b2-7fd64d04fa53 req-eeea916a-25a3-4e08-be5f-51694edac553 service nova] Releasing lock "refresh_cache-60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:54:57 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:54:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:54:58 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:55:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:55:04 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Creating image(s)
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Ensure instance console log exists: /opt/stack/data/nova/instances/60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Start _get_guest_xml network_info=[{"id": "f25fb1ed-c869-4d45-b859-50a9f757b481", "address": "fa:16:3e:20:0a:ef", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25fb1ed-c8", "ovs_interfaceid": "f25fb1ed-c869-4d45-b859-50a9f757b481", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQtfrMwC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d', 'attached_at': '', 'detached_at': '', 'volume_id': 'bdd618c9-3765-4380-a933-86b0a38bbdef', 'serial': 'bdd618c9-3765-4380-a933-86b0a38bbdef'}, 'delete_on_termination': True, 'attachment_id': 'a963cbd7-3533-4379-80d6-99d1d9821c44', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:55:04 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:55:04 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQtfrMwC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:55:04 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:55:04 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:55:04 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6634b3-a898-418e-b947-784ac45070c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:55:04 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5768fdb1-2f18-4501-9df1-c467037bf18a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef] added
Aug 17 18:55:04 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcffb0aa-3419-4160-ae6e-b6fb5dcf8a05]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef926f67-6a00-4355-af44-795485b588f0]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQtfrMwC {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jQtfrMwC" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[284cc8f5-c5b3-4f9f-8eab-39cce753bbe9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jQtfrMwC'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e45a06-8af1-4821-add7-b3d531cf33f5]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffe3d4b-fc8c-448b-8720-4fe4830d9f52]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 18:55:04 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 18:55:04 user nova-compute[72874]:  {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:55:04 user nova-compute[72874]: WARNING os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 18:55:04 user nova-compute[72874]: 
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98d4bdf-9b5e-4003-b7b0-618e4d7439ec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef, portal: 172.16.0.220,3260]
Aug 17 18:55:04 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef, portal: 172.16.0.220,3260] successful.
Aug 17 18:55:04 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa935e9c-ca53-41c1-8dbd-a9bd394246d0]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5d2ddd-6418-4706-a41e-dd499231bf26]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:55:04 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:55:04 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[da85e95e-ff1e-4a87-b653-14e3bc85a4cb]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:55:04 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQtfrMwC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '23765393439656362', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765393439656362', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:54:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1009074682',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1009074682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1009074682',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEw8BZRSjRimQoOO53DLzKJMSpq3XOp8IZ459p9aFOe+ez+iREoZ0nYAOJvJVTJziEeMcqaGfpiaEYQlwARzjqfTgXjPDjT15zk5QtTTNN31Il67BEMCjQcGwpTKqFk2FA==',key_name='tempest-keypair-1165959610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-bl0wa7tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:54:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f25fb1ed-c869-4d45-b859-50a9f757b481", "address": "fa:16:3e:20:0a:ef", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25fb1ed-c8", "ovs_interfaceid": "f25fb1ed-c869-4d45-b859-50a9f757b481", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "f25fb1ed-c869-4d45-b859-50a9f757b481", "address": "fa:16:3e:20:0a:ef", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25fb1ed-c8", "ovs_interfaceid": "f25fb1ed-c869-4d45-b859-50a9f757b481", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:0a:ef,bridge_name='br-int',has_traffic_filtering=True,id=f25fb1ed-c869-4d45-b859-50a9f757b481,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25fb1ed-c8') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG nova.objects.instance [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lazy-loading 'pci_devices' on Instance uuid 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:55:05 user nova-compute[72874]:   <uuid>60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d</uuid>
Aug 17 18:55:05 user nova-compute[72874]:   <name>instance-0000002d</name>
Aug 17 18:55:05 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:55:05 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:55:05 user nova-compute[72874]:   <metadata>
Aug 17 18:55:05 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:55:05 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:55:05 user nova-compute[72874]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1009074682</nova:name>
Aug 17 18:55:05 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:55:04</nova:creationTime>
Aug 17 18:55:05 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:55:05 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:55:05 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:55:05 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:55:05 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:55:05 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:55:05 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:55:05 user nova-compute[72874]:       <nova:owner>
Aug 17 18:55:05 user nova-compute[72874]:         <nova:user uuid="73cdc5d076a14395ad1958394f0c48e4">tempest-TestVolumeBootPattern-414332602-project-member</nova:user>
Aug 17 18:55:05 user nova-compute[72874]:         <nova:project uuid="f41b302a39da4ab18c463789f2a73dd5">tempest-TestVolumeBootPattern-414332602</nova:project>
Aug 17 18:55:05 user nova-compute[72874]:       </nova:owner>
Aug 17 18:55:05 user nova-compute[72874]:       <nova:ports>
Aug 17 18:55:05 user nova-compute[72874]:         <nova:port uuid="f25fb1ed-c869-4d45-b859-50a9f757b481">
Aug 17 18:55:05 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 18:55:05 user nova-compute[72874]:         </nova:port>
Aug 17 18:55:05 user nova-compute[72874]:       </nova:ports>
Aug 17 18:55:05 user nova-compute[72874]:     </nova:instance>
Aug 17 18:55:05 user nova-compute[72874]:   </metadata>
Aug 17 18:55:05 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:55:05 user nova-compute[72874]:     <system>
Aug 17 18:55:05 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:55:05 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:55:05 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:55:05 user nova-compute[72874]:       <entry name="serial">60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d</entry>
Aug 17 18:55:05 user nova-compute[72874]:       <entry name="uuid">60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d</entry>
Aug 17 18:55:05 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:55:05 user nova-compute[72874]:     </system>
Aug 17 18:55:05 user nova-compute[72874]:   </sysinfo>
Aug 17 18:55:05 user nova-compute[72874]:   <os>
Aug 17 18:55:05 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:55:05 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:55:05 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:55:05 user nova-compute[72874]:   </os>
Aug 17 18:55:05 user nova-compute[72874]:   <features>
Aug 17 18:55:05 user nova-compute[72874]:     <acpi/>
Aug 17 18:55:05 user nova-compute[72874]:     <apic/>
Aug 17 18:55:05 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:55:05 user nova-compute[72874]:   </features>
Aug 17 18:55:05 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:55:05 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:55:05 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:55:05 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:55:05 user nova-compute[72874]:   </clock>
Aug 17 18:55:05 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:55:05 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:55:05 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:55:05 user nova-compute[72874]:   </cpu>
Aug 17 18:55:05 user nova-compute[72874]:   <devices>
Aug 17 18:55:05 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:55:05 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:55:05 user nova-compute[72874]:       <source dev="/dev/sdb"/>
Aug 17 18:55:05 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:55:05 user nova-compute[72874]:       <serial>bdd618c9-3765-4380-a933-86b0a38bbdef</serial>
Aug 17 18:55:05 user nova-compute[72874]:     </disk>
Aug 17 18:55:05 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:55:05 user nova-compute[72874]:       <mac address="fa:16:3e:20:0a:ef"/>
Aug 17 18:55:05 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:55:05 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:55:05 user nova-compute[72874]:       <target dev="tapf25fb1ed-c8"/>
Aug 17 18:55:05 user nova-compute[72874]:     </interface>
Aug 17 18:55:05 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:55:05 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d/console.log" append="off"/>
Aug 17 18:55:05 user nova-compute[72874]:     </serial>
Aug 17 18:55:05 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:55:05 user nova-compute[72874]:     <video>
Aug 17 18:55:05 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:55:05 user nova-compute[72874]:     </video>
Aug 17 18:55:05 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:55:05 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:55:05 user nova-compute[72874]:     </rng>
Aug 17 18:55:05 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:55:05 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:55:05 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:55:05 user nova-compute[72874]:     </memballoon>
Aug 17 18:55:05 user nova-compute[72874]:   </devices>
Aug 17 18:55:05 user nova-compute[72874]: </domain>
Aug 17 18:55:05 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:54:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1009074682',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1009074682',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1009074682',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEw8BZRSjRimQoOO53DLzKJMSpq3XOp8IZ459p9aFOe+ez+iREoZ0nYAOJvJVTJziEeMcqaGfpiaEYQlwARzjqfTgXjPDjT15zk5QtTTNN31Il67BEMCjQcGwpTKqFk2FA==',key_name='tempest-keypair-1165959610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-bl0wa7tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:54:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f25fb1ed-c869-4d45-b859-50a9f757b481", "address": "fa:16:3e:20:0a:ef", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25fb1ed-c8", "ovs_interfaceid": "f25fb1ed-c869-4d45-b859-50a9f757b481", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "f25fb1ed-c869-4d45-b859-50a9f757b481", "address": "fa:16:3e:20:0a:ef", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25fb1ed-c8", "ovs_interfaceid": "f25fb1ed-c869-4d45-b859-50a9f757b481", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:0a:ef,bridge_name='br-int',has_traffic_filtering=True,id=f25fb1ed-c869-4d45-b859-50a9f757b481,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25fb1ed-c8') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG os_vif [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:0a:ef,bridge_name='br-int',has_traffic_filtering=True,id=f25fb1ed-c869-4d45-b859-50a9f757b481,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25fb1ed-c8') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf25fb1ed-c8, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf25fb1ed-c8, col_values=(('external_ids', {'iface-id': 'f25fb1ed-c869-4d45-b859-50a9f757b481', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:0a:ef', 'vm-uuid': '60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:05 user nova-compute[72874]: INFO os_vif [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:0a:ef,bridge_name='br-int',has_traffic_filtering=True,id=f25fb1ed-c869-4d45-b859-50a9f757b481,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25fb1ed-c8')
Aug 17 18:55:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:55:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] No VIF found with MAC fa:16:3e:20:0a:ef, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:55:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-0bc79c73-0e14-4519-875b-92d8e89a2642 req-29f27988-94a7-4990-9b4b-fdb06cda48a8 service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Received event network-vif-plugged-f25fb1ed-c869-4d45-b859-50a9f757b481 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:55:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0bc79c73-0e14-4519-875b-92d8e89a2642 req-29f27988-94a7-4990-9b4b-fdb06cda48a8 service nova] Acquiring lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:55:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0bc79c73-0e14-4519-875b-92d8e89a2642 req-29f27988-94a7-4990-9b4b-fdb06cda48a8 service nova] Lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:55:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0bc79c73-0e14-4519-875b-92d8e89a2642 req-29f27988-94a7-4990-9b4b-fdb06cda48a8 service nova] Lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:55:07 user nova-compute[72874]: DEBUG nova.compute.manager [req-0bc79c73-0e14-4519-875b-92d8e89a2642 req-29f27988-94a7-4990-9b4b-fdb06cda48a8 service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] No waiting events found dispatching network-vif-plugged-f25fb1ed-c869-4d45-b859-50a9f757b481 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:55:07 user nova-compute[72874]: WARNING nova.compute.manager [req-0bc79c73-0e14-4519-875b-92d8e89a2642 req-29f27988-94a7-4990-9b4b-fdb06cda48a8 service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Received unexpected event network-vif-plugged-f25fb1ed-c869-4d45-b859-50a9f757b481 for instance with vm_state building and task_state spawning.
Aug 17 18:55:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692298509.1845727, 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:55:09 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] VM Resumed (Lifecycle Event)
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:55:09 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Instance spawned successfully.
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:55:09 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692298509.1857345, 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:55:09 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] VM Started (Lifecycle Event)
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:55:09 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:55:09 user nova-compute[72874]: INFO nova.compute.manager [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Took 4.80 seconds to spawn the instance on the hypervisor.
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:55:09 user nova-compute[72874]: INFO nova.compute.manager [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Took 15.77 seconds to build instance.
Aug 17 18:55:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-afd9c1dd-5a91-4717-89ce-55a1417f6a1c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.865s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.compute.manager [req-f6fa017f-0d7b-4bf1-943b-610d7ee91520 req-acbbed6f-b61f-45c6-83a1-e03a0e36324e service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Received event network-vif-plugged-f25fb1ed-c869-4d45-b859-50a9f757b481 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:55:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f6fa017f-0d7b-4bf1-943b-610d7ee91520 req-acbbed6f-b61f-45c6-83a1-e03a0e36324e service nova] Acquiring lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:55:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f6fa017f-0d7b-4bf1-943b-610d7ee91520 req-acbbed6f-b61f-45c6-83a1-e03a0e36324e service nova] Lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:55:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f6fa017f-0d7b-4bf1-943b-610d7ee91520 req-acbbed6f-b61f-45c6-83a1-e03a0e36324e service nova] Lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:55:09 user nova-compute[72874]: DEBUG nova.compute.manager [req-f6fa017f-0d7b-4bf1-943b-610d7ee91520 req-acbbed6f-b61f-45c6-83a1-e03a0e36324e service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] No waiting events found dispatching network-vif-plugged-f25fb1ed-c869-4d45-b859-50a9f757b481 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:55:09 user nova-compute[72874]: WARNING nova.compute.manager [req-f6fa017f-0d7b-4bf1-943b-610d7ee91520 req-acbbed6f-b61f-45c6-83a1-e03a0e36324e service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Received unexpected event network-vif-plugged-f25fb1ed-c869-4d45-b859-50a9f757b481 for instance with vm_state active and task_state None.
Aug 17 18:55:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:55:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:42 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:55:43 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:55:43 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:55:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:55:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:55:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:55:43 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:55:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:55:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:55:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:55:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:55:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:55:44 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:55:44 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:55:44 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8619MB free_disk=25.189712524414062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:55:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:55:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:55:44 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 5a26e8ee-a875-4eb7-b924-c5c8962263b1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:55:44 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:55:44 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:55:44 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:55:44 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:55:44 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:55:44 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:55:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:55:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:55:46 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:55:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:55:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:55:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:55:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:55:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:55:49 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:55:49 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:55:49 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updating instance_info_cache with network_info: [{"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:55:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-5a26e8ee-a875-4eb7-b924-c5c8962263b1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:55:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:55:50 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:55:50 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:55:50 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:55:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:55:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:55:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:55:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:55:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:55:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:55:57 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:55:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:56:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:56:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:56:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:56:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:56:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:56:25 user nova-compute[72874]: INFO nova.compute.manager [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Terminating instance
Aug 17 18:56:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-809c2026-9e59-4278-a1ad-db7c2b425a32 req-2f5cf773-d8f3-469f-82dc-96c42d38ea09 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received event network-vif-unplugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-809c2026-9e59-4278-a1ad-db7c2b425a32 req-2f5cf773-d8f3-469f-82dc-96c42d38ea09 service nova] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-809c2026-9e59-4278-a1ad-db7c2b425a32 req-2f5cf773-d8f3-469f-82dc-96c42d38ea09 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-809c2026-9e59-4278-a1ad-db7c2b425a32 req-2f5cf773-d8f3-469f-82dc-96c42d38ea09 service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-809c2026-9e59-4278-a1ad-db7c2b425a32 req-2f5cf773-d8f3-469f-82dc-96c42d38ea09 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] No waiting events found dispatching network-vif-unplugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-809c2026-9e59-4278-a1ad-db7c2b425a32 req-2f5cf773-d8f3-469f-82dc-96c42d38ea09 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received event network-vif-unplugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:25 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Instance destroyed successfully.
Aug 17 18:56:25 user nova-compute[72874]: DEBUG nova.objects.instance [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'resources' on Instance uuid 5a26e8ee-a875-4eb7-b924-c5c8962263b1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:46:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1371027525',display_name='tempest-AttachVolumeTestJSON-server-1371027525',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1371027525',id=43,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdYfs/sLUHWSa/zvMpaUBe7Xc8Lp+dlZ+f30CtjbQ0OE5px5SGs8/VJAlNvxluJTvxKRCJtg4fLA7lBgSn8v6Si0I44hT1DD+ksfJGKy/yMOfXst7dOgevQ5DBh7zmIPw==',key_name='tempest-keypair-1286931965',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:46:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d8e6936f2004a5cbb90e1e26f3ec28d',ramdisk_id='',reservation_id='r-7syakzfu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-385757460',owner_user_name='tempest-AttachVolumeTestJSON-385757460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:54:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b47a0411fa4642bfc5aa08f48919c9',uuid=5a26e8ee-a875-4eb7-b924-c5c8962263b1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converting VIF {"id": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "address": "fa:16:3e:24:1d:06", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8cb8b2c-5f", "ovs_interfaceid": "f8cb8b2c-5fed-45a5-a03e-865b8bfcea41", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG os_vif [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8cb8b2c-5f, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:56:25 user nova-compute[72874]: INFO os_vif [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:1d:06,bridge_name='br-int',has_traffic_filtering=True,id=f8cb8b2c-5fed-45a5-a03e-865b8bfcea41,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8cb8b2c-5f')
Aug 17 18:56:25 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Deleting instance files /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1_del
Aug 17 18:56:25 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Deletion of /opt/stack/data/nova/instances/5a26e8ee-a875-4eb7-b924-c5c8962263b1_del complete
Aug 17 18:56:26 user nova-compute[72874]: INFO nova.compute.manager [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 17 18:56:26 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:56:26 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:56:26 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:56:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:27 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:56:27 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Took 1.35 seconds to deallocate network for instance.
Aug 17 18:56:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-77cd500d-49bf-417e-a278-00c3c180a497 req-ebcd30a7-6552-41a5-8ceb-e92531901448 service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received event network-vif-deleted-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:56:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:56:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:56:27 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:56:27 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:56:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.215s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:56:27 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Deleted allocations for instance 5a26e8ee-a875-4eb7-b924-c5c8962263b1
Aug 17 18:56:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-8e0b0683-8446-4c9b-be1e-401ccd71262e req-6ea6f2a3-99fc-49db-889d-c63040df1ddb service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:56:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8e0b0683-8446-4c9b-be1e-401ccd71262e req-6ea6f2a3-99fc-49db-889d-c63040df1ddb service nova] Acquiring lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:56:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8e0b0683-8446-4c9b-be1e-401ccd71262e req-6ea6f2a3-99fc-49db-889d-c63040df1ddb service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:56:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-8e0b0683-8446-4c9b-be1e-401ccd71262e req-6ea6f2a3-99fc-49db-889d-c63040df1ddb service nova] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:56:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-8e0b0683-8446-4c9b-be1e-401ccd71262e req-6ea6f2a3-99fc-49db-889d-c63040df1ddb service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] No waiting events found dispatching network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:56:27 user nova-compute[72874]: WARNING nova.compute.manager [req-8e0b0683-8446-4c9b-be1e-401ccd71262e req-6ea6f2a3-99fc-49db-889d-c63040df1ddb service nova] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Received unexpected event network-vif-plugged-f8cb8b2c-5fed-45a5-a03e-865b8bfcea41 for instance with vm_state deleted and task_state None.
Aug 17 18:56:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8069c4b0-e071-4a1f-aef5-aaa2b9361bb5 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "5a26e8ee-a875-4eb7-b924-c5c8962263b1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.413s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:56:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:40 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692298585.902075, 5a26e8ee-a875-4eb7-b924-c5c8962263b1 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:56:40 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] VM Stopped (Lifecycle Event)
Aug 17 18:56:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-acf8faf9-5b9d-4464-8df2-b61e48b731df None None] [instance: 5a26e8ee-a875-4eb7-b924-c5c8962263b1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:56:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-e6e4d48f-8d72-4a98-9aff-128e916cd11b req-ed2aeb8a-8d7f-47ae-af6c-5aa9db7d5eb1 service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Received event network-changed-f25fb1ed-c869-4d45-b859-50a9f757b481 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-e6e4d48f-8d72-4a98-9aff-128e916cd11b req-ed2aeb8a-8d7f-47ae-af6c-5aa9db7d5eb1 service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Refreshing instance network info cache due to event network-changed-f25fb1ed-c869-4d45-b859-50a9f757b481. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e6e4d48f-8d72-4a98-9aff-128e916cd11b req-ed2aeb8a-8d7f-47ae-af6c-5aa9db7d5eb1 service nova] Acquiring lock "refresh_cache-60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e6e4d48f-8d72-4a98-9aff-128e916cd11b req-ed2aeb8a-8d7f-47ae-af6c-5aa9db7d5eb1 service nova] Acquired lock "refresh_cache-60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG nova.network.neutron [req-e6e4d48f-8d72-4a98-9aff-128e916cd11b req-ed2aeb8a-8d7f-47ae-af6c-5aa9db7d5eb1 service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Refreshing network info cache for port f25fb1ed-c869-4d45-b859-50a9f757b481 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:56:44 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:56:44 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:56:44 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=25.217121124267578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:56:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:56:45 user nova-compute[72874]: DEBUG nova.network.neutron [req-e6e4d48f-8d72-4a98-9aff-128e916cd11b req-ed2aeb8a-8d7f-47ae-af6c-5aa9db7d5eb1 service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Updated VIF entry in instance network info cache for port f25fb1ed-c869-4d45-b859-50a9f757b481. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:56:45 user nova-compute[72874]: DEBUG nova.network.neutron [req-e6e4d48f-8d72-4a98-9aff-128e916cd11b req-ed2aeb8a-8d7f-47ae-af6c-5aa9db7d5eb1 service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Updating instance_info_cache with network_info: [{"id": "f25fb1ed-c869-4d45-b859-50a9f757b481", "address": "fa:16:3e:20:0a:ef", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25fb1ed-c8", "ovs_interfaceid": "f25fb1ed-c869-4d45-b859-50a9f757b481", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:56:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e6e4d48f-8d72-4a98-9aff-128e916cd11b req-ed2aeb8a-8d7f-47ae-af6c-5aa9db7d5eb1 service nova] Releasing lock "refresh_cache-60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:56:45 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:56:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:56:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:56:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:56:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:56:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:56:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:56:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:56:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:56:49 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:56:49 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Updating instance_info_cache with network_info: [{"id": "f25fb1ed-c869-4d45-b859-50a9f757b481", "address": "fa:16:3e:20:0a:ef", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25fb1ed-c8", "ovs_interfaceid": "f25fb1ed-c869-4d45-b859-50a9f757b481", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:56:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:56:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:56:50 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:56:50 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:56:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:52 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:56:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:56:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:56:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:56:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:56:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:56:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:56:56 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:56:56 user nova-compute[72874]: INFO nova.compute.claims [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Claim successful on node user
Aug 17 18:56:56 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:56:56 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:56:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:56:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:56:56 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:56:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:56:56 user nova-compute[72874]: DEBUG nova.network.neutron [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:56:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:56:56 user nova-compute[72874]: DEBUG nova.policy [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73cdc5d076a14395ad1958394f0c48e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41b302a39da4ab18c463789f2a73dd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:56:56 user nova-compute[72874]: INFO nova.virt.block_device [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Booting with volume snapshot 4c068c34-83e2-4a16-be1a-ed0d94c6c794 at /dev/vda
Aug 17 18:56:57 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:56:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:56:57 user nova-compute[72874]: DEBUG nova.network.neutron [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Successfully created port: 3a19cd26-973b-419c-aee6-649961ba130b {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:56:58 user nova-compute[72874]: DEBUG nova.network.neutron [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Successfully updated port: 3a19cd26-973b-419c-aee6-649961ba130b {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:56:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "refresh_cache-beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:56:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquired lock "refresh_cache-beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:56:58 user nova-compute[72874]: DEBUG nova.network.neutron [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:56:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-6fa5467d-7a7d-4dbc-b559-d6b4bcfed044 req-fd4c7015-5233-4a9a-ba84-86e7b28460dd service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Received event network-changed-3a19cd26-973b-419c-aee6-649961ba130b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:56:58 user nova-compute[72874]: DEBUG nova.compute.manager [req-6fa5467d-7a7d-4dbc-b559-d6b4bcfed044 req-fd4c7015-5233-4a9a-ba84-86e7b28460dd service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Refreshing instance network info cache due to event network-changed-3a19cd26-973b-419c-aee6-649961ba130b. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:56:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6fa5467d-7a7d-4dbc-b559-d6b4bcfed044 req-fd4c7015-5233-4a9a-ba84-86e7b28460dd service nova] Acquiring lock "refresh_cache-beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:56:58 user nova-compute[72874]: DEBUG nova.network.neutron [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:56:58 user nova-compute[72874]: DEBUG nova.network.neutron [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Updating instance_info_cache with network_info: [{"id": "3a19cd26-973b-419c-aee6-649961ba130b", "address": "fa:16:3e:f7:69:51", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a19cd26-97", "ovs_interfaceid": "3a19cd26-973b-419c-aee6-649961ba130b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:56:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Releasing lock "refresh_cache-beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:56:58 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Instance network_info: |[{"id": "3a19cd26-973b-419c-aee6-649961ba130b", "address": "fa:16:3e:f7:69:51", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a19cd26-97", "ovs_interfaceid": "3a19cd26-973b-419c-aee6-649961ba130b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:56:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6fa5467d-7a7d-4dbc-b559-d6b4bcfed044 req-fd4c7015-5233-4a9a-ba84-86e7b28460dd service nova] Acquired lock "refresh_cache-beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:56:58 user nova-compute[72874]: DEBUG nova.network.neutron [req-6fa5467d-7a7d-4dbc-b559-d6b4bcfed044 req-fd4c7015-5233-4a9a-ba84-86e7b28460dd service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Refreshing network info cache for port 3a19cd26-973b-419c-aee6-649961ba130b {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:56:59 user nova-compute[72874]: DEBUG nova.network.neutron [req-6fa5467d-7a7d-4dbc-b559-d6b4bcfed044 req-fd4c7015-5233-4a9a-ba84-86e7b28460dd service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Updated VIF entry in instance network info cache for port 3a19cd26-973b-419c-aee6-649961ba130b. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:56:59 user nova-compute[72874]: DEBUG nova.network.neutron [req-6fa5467d-7a7d-4dbc-b559-d6b4bcfed044 req-fd4c7015-5233-4a9a-ba84-86e7b28460dd service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Updating instance_info_cache with network_info: [{"id": "3a19cd26-973b-419c-aee6-649961ba130b", "address": "fa:16:3e:f7:69:51", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a19cd26-97", "ovs_interfaceid": "3a19cd26-973b-419c-aee6-649961ba130b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:56:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6fa5467d-7a7d-4dbc-b559-d6b4bcfed044 req-fd4c7015-5233-4a9a-ba84-86e7b28460dd service nova] Releasing lock "refresh_cache-beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:57:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG os_brick.utils [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0209f701-f8c2-41bf-9f19-8ed9e1c2a896]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eac0a3-1f0a-4d1e-9bb6-32dbb2dacc02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[29621763-0731-40ab-9591-2d1d34f1ebcf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9485d191-1a1b-4269-bcad-02aff43e2a08]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:57:02 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:57:02 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c264cd28-921f-4748-844d-cccbd0b52970]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG os_brick.utils [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:57:02 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Updating existing volume attachment record: 4ba9f80b-1d86-49fd-a735-1b115e80cd9c {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:57:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:57:12 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Creating image(s)
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Ensure instance console log exists: /opt/stack/data/nova/instances/beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Start _get_guest_xml network_info=[{"id": "3a19cd26-973b-419c-aee6-649961ba130b", "address": "fa:16:3e:f7:69:51", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a19cd26-97", "ovs_interfaceid": "3a19cd26-973b-419c-aee6-649961ba130b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T18:56:46Z,direct_url=<?>,disk_format='qcow2',id=73e5669c-0023-454e-b54f-5020fa6d683a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-258708447',owner='f41b302a39da4ab18c463789f2a73dd5',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T18:56:47Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xowiLZlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148', 'attached_at': '', 'detached_at': '', 'volume_id': '8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952', 'serial': '8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952'}, 'delete_on_termination': True, 'attachment_id': '4ba9f80b-1d86-49fd-a735-1b115e80cd9c', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:57:12 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:57:12 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T18:56:46Z,direct_url=<?>,disk_format='qcow2',id=73e5669c-0023-454e-b54f-5020fa6d683a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-258708447',owner='f41b302a39da4ab18c463789f2a73dd5',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T18:56:47Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xowiLZlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:57:12 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:57:12 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:57:12 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e82087-940c-47bf-8453-23866af5f720]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:57:12 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d67f471-ef4a-4dd9-b6c5-6a80f34b67ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952] added
Aug 17 18:57:12 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfeece08-21ea-418a-b13f-1195d1e00c0b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6d94fc-2b8d-40cd-85b9-a8f07e5d13a5]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xowiLZlW {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xowiLZlW" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df2f5c3-4607-4ed0-b252-aaaa60efdb74]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xowiLZlW'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bce3687-c65f-4a0a-a149-db987c509328]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bdfd20-8be7-4d01-92be-ff0b37641bd0]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:57:12 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:57:12 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dced866-b103-4178-86b8-5257eae63b00]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952, portal: 172.16.0.220,3260]
Aug 17 18:57:12 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952, portal: 172.16.0.220,3260] successful.
Aug 17 18:57:12 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e82c4dd-aa3f-4f25-86da-9bed56b25792]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c9a111-514d-45b9-b72b-f283f82fb2af]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:57:12 user nova-compute[72874]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 (non-flash)
Aug 17 18:57:12 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:57:12 user nova-compute[72874]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 (non-flash)
Aug 17 18:57:12 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:12 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:13 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f430fe9f-9f5f-421e-9540-edecf08421fd]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:57:13 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:57:13 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xowiLZlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23931353036633465', 'path': '/dev/sdc'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931353036633465', 'path': '/dev/sdc'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-921065994',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-921065994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-921065994',id=46,image_ref='73e5669c-0023-454e-b54f-5020fa6d683a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAE6XLVbUEYkhULu0o7+Mbiw5ALD5BA3oRfSRUe0uebqVQnBOa2hTi0HTmmf3l/umd9Tn9+EnPdfYDcNRhqjlWGoWE+xssj8lmH9vJp+OuwdAcJacSMEJrxhzn8S/NL6cA==',key_name='tempest-keypair-1203023996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-ugr76nu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-414332602',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:56:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a19cd26-973b-419c-aee6-649961ba130b", "address": "fa:16:3e:f7:69:51", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a19cd26-97", "ovs_interfaceid": "3a19cd26-973b-419c-aee6-649961ba130b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "3a19cd26-973b-419c-aee6-649961ba130b", "address": "fa:16:3e:f7:69:51", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a19cd26-97", "ovs_interfaceid": "3a19cd26-973b-419c-aee6-649961ba130b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:69:51,bridge_name='br-int',has_traffic_filtering=True,id=3a19cd26-973b-419c-aee6-649961ba130b,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a19cd26-97') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG nova.objects.instance [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lazy-loading 'pci_devices' on Instance uuid beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:57:14 user nova-compute[72874]:   <uuid>beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148</uuid>
Aug 17 18:57:14 user nova-compute[72874]:   <name>instance-0000002e</name>
Aug 17 18:57:14 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:57:14 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:57:14 user nova-compute[72874]:   <metadata>
Aug 17 18:57:14 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:57:14 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:57:14 user nova-compute[72874]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-921065994</nova:name>
Aug 17 18:57:14 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:57:12</nova:creationTime>
Aug 17 18:57:14 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:57:14 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:57:14 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:57:14 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:57:14 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:57:14 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:57:14 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:57:14 user nova-compute[72874]:       <nova:owner>
Aug 17 18:57:14 user nova-compute[72874]:         <nova:user uuid="73cdc5d076a14395ad1958394f0c48e4">tempest-TestVolumeBootPattern-414332602-project-member</nova:user>
Aug 17 18:57:14 user nova-compute[72874]:         <nova:project uuid="f41b302a39da4ab18c463789f2a73dd5">tempest-TestVolumeBootPattern-414332602</nova:project>
Aug 17 18:57:14 user nova-compute[72874]:       </nova:owner>
Aug 17 18:57:14 user nova-compute[72874]:       <nova:root type="image" uuid="73e5669c-0023-454e-b54f-5020fa6d683a"/>
Aug 17 18:57:14 user nova-compute[72874]:       <nova:ports>
Aug 17 18:57:14 user nova-compute[72874]:         <nova:port uuid="3a19cd26-973b-419c-aee6-649961ba130b">
Aug 17 18:57:14 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 18:57:14 user nova-compute[72874]:         </nova:port>
Aug 17 18:57:14 user nova-compute[72874]:       </nova:ports>
Aug 17 18:57:14 user nova-compute[72874]:     </nova:instance>
Aug 17 18:57:14 user nova-compute[72874]:   </metadata>
Aug 17 18:57:14 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:57:14 user nova-compute[72874]:     <system>
Aug 17 18:57:14 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:57:14 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:57:14 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:57:14 user nova-compute[72874]:       <entry name="serial">beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148</entry>
Aug 17 18:57:14 user nova-compute[72874]:       <entry name="uuid">beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148</entry>
Aug 17 18:57:14 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:57:14 user nova-compute[72874]:     </system>
Aug 17 18:57:14 user nova-compute[72874]:   </sysinfo>
Aug 17 18:57:14 user nova-compute[72874]:   <os>
Aug 17 18:57:14 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:57:14 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:57:14 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:57:14 user nova-compute[72874]:   </os>
Aug 17 18:57:14 user nova-compute[72874]:   <features>
Aug 17 18:57:14 user nova-compute[72874]:     <acpi/>
Aug 17 18:57:14 user nova-compute[72874]:     <apic/>
Aug 17 18:57:14 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:57:14 user nova-compute[72874]:   </features>
Aug 17 18:57:14 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:57:14 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:57:14 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:57:14 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:57:14 user nova-compute[72874]:   </clock>
Aug 17 18:57:14 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:57:14 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:57:14 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:57:14 user nova-compute[72874]:   </cpu>
Aug 17 18:57:14 user nova-compute[72874]:   <devices>
Aug 17 18:57:14 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 18:57:14 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:57:14 user nova-compute[72874]:       <source dev="/dev/sdc"/>
Aug 17 18:57:14 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:57:14 user nova-compute[72874]:       <serial>8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952</serial>
Aug 17 18:57:14 user nova-compute[72874]:     </disk>
Aug 17 18:57:14 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:57:14 user nova-compute[72874]:       <mac address="fa:16:3e:f7:69:51"/>
Aug 17 18:57:14 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:57:14 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:57:14 user nova-compute[72874]:       <target dev="tap3a19cd26-97"/>
Aug 17 18:57:14 user nova-compute[72874]:     </interface>
Aug 17 18:57:14 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:57:14 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148/console.log" append="off"/>
Aug 17 18:57:14 user nova-compute[72874]:     </serial>
Aug 17 18:57:14 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:57:14 user nova-compute[72874]:     <video>
Aug 17 18:57:14 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:57:14 user nova-compute[72874]:     </video>
Aug 17 18:57:14 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:57:14 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:57:14 user nova-compute[72874]:     </rng>
Aug 17 18:57:14 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:57:14 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:57:14 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:57:14 user nova-compute[72874]:     </memballoon>
Aug 17 18:57:14 user nova-compute[72874]:   </devices>
Aug 17 18:57:14 user nova-compute[72874]: </domain>
Aug 17 18:57:14 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-921065994',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-921065994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-921065994',id=46,image_ref='73e5669c-0023-454e-b54f-5020fa6d683a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAE6XLVbUEYkhULu0o7+Mbiw5ALD5BA3oRfSRUe0uebqVQnBOa2hTi0HTmmf3l/umd9Tn9+EnPdfYDcNRhqjlWGoWE+xssj8lmH9vJp+OuwdAcJacSMEJrxhzn8S/NL6cA==',key_name='tempest-keypair-1203023996',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-ugr76nu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-414332602',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:56:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a19cd26-973b-419c-aee6-649961ba130b", "address": "fa:16:3e:f7:69:51", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a19cd26-97", "ovs_interfaceid": "3a19cd26-973b-419c-aee6-649961ba130b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "3a19cd26-973b-419c-aee6-649961ba130b", "address": "fa:16:3e:f7:69:51", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a19cd26-97", "ovs_interfaceid": "3a19cd26-973b-419c-aee6-649961ba130b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:69:51,bridge_name='br-int',has_traffic_filtering=True,id=3a19cd26-973b-419c-aee6-649961ba130b,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a19cd26-97') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG os_vif [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:69:51,bridge_name='br-int',has_traffic_filtering=True,id=3a19cd26-973b-419c-aee6-649961ba130b,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a19cd26-97') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a19cd26-97, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3a19cd26-97, col_values=(('external_ids', {'iface-id': '3a19cd26-973b-419c-aee6-649961ba130b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:69:51', 'vm-uuid': 'beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:14 user nova-compute[72874]: INFO os_vif [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:69:51,bridge_name='br-int',has_traffic_filtering=True,id=3a19cd26-973b-419c-aee6-649961ba130b,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a19cd26-97')
Aug 17 18:57:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:57:14 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] No VIF found with MAC fa:16:3e:f7:69:51, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:57:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:15 user nova-compute[72874]: DEBUG nova.compute.manager [req-974fa25e-6279-42dd-9eda-9f9e91a83f03 req-3451add9-deb9-4fc1-b09e-660c52c55dde service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Received event network-vif-plugged-3a19cd26-973b-419c-aee6-649961ba130b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:57:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-974fa25e-6279-42dd-9eda-9f9e91a83f03 req-3451add9-deb9-4fc1-b09e-660c52c55dde service nova] Acquiring lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:57:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-974fa25e-6279-42dd-9eda-9f9e91a83f03 req-3451add9-deb9-4fc1-b09e-660c52c55dde service nova] Lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:57:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-974fa25e-6279-42dd-9eda-9f9e91a83f03 req-3451add9-deb9-4fc1-b09e-660c52c55dde service nova] Lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:57:15 user nova-compute[72874]: DEBUG nova.compute.manager [req-974fa25e-6279-42dd-9eda-9f9e91a83f03 req-3451add9-deb9-4fc1-b09e-660c52c55dde service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] No waiting events found dispatching network-vif-plugged-3a19cd26-973b-419c-aee6-649961ba130b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:57:15 user nova-compute[72874]: WARNING nova.compute.manager [req-974fa25e-6279-42dd-9eda-9f9e91a83f03 req-3451add9-deb9-4fc1-b09e-660c52c55dde service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Received unexpected event network-vif-plugged-3a19cd26-973b-419c-aee6-649961ba130b for instance with vm_state building and task_state spawning.
Aug 17 18:57:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:17 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692298637.415886, beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:57:17 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] VM Resumed (Lifecycle Event)
Aug 17 18:57:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:57:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:57:17 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Instance spawned successfully.
Aug 17 18:57:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:57:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:57:17 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:57:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:57:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:57:17 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:57:17 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692298637.4167194, beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:57:17 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] VM Started (Lifecycle Event)
Aug 17 18:57:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:57:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:57:17 user nova-compute[72874]: INFO nova.compute.manager [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Took 4.88 seconds to spawn the instance on the hypervisor.
Aug 17 18:57:17 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:57:17 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:57:17 user nova-compute[72874]: DEBUG nova.compute.manager [req-165a6f45-d7c0-4cf9-bec4-180580f19348 req-8bc74fdb-b77a-46cf-b963-e41d19e3b547 service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Received event network-vif-plugged-3a19cd26-973b-419c-aee6-649961ba130b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:57:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-165a6f45-d7c0-4cf9-bec4-180580f19348 req-8bc74fdb-b77a-46cf-b963-e41d19e3b547 service nova] Acquiring lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:57:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-165a6f45-d7c0-4cf9-bec4-180580f19348 req-8bc74fdb-b77a-46cf-b963-e41d19e3b547 service nova] Lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:57:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-165a6f45-d7c0-4cf9-bec4-180580f19348 req-8bc74fdb-b77a-46cf-b963-e41d19e3b547 service nova] Lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:57:17 user nova-compute[72874]: DEBUG nova.compute.manager [req-165a6f45-d7c0-4cf9-bec4-180580f19348 req-8bc74fdb-b77a-46cf-b963-e41d19e3b547 service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] No waiting events found dispatching network-vif-plugged-3a19cd26-973b-419c-aee6-649961ba130b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:57:17 user nova-compute[72874]: WARNING nova.compute.manager [req-165a6f45-d7c0-4cf9-bec4-180580f19348 req-8bc74fdb-b77a-46cf-b963-e41d19e3b547 service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Received unexpected event network-vif-plugged-3a19cd26-973b-419c-aee6-649961ba130b for instance with vm_state building and task_state spawning.
Aug 17 18:57:17 user nova-compute[72874]: INFO nova.compute.manager [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Took 21.34 seconds to build instance.
Aug 17 18:57:17 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9364907d-098a-4099-aebb-00dbc1d09e90 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.434s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:57:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "6910360f-3540-4705-a5ad-16fac50d2e18" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:57:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:57:19 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 18:57:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:57:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:57:19 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 18:57:19 user nova-compute[72874]: INFO nova.compute.claims [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Claim successful on node user
Aug 17 18:57:19 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:57:19 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:57:19 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:57:19 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 18:57:19 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 18:57:19 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 18:57:19 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 18:57:19 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG nova.policy [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04b47a0411fa4642bfc5aa08f48919c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d8e6936f2004a5cbb90e1e26f3ec28d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 18:57:20 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Creating image(s)
Aug 17 18:57:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "/opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "/opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "/opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.212s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.211s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk 1073741824" returned: 0 in 0.056s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.190s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:20 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Successfully created port: 3b687d6e-b489-4bac-bc15-392d19991969 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 18:57:21 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:21 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Cannot resize image /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 18:57:21 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'migration_context' on Instance uuid 6910360f-3540-4705-a5ad-16fac50d2e18 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:57:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 18:57:21 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Ensure instance console log exists: /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 18:57:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:57:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:57:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:57:21 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Successfully updated port: 3b687d6e-b489-4bac-bc15-392d19991969 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 18:57:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "refresh_cache-6910360f-3540-4705-a5ad-16fac50d2e18" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:57:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquired lock "refresh_cache-6910360f-3540-4705-a5ad-16fac50d2e18" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:57:21 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 18:57:21 user nova-compute[72874]: DEBUG nova.compute.manager [req-686f1d0f-f581-4532-ad60-ce6e055ff7db req-86fb0ee2-46b4-4392-a4e7-ccc9a09db409 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Received event network-changed-3b687d6e-b489-4bac-bc15-392d19991969 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:57:21 user nova-compute[72874]: DEBUG nova.compute.manager [req-686f1d0f-f581-4532-ad60-ce6e055ff7db req-86fb0ee2-46b4-4392-a4e7-ccc9a09db409 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Refreshing instance network info cache due to event network-changed-3b687d6e-b489-4bac-bc15-392d19991969. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:57:21 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-686f1d0f-f581-4532-ad60-ce6e055ff7db req-86fb0ee2-46b4-4392-a4e7-ccc9a09db409 service nova] Acquiring lock "refresh_cache-6910360f-3540-4705-a5ad-16fac50d2e18" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:57:21 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Updating instance_info_cache with network_info: [{"id": "3b687d6e-b489-4bac-bc15-392d19991969", "address": "fa:16:3e:8b:20:ce", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b687d6e-b4", "ovs_interfaceid": "3b687d6e-b489-4bac-bc15-392d19991969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Releasing lock "refresh_cache-6910360f-3540-4705-a5ad-16fac50d2e18" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Instance network_info: |[{"id": "3b687d6e-b489-4bac-bc15-392d19991969", "address": "fa:16:3e:8b:20:ce", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b687d6e-b4", "ovs_interfaceid": "3b687d6e-b489-4bac-bc15-392d19991969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-686f1d0f-f581-4532-ad60-ce6e055ff7db req-86fb0ee2-46b4-4392-a4e7-ccc9a09db409 service nova] Acquired lock "refresh_cache-6910360f-3540-4705-a5ad-16fac50d2e18" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.network.neutron [req-686f1d0f-f581-4532-ad60-ce6e055ff7db req-86fb0ee2-46b4-4392-a4e7-ccc9a09db409 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Refreshing network info cache for port 3b687d6e-b489-4bac-bc15-392d19991969 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Start _get_guest_xml network_info=[{"id": "3b687d6e-b489-4bac-bc15-392d19991969", "address": "fa:16:3e:8b:20:ce", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b687d6e-b4", "ovs_interfaceid": "3b687d6e-b489-4bac-bc15-392d19991969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 18:57:22 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:57:22 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1088035884',display_name='tempest-AttachVolumeTestJSON-server-1088035884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1088035884',id=47,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBjKhFsD7zCPiZ7SDquVjHKB85rPP2EBTHJbeBf489l3xwfdiYd2SGTzXrfzh+u7/3UfimHS/2O1PQaD+GLeR3am5qv8ep83z5t2CqnyzzXAiy654vDpgWhrwveqhrxCA==',key_name='tempest-keypair-862772394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d8e6936f2004a5cbb90e1e26f3ec28d',ramdisk_id='',reservation_id='r-htwsug7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-385757460',owner_user_name='tempest-AttachVolumeTestJSON-385757460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:57:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b47a0411fa4642bfc5aa08f48919c9',uuid=6910360f-3540-4705-a5ad-16fac50d2e18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b687d6e-b489-4bac-bc15-392d19991969", "address": "fa:16:3e:8b:20:ce", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b687d6e-b4", "ovs_interfaceid": "3b687d6e-b489-4bac-bc15-392d19991969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converting VIF {"id": "3b687d6e-b489-4bac-bc15-392d19991969", "address": "fa:16:3e:8b:20:ce", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b687d6e-b4", "ovs_interfaceid": "3b687d6e-b489-4bac-bc15-392d19991969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:20:ce,bridge_name='br-int',has_traffic_filtering=True,id=3b687d6e-b489-4bac-bc15-392d19991969,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b687d6e-b4') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'pci_devices' on Instance uuid 6910360f-3540-4705-a5ad-16fac50d2e18 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] End _get_guest_xml xml=<domain type="kvm">
Aug 17 18:57:22 user nova-compute[72874]:   <uuid>6910360f-3540-4705-a5ad-16fac50d2e18</uuid>
Aug 17 18:57:22 user nova-compute[72874]:   <name>instance-0000002f</name>
Aug 17 18:57:22 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 18:57:22 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 18:57:22 user nova-compute[72874]:   <metadata>
Aug 17 18:57:22 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 18:57:22 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 18:57:22 user nova-compute[72874]:       <nova:name>tempest-AttachVolumeTestJSON-server-1088035884</nova:name>
Aug 17 18:57:22 user nova-compute[72874]:       <nova:creationTime>2023-08-17 18:57:22</nova:creationTime>
Aug 17 18:57:22 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 18:57:22 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 18:57:22 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 18:57:22 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 18:57:22 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 18:57:22 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 18:57:22 user nova-compute[72874]:       </nova:flavor>
Aug 17 18:57:22 user nova-compute[72874]:       <nova:owner>
Aug 17 18:57:22 user nova-compute[72874]:         <nova:user uuid="04b47a0411fa4642bfc5aa08f48919c9">tempest-AttachVolumeTestJSON-385757460-project-member</nova:user>
Aug 17 18:57:22 user nova-compute[72874]:         <nova:project uuid="4d8e6936f2004a5cbb90e1e26f3ec28d">tempest-AttachVolumeTestJSON-385757460</nova:project>
Aug 17 18:57:22 user nova-compute[72874]:       </nova:owner>
Aug 17 18:57:22 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 18:57:22 user nova-compute[72874]:       <nova:ports>
Aug 17 18:57:22 user nova-compute[72874]:         <nova:port uuid="3b687d6e-b489-4bac-bc15-392d19991969">
Aug 17 18:57:22 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 18:57:22 user nova-compute[72874]:         </nova:port>
Aug 17 18:57:22 user nova-compute[72874]:       </nova:ports>
Aug 17 18:57:22 user nova-compute[72874]:     </nova:instance>
Aug 17 18:57:22 user nova-compute[72874]:   </metadata>
Aug 17 18:57:22 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 18:57:22 user nova-compute[72874]:     <system>
Aug 17 18:57:22 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 18:57:22 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 18:57:22 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 18:57:22 user nova-compute[72874]:       <entry name="serial">6910360f-3540-4705-a5ad-16fac50d2e18</entry>
Aug 17 18:57:22 user nova-compute[72874]:       <entry name="uuid">6910360f-3540-4705-a5ad-16fac50d2e18</entry>
Aug 17 18:57:22 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 18:57:22 user nova-compute[72874]:     </system>
Aug 17 18:57:22 user nova-compute[72874]:   </sysinfo>
Aug 17 18:57:22 user nova-compute[72874]:   <os>
Aug 17 18:57:22 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 18:57:22 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 18:57:22 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 18:57:22 user nova-compute[72874]:   </os>
Aug 17 18:57:22 user nova-compute[72874]:   <features>
Aug 17 18:57:22 user nova-compute[72874]:     <acpi/>
Aug 17 18:57:22 user nova-compute[72874]:     <apic/>
Aug 17 18:57:22 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 18:57:22 user nova-compute[72874]:   </features>
Aug 17 18:57:22 user nova-compute[72874]:   <clock offset="utc">
Aug 17 18:57:22 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 18:57:22 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 18:57:22 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 18:57:22 user nova-compute[72874]:   </clock>
Aug 17 18:57:22 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 18:57:22 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 18:57:22 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 18:57:22 user nova-compute[72874]:   </cpu>
Aug 17 18:57:22 user nova-compute[72874]:   <devices>
Aug 17 18:57:22 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 18:57:22 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 18:57:22 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk"/>
Aug 17 18:57:22 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 18:57:22 user nova-compute[72874]:     </disk>
Aug 17 18:57:22 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 18:57:22 user nova-compute[72874]:       <mac address="fa:16:3e:8b:20:ce"/>
Aug 17 18:57:22 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:57:22 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 18:57:22 user nova-compute[72874]:       <target dev="tap3b687d6e-b4"/>
Aug 17 18:57:22 user nova-compute[72874]:     </interface>
Aug 17 18:57:22 user nova-compute[72874]:     <serial type="pty">
Aug 17 18:57:22 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/console.log" append="off"/>
Aug 17 18:57:22 user nova-compute[72874]:     </serial>
Aug 17 18:57:22 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 18:57:22 user nova-compute[72874]:     <video>
Aug 17 18:57:22 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 18:57:22 user nova-compute[72874]:     </video>
Aug 17 18:57:22 user nova-compute[72874]:     <rng model="virtio">
Aug 17 18:57:22 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 18:57:22 user nova-compute[72874]:     </rng>
Aug 17 18:57:22 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 18:57:22 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 18:57:22 user nova-compute[72874]:       <stats period="10"/>
Aug 17 18:57:22 user nova-compute[72874]:     </memballoon>
Aug 17 18:57:22 user nova-compute[72874]:   </devices>
Aug 17 18:57:22 user nova-compute[72874]: </domain>
Aug 17 18:57:22 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1088035884',display_name='tempest-AttachVolumeTestJSON-server-1088035884',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1088035884',id=47,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBjKhFsD7zCPiZ7SDquVjHKB85rPP2EBTHJbeBf489l3xwfdiYd2SGTzXrfzh+u7/3UfimHS/2O1PQaD+GLeR3am5qv8ep83z5t2CqnyzzXAiy654vDpgWhrwveqhrxCA==',key_name='tempest-keypair-862772394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d8e6936f2004a5cbb90e1e26f3ec28d',ramdisk_id='',reservation_id='r-htwsug7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-385757460',owner_user_name='tempest-AttachVolumeTestJSON-385757460-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T18:57:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b47a0411fa4642bfc5aa08f48919c9',uuid=6910360f-3540-4705-a5ad-16fac50d2e18,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b687d6e-b489-4bac-bc15-392d19991969", "address": "fa:16:3e:8b:20:ce", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b687d6e-b4", "ovs_interfaceid": "3b687d6e-b489-4bac-bc15-392d19991969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converting VIF {"id": "3b687d6e-b489-4bac-bc15-392d19991969", "address": "fa:16:3e:8b:20:ce", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b687d6e-b4", "ovs_interfaceid": "3b687d6e-b489-4bac-bc15-392d19991969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:20:ce,bridge_name='br-int',has_traffic_filtering=True,id=3b687d6e-b489-4bac-bc15-392d19991969,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b687d6e-b4') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG os_vif [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:20:ce,bridge_name='br-int',has_traffic_filtering=True,id=3b687d6e-b489-4bac-bc15-392d19991969,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b687d6e-b4') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b687d6e-b4, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b687d6e-b4, col_values=(('external_ids', {'iface-id': '3b687d6e-b489-4bac-bc15-392d19991969', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:20:ce', 'vm-uuid': '6910360f-3540-4705-a5ad-16fac50d2e18'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:22 user nova-compute[72874]: INFO os_vif [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:20:ce,bridge_name='br-int',has_traffic_filtering=True,id=3b687d6e-b489-4bac-bc15-392d19991969,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b687d6e-b4')
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] No VIF found with MAC fa:16:3e:8b:20:ce, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.network.neutron [req-686f1d0f-f581-4532-ad60-ce6e055ff7db req-86fb0ee2-46b4-4392-a4e7-ccc9a09db409 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Updated VIF entry in instance network info cache for port 3b687d6e-b489-4bac-bc15-392d19991969. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG nova.network.neutron [req-686f1d0f-f581-4532-ad60-ce6e055ff7db req-86fb0ee2-46b4-4392-a4e7-ccc9a09db409 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Updating instance_info_cache with network_info: [{"id": "3b687d6e-b489-4bac-bc15-392d19991969", "address": "fa:16:3e:8b:20:ce", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b687d6e-b4", "ovs_interfaceid": "3b687d6e-b489-4bac-bc15-392d19991969", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:57:22 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-686f1d0f-f581-4532-ad60-ce6e055ff7db req-86fb0ee2-46b4-4392-a4e7-ccc9a09db409 service nova] Releasing lock "refresh_cache-6910360f-3540-4705-a5ad-16fac50d2e18" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:57:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:23 user nova-compute[72874]: DEBUG nova.compute.manager [req-86ffe974-a881-49d1-9880-97d1cd2c29cd req-f96d63b5-0282-4202-9bf1-95a226c9e3b1 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Received event network-vif-plugged-3b687d6e-b489-4bac-bc15-392d19991969 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:57:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-86ffe974-a881-49d1-9880-97d1cd2c29cd req-f96d63b5-0282-4202-9bf1-95a226c9e3b1 service nova] Acquiring lock "6910360f-3540-4705-a5ad-16fac50d2e18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:57:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-86ffe974-a881-49d1-9880-97d1cd2c29cd req-f96d63b5-0282-4202-9bf1-95a226c9e3b1 service nova] Lock "6910360f-3540-4705-a5ad-16fac50d2e18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:57:23 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-86ffe974-a881-49d1-9880-97d1cd2c29cd req-f96d63b5-0282-4202-9bf1-95a226c9e3b1 service nova] Lock "6910360f-3540-4705-a5ad-16fac50d2e18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:57:23 user nova-compute[72874]: DEBUG nova.compute.manager [req-86ffe974-a881-49d1-9880-97d1cd2c29cd req-f96d63b5-0282-4202-9bf1-95a226c9e3b1 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] No waiting events found dispatching network-vif-plugged-3b687d6e-b489-4bac-bc15-392d19991969 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:57:23 user nova-compute[72874]: WARNING nova.compute.manager [req-86ffe974-a881-49d1-9880-97d1cd2c29cd req-f96d63b5-0282-4202-9bf1-95a226c9e3b1 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Received unexpected event network-vif-plugged-3b687d6e-b489-4bac-bc15-392d19991969 for instance with vm_state building and task_state spawning.
Aug 17 18:57:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692298645.792222, 6910360f-3540-4705-a5ad-16fac50d2e18 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:57:25 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] VM Resumed (Lifecycle Event)
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 18:57:25 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Instance spawned successfully.
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 18:57:25 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692298645.7961066, 6910360f-3540-4705-a5ad-16fac50d2e18 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:57:25 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] VM Started (Lifecycle Event)
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 18:57:25 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-a585ae56-ad88-4119-bbda-187e0d3d8a6e req-f00e95fe-fcdc-4b35-8971-6604996eea50 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Received event network-vif-plugged-3b687d6e-b489-4bac-bc15-392d19991969 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:57:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a585ae56-ad88-4119-bbda-187e0d3d8a6e req-f00e95fe-fcdc-4b35-8971-6604996eea50 service nova] Acquiring lock "6910360f-3540-4705-a5ad-16fac50d2e18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:57:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a585ae56-ad88-4119-bbda-187e0d3d8a6e req-f00e95fe-fcdc-4b35-8971-6604996eea50 service nova] Lock "6910360f-3540-4705-a5ad-16fac50d2e18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:57:25 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a585ae56-ad88-4119-bbda-187e0d3d8a6e req-f00e95fe-fcdc-4b35-8971-6604996eea50 service nova] Lock "6910360f-3540-4705-a5ad-16fac50d2e18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.compute.manager [req-a585ae56-ad88-4119-bbda-187e0d3d8a6e req-f00e95fe-fcdc-4b35-8971-6604996eea50 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] No waiting events found dispatching network-vif-plugged-3b687d6e-b489-4bac-bc15-392d19991969 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:57:25 user nova-compute[72874]: WARNING nova.compute.manager [req-a585ae56-ad88-4119-bbda-187e0d3d8a6e req-f00e95fe-fcdc-4b35-8971-6604996eea50 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Received unexpected event network-vif-plugged-3b687d6e-b489-4bac-bc15-392d19991969 for instance with vm_state building and task_state spawning.
Aug 17 18:57:25 user nova-compute[72874]: INFO nova.compute.manager [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 17 18:57:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:57:25 user nova-compute[72874]: INFO nova.compute.manager [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Took 6.49 seconds to build instance.
Aug 17 18:57:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f08147d-cd79-4aa0-ac70-78391ce9b911 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.622s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:57:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:45 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:57:45 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:57:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:57:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:57:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:57:45 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:57:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:57:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:57:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:57:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:57:46 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:57:46 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:57:46 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8473MB free_disk=25.179519653320312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:57:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:57:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:57:46 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:57:46 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:57:46 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 6910360f-3540-4705-a5ad-16fac50d2e18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:57:46 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:57:46 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:57:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:46 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:57:46 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:57:46 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:57:46 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:57:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:57:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:57:50 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:57:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:57:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:57:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:57:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:57:50 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:57:50 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:57:50 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Updating instance_info_cache with network_info: [{"id": "f25fb1ed-c869-4d45-b859-50a9f757b481", "address": "fa:16:3e:20:0a:ef", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25fb1ed-c8", "ovs_interfaceid": "f25fb1ed-c869-4d45-b859-50a9f757b481", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:57:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:57:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:57:51 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:57:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:52 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:57:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:53 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:57:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:57:59 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:57:59 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:58:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:58:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 18:58:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:06 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:58:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:58:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 18:58:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] There are 0 instances to clean {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 18:58:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:58:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:45 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG nova.compute.manager [req-c1fb1311-9eb4-4e40-b5a5-5910b90623b5 req-e007f927-1674-45f9-8bca-d63f3218be05 service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Received event network-changed-3a19cd26-973b-419c-aee6-649961ba130b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG nova.compute.manager [req-c1fb1311-9eb4-4e40-b5a5-5910b90623b5 req-e007f927-1674-45f9-8bca-d63f3218be05 service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Refreshing instance network info cache due to event network-changed-3a19cd26-973b-419c-aee6-649961ba130b. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c1fb1311-9eb4-4e40-b5a5-5910b90623b5 req-e007f927-1674-45f9-8bca-d63f3218be05 service nova] Acquiring lock "refresh_cache-beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c1fb1311-9eb4-4e40-b5a5-5910b90623b5 req-e007f927-1674-45f9-8bca-d63f3218be05 service nova] Acquired lock "refresh_cache-beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG nova.network.neutron [req-c1fb1311-9eb4-4e40-b5a5-5910b90623b5 req-e007f927-1674-45f9-8bca-d63f3218be05 service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Refreshing network info cache for port 3a19cd26-973b-419c-aee6-649961ba130b {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:58:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:58:48 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:58:48 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8633MB free_disk=25.177383422851562GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:58:48 user nova-compute[72874]: INFO nova.compute.manager [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Terminating instance
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 6910360f-3540-4705-a5ad-16fac50d2e18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing inventories for resource provider b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Updating ProviderTree inventory for provider b677d836-b01b-4674-8972-53d526f1b5f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Updating inventory in ProviderTree for provider b677d836-b01b-4674-8972-53d526f1b5f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing aggregate associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, aggregates: None {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing trait associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, traits: HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-c1fb1311-9eb4-4e40-b5a5-5910b90623b5 req-e007f927-1674-45f9-8bca-d63f3218be05 service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Updated VIF entry in instance network info cache for port 3a19cd26-973b-419c-aee6-649961ba130b. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.network.neutron [req-c1fb1311-9eb4-4e40-b5a5-5910b90623b5 req-e007f927-1674-45f9-8bca-d63f3218be05 service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Updating instance_info_cache with network_info: [{"id": "3a19cd26-973b-419c-aee6-649961ba130b", "address": "fa:16:3e:f7:69:51", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.213", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a19cd26-97", "ovs_interfaceid": "3a19cd26-973b-419c-aee6-649961ba130b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c1fb1311-9eb4-4e40-b5a5-5910b90623b5 req-e007f927-1674-45f9-8bca-d63f3218be05 service nova] Releasing lock "refresh_cache-beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:48 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Instance destroyed successfully.
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.objects.instance [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lazy-loading 'resources' on Instance uuid beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:56:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-921065994',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-921065994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-921065994',id=46,image_ref='73e5669c-0023-454e-b54f-5020fa6d683a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAE6XLVbUEYkhULu0o7+Mbiw5ALD5BA3oRfSRUe0uebqVQnBOa2hTi0HTmmf3l/umd9Tn9+EnPdfYDcNRhqjlWGoWE+xssj8lmH9vJp+OuwdAcJacSMEJrxhzn8S/NL6cA==',key_name='tempest-keypair-1203023996',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:57:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-ugr76nu9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-414332602',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:57:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a19cd26-973b-419c-aee6-649961ba130b", "address": "fa:16:3e:f7:69:51", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a19cd26-97", "ovs_interfaceid": "3a19cd26-973b-419c-aee6-649961ba130b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "3a19cd26-973b-419c-aee6-649961ba130b", "address": "fa:16:3e:f7:69:51", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a19cd26-97", "ovs_interfaceid": "3a19cd26-973b-419c-aee6-649961ba130b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:69:51,bridge_name='br-int',has_traffic_filtering=True,id=3a19cd26-973b-419c-aee6-649961ba130b,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a19cd26-97') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG os_vif [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:69:51,bridge_name='br-int',has_traffic_filtering=True,id=3a19cd26-973b-419c-aee6-649961ba130b,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a19cd26-97') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a19cd26-97, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:58:48 user nova-compute[72874]: INFO os_vif [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:69:51,bridge_name='br-int',has_traffic_filtering=True,id=3a19cd26-973b-419c-aee6-649961ba130b,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a19cd26-97')
Aug 17 18:58:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xowiLZlW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:58:48 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:58:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad47398-ac39-4bfe-8212-a3d0ba97e5a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbab4c40-f84b-4ec0-ad17-bd165d3cd447]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:58:48 user nova-compute[72874]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 (non-flash)
Aug 17 18:58:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:58:48 user nova-compute[72874]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 (non-flash)
Aug 17 18:58:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c05d0f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952'): ({'sdc'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Removing single pathed devices sdc {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[061a7d81-6599-4927-a499-5b1e22aacec4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:58:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17db9fc-485b-4ab2-9708-25ebc12f66c1]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flushing IO for device /dev/sdc {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f1b5d6-8a89-4a46-95d2-58f8b6dcd3d5]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8207a7ef-1666-4edc-9f8c-7d9a942831be]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b13c2d2', '/dev/disk/by-id/scsi-23931353036633465', '/dev/disk/by-id/scsi-1SCST_BIOb13c2d2-91506c4e93ec1826') {{(pid=83588) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 18:58:49 user nova-compute[72874]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_b13c2d2
Aug 17 18:58:49 user nova-compute[72874]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23931353036633465
Aug 17 18:58:49 user nova-compute[72874]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOb13c2d2-91506c4e93ec1826
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb39abf-74af-440d-aaf0-36c9ee6ae956]: (4, None) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcd0e94-78e3-4089-bcfb-19147cc040cf]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb57af93-3396-4e2d-ac64-19432682c76b]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952, portal: 172.16.0.220,3260]
Aug 17 18:58:49 user nova-compute[72874]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952, portal: 172.16.0.220,3260] successful.
Aug 17 18:58:49 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dfc337-881d-4ac2-b9ba-1d87c4db2324]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== disconnect_volume: return (280ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:58:49 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Deleting instance files /opt/stack/data/nova/instances/beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148_del
Aug 17 18:58:49 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Deletion of /opt/stack/data/nova/instances/beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148_del complete
Aug 17 18:58:49 user nova-compute[72874]: INFO nova.compute.manager [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Took 1.14 seconds to destroy the instance on the hypervisor.
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-31b1147d-d439-4c9c-95e2-70d2f84bc323 req-8ebe41b7-a5cd-4550-bc8d-b2040a364e85 service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Received event network-vif-unplugged-3a19cd26-973b-419c-aee6-649961ba130b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-31b1147d-d439-4c9c-95e2-70d2f84bc323 req-8ebe41b7-a5cd-4550-bc8d-b2040a364e85 service nova] Acquiring lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-31b1147d-d439-4c9c-95e2-70d2f84bc323 req-8ebe41b7-a5cd-4550-bc8d-b2040a364e85 service nova] Lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-31b1147d-d439-4c9c-95e2-70d2f84bc323 req-8ebe41b7-a5cd-4550-bc8d-b2040a364e85 service nova] Lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-31b1147d-d439-4c9c-95e2-70d2f84bc323 req-8ebe41b7-a5cd-4550-bc8d-b2040a364e85 service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] No waiting events found dispatching network-vif-unplugged-3a19cd26-973b-419c-aee6-649961ba130b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-31b1147d-d439-4c9c-95e2-70d2f84bc323 req-8ebe41b7-a5cd-4550-bc8d-b2040a364e85 service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Received event network-vif-unplugged-3a19cd26-973b-419c-aee6-649961ba130b for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-31b1147d-d439-4c9c-95e2-70d2f84bc323 req-8ebe41b7-a5cd-4550-bc8d-b2040a364e85 service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Received event network-vif-plugged-3a19cd26-973b-419c-aee6-649961ba130b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-31b1147d-d439-4c9c-95e2-70d2f84bc323 req-8ebe41b7-a5cd-4550-bc8d-b2040a364e85 service nova] Acquiring lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-31b1147d-d439-4c9c-95e2-70d2f84bc323 req-8ebe41b7-a5cd-4550-bc8d-b2040a364e85 service nova] Lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-31b1147d-d439-4c9c-95e2-70d2f84bc323 req-8ebe41b7-a5cd-4550-bc8d-b2040a364e85 service nova] Lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:58:49 user nova-compute[72874]: DEBUG nova.compute.manager [req-31b1147d-d439-4c9c-95e2-70d2f84bc323 req-8ebe41b7-a5cd-4550-bc8d-b2040a364e85 service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] No waiting events found dispatching network-vif-plugged-3a19cd26-973b-419c-aee6-649961ba130b {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:58:49 user nova-compute[72874]: WARNING nova.compute.manager [req-31b1147d-d439-4c9c-95e2-70d2f84bc323 req-8ebe41b7-a5cd-4550-bc8d-b2040a364e85 service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Received unexpected event network-vif-plugged-3a19cd26-973b-419c-aee6-649961ba130b for instance with vm_state active and task_state deleting.
Aug 17 18:58:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:58:50 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:58:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:58:50 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:58:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Skipping network cache update for instance because it is being deleted. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9891}}
Aug 17 18:58:50 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Took 0.95 seconds to deallocate network for instance.
Aug 17 18:58:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-6910360f-3540-4705-a5ad-16fac50d2e18" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:58:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-6910360f-3540-4705-a5ad-16fac50d2e18" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:58:50 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:58:50 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Updating instance_info_cache with network_info: [{"id": "3b687d6e-b489-4bac-bc15-392d19991969", "address": "fa:16:3e:8b:20:ce", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b687d6e-b4", "ovs_interfaceid": "3b687d6e-b489-4bac-bc15-392d19991969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:58:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-6910360f-3540-4705-a5ad-16fac50d2e18" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:58:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:58:51 user nova-compute[72874]: INFO nova.compute.manager [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Took 0.82 seconds to detach 1 volumes for instance.
Aug 17 18:58:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Deleting volume: 8fd9a3b8-4fe7-423c-b29e-8da5f0b5c952 {{(pid=72874) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 18:58:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:58:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:58:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:51 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:58:51 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:58:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:58:51 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Deleted allocations for instance beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148
Aug 17 18:58:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-9ba681dc-c5a7-4b90-b164-f798f9af1922 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.342s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:58:51 user nova-compute[72874]: DEBUG nova.compute.manager [req-260570d8-7134-4356-9c92-eae903cbb6c6 req-8bfccfb2-0484-425a-8f53-c8d058fc54b2 service nova] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Received event network-vif-deleted-3a19cd26-973b-419c-aee6-649961ba130b {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:58:52 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:58:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:58:54 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:58:54 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:58:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:59:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 18:59:02 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:59:03 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692298728.8625116, beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 18:59:03 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] VM Stopped (Lifecycle Event)
Aug 17 18:59:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-10030050-57d7-4d8a-a4be-ac146968f305 None None] [instance: beb89adf-2f4b-4bfa-8ec1-ae2ea2bdb148] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 18:59:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:59:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 18:59:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:59:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 18:59:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:59:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-f3b222e3-7e1b-45fb-b858-74202c36c8e0 req-0a821271-9558-4ff7-8527-df1c8abb34f7 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Received event network-changed-3b687d6e-b489-4bac-bc15-392d19991969 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:59:10 user nova-compute[72874]: DEBUG nova.compute.manager [req-f3b222e3-7e1b-45fb-b858-74202c36c8e0 req-0a821271-9558-4ff7-8527-df1c8abb34f7 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Refreshing instance network info cache due to event network-changed-3b687d6e-b489-4bac-bc15-392d19991969. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 18:59:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f3b222e3-7e1b-45fb-b858-74202c36c8e0 req-0a821271-9558-4ff7-8527-df1c8abb34f7 service nova] Acquiring lock "refresh_cache-6910360f-3540-4705-a5ad-16fac50d2e18" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:59:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f3b222e3-7e1b-45fb-b858-74202c36c8e0 req-0a821271-9558-4ff7-8527-df1c8abb34f7 service nova] Acquired lock "refresh_cache-6910360f-3540-4705-a5ad-16fac50d2e18" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:59:10 user nova-compute[72874]: DEBUG nova.network.neutron [req-f3b222e3-7e1b-45fb-b858-74202c36c8e0 req-0a821271-9558-4ff7-8527-df1c8abb34f7 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Refreshing network info cache for port 3b687d6e-b489-4bac-bc15-392d19991969 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 18:59:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:11 user nova-compute[72874]: DEBUG nova.network.neutron [req-f3b222e3-7e1b-45fb-b858-74202c36c8e0 req-0a821271-9558-4ff7-8527-df1c8abb34f7 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Updated VIF entry in instance network info cache for port 3b687d6e-b489-4bac-bc15-392d19991969. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 18:59:11 user nova-compute[72874]: DEBUG nova.network.neutron [req-f3b222e3-7e1b-45fb-b858-74202c36c8e0 req-0a821271-9558-4ff7-8527-df1c8abb34f7 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Updating instance_info_cache with network_info: [{"id": "3b687d6e-b489-4bac-bc15-392d19991969", "address": "fa:16:3e:8b:20:ce", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b687d6e-b4", "ovs_interfaceid": "3b687d6e-b489-4bac-bc15-392d19991969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:59:11 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f3b222e3-7e1b-45fb-b858-74202c36c8e0 req-0a821271-9558-4ff7-8527-df1c8abb34f7 service nova] Releasing lock "refresh_cache-6910360f-3540-4705-a5ad-16fac50d2e18" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:59:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "6910360f-3540-4705-a5ad-16fac50d2e18" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG nova.objects.instance [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'flavor' on Instance uuid 6910360f-3540-4705-a5ad-16fac50d2e18 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "6910360f-3540-4705-a5ad-16fac50d2e18" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:15 user nova-compute[72874]: INFO nova.compute.manager [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Attaching volume e5fef76a-8fc8-4982-8945-6651875371d3 to /dev/vdb
Aug 17 18:59:15 user nova-compute[72874]: DEBUG os_brick.utils [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec85498e-c4dd-4793-b319-2165d8db6e81]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f394f119-4ce1-434f-a640-8cd936100cc5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[721015ae-a490-40a8-a8de-fd56a451f537]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e1557a-72de-4632-88d3-92434bc86c39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:59:15 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:59:15 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dcbf57-4e4a-40f7-be5a-435bdadcefba]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG os_brick.utils [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:59:15 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Updating existing volume attachment record: 639dc604-dc6d-432a-9a2d-587cc43aebc2 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:59:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxKfOrBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:59:25 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:59:25 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:59:25 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83d1bf2-8b7c-4b23-9ee4-3d904be3b6a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:59:25 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a845721-762d-4e98-9ba5-4a257d765fed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3] added
Aug 17 18:59:25 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b607d3-99e2-4fd6-ac45-c0b1f06b3652]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9113e821-72c1-479e-975f-a0fb598263ec]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxKfOrBZ {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kxKfOrBZ" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c90109-c39c-43b6-b860-f2098290f274]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kxKfOrBZ'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[182481bd-ca64-4411-a462-2cf0011515cd]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fba7dcb-2921-41c6-b7e1-1978b3b73f81]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:59:25 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:59:25 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3464137e-57c0-4f88-ad01-1217d2d2ae62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3, portal: 172.16.0.220,3260]
Aug 17 18:59:25 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3, portal: 172.16.0.220,3260] successful.
Aug 17 18:59:25 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9292b9-de44-44c3-9d00-47a9151cb5d1]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[817106d9-0c83-4e59-a2e4-8d55d3bbb765]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:59:25 user nova-compute[72874]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 (non-flash)
Aug 17 18:59:25 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:59:25 user nova-compute[72874]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 (non-flash)
Aug 17 18:59:25 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[589cf062-8241-4a74-80f0-c79f9b3243ba]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:59:25 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxKfOrBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:59:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:59:26 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26233666538623464', 'path': '/dev/sdc'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:59:26 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233666538623464', 'path': '/dev/sdc'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:59:26 user nova-compute[72874]: DEBUG nova.objects.instance [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'flavor' on Instance uuid 6910360f-3540-4705-a5ad-16fac50d2e18 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:59:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:59:27 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:59:27 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:59:27 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:59:27 user nova-compute[72874]:   <serial>e5fef76a-8fc8-4982-8945-6651875371d3</serial>
Aug 17 18:59:27 user nova-compute[72874]: </disk>
Aug 17 18:59:27 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:59:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:59:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:59:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] No VIF found with MAC fa:16:3e:8b:20:ce, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:59:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0a45ef45-68ad-4d9a-8c32-ab00a5b2ba6a tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.195s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "6910360f-3540-4705-a5ad-16fac50d2e18" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:32 user nova-compute[72874]: DEBUG nova.objects.instance [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'flavor' on Instance uuid 6910360f-3540-4705-a5ad-16fac50d2e18 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:59:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "6910360f-3540-4705-a5ad-16fac50d2e18" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:33 user nova-compute[72874]: INFO nova.compute.manager [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Attaching volume abf53e39-f5e1-4913-b630-a5a8b86158d0 to /dev/vdc
Aug 17 18:59:33 user nova-compute[72874]: DEBUG os_brick.utils [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cc5ede-61aa-47ca-aa34-f86f45a3df26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ff8b5a-4dd5-4077-b56e-36aa04bf3980]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7126c0c-9818-456e-9cb2-3603c5936048]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c191dbb7-6579-4dd5-9256-be7539c70cce]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 18:59:33 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 18:59:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8eca142-d0d9-4330-a0eb-4be9c4dbf83a]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG os_brick.utils [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Updating existing volume attachment record: 621b309d-3c35-4fdd-915c-b770d73d126a {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 18:59:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:59:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:59:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoduQfPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:59:43 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:59:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:59:43 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:59:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:59:43 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c7bbff-888b-440d-a110-3cf91c807ecc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 18:59:43 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc39e176-4d7b-4659-82dc-533d90be2df9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0] added
Aug 17 18:59:43 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e530c594-f9c2-4b77-875e-13ae8fbb6dd2]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f55fe5-aca2-4e16-8bc0-b7c2292f6600]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YoduQfPz {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YoduQfPz" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32389f9-9696-4db5-bf79-13ca6100252b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YoduQfPz'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d782081-0d6f-4090-bc7e-56e473834dc1]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed484cb-ea17-43c5-8dd2-3af4f5930528]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:59:43 user nova-compute[72874]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 (non-flash)
Aug 17 18:59:43 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:59:43 user nova-compute[72874]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 (non-flash)
Aug 17 18:59:43 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:59:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eeb241b-f981-4cbc-8766-c74136d970e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0, portal: 172.16.0.220,3260]
Aug 17 18:59:44 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0, portal: 172.16.0.220,3260] successful.
Aug 17 18:59:44 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1613deda-b814-421e-909a-12ceb42be299]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c07d2f8-053f-4a17-96c5-b5acecfd5b8e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:59:44 user nova-compute[72874]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 (non-flash)
Aug 17 18:59:44 user nova-compute[72874]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 (non-flash)
Aug 17 18:59:44 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:59:44 user nova-compute[72874]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 (non-flash)
Aug 17 18:59:44 user nova-compute[72874]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 (non-flash)
Aug 17 18:59:44 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e124181-f97b-485b-8b97-953d51f9bcb3]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoduQfPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:44 user nova-compute[72874]: INFO nova.compute.manager [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Terminating instance
Aug 17 18:59:44 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23061393662386363', 'path': '/dev/sdd'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061393662386363', 'path': '/dev/sdd'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-f4f2f909-d7b2-453b-a515-4c6665261d3d req-7c494af6-a006-4ab1-882d-0882a92b670b service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Received event network-vif-unplugged-f25fb1ed-c869-4d45-b859-50a9f757b481 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f4f2f909-d7b2-453b-a515-4c6665261d3d req-7c494af6-a006-4ab1-882d-0882a92b670b service nova] Acquiring lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f4f2f909-d7b2-453b-a515-4c6665261d3d req-7c494af6-a006-4ab1-882d-0882a92b670b service nova] Lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f4f2f909-d7b2-453b-a515-4c6665261d3d req-7c494af6-a006-4ab1-882d-0882a92b670b service nova] Lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-f4f2f909-d7b2-453b-a515-4c6665261d3d req-7c494af6-a006-4ab1-882d-0882a92b670b service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] No waiting events found dispatching network-vif-unplugged-f25fb1ed-c869-4d45-b859-50a9f757b481 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG nova.compute.manager [req-f4f2f909-d7b2-453b-a515-4c6665261d3d req-7c494af6-a006-4ab1-882d-0882a92b670b service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Received event network-vif-unplugged-f25fb1ed-c869-4d45-b859-50a9f757b481 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG nova.objects.instance [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'flavor' on Instance uuid 6910360f-3540-4705-a5ad-16fac50d2e18 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 18:59:45 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:59:45 user nova-compute[72874]:   <source dev="/dev/sdd"/>
Aug 17 18:59:45 user nova-compute[72874]:   <target dev="vdc" bus="virtio"/>
Aug 17 18:59:45 user nova-compute[72874]:   <serial>abf53e39-f5e1-4913-b630-a5a8b86158d0</serial>
Aug 17 18:59:45 user nova-compute[72874]: </disk>
Aug 17 18:59:45 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:45 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Instance destroyed successfully.
Aug 17 18:59:45 user nova-compute[72874]: DEBUG nova.objects.instance [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lazy-loading 'resources' on Instance uuid 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:54:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1009074682',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1009074682',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1009074682',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEw8BZRSjRimQoOO53DLzKJMSpq3XOp8IZ459p9aFOe+ez+iREoZ0nYAOJvJVTJziEeMcqaGfpiaEYQlwARzjqfTgXjPDjT15zk5QtTTNN31Il67BEMCjQcGwpTKqFk2FA==',key_name='tempest-keypair-1165959610',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:55:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-bl0wa7tj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:55:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f25fb1ed-c869-4d45-b859-50a9f757b481", "address": "fa:16:3e:20:0a:ef", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25fb1ed-c8", "ovs_interfaceid": "f25fb1ed-c869-4d45-b859-50a9f757b481", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "f25fb1ed-c869-4d45-b859-50a9f757b481", "address": "fa:16:3e:20:0a:ef", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf25fb1ed-c8", "ovs_interfaceid": "f25fb1ed-c869-4d45-b859-50a9f757b481", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:0a:ef,bridge_name='br-int',has_traffic_filtering=True,id=f25fb1ed-c869-4d45-b859-50a9f757b481,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25fb1ed-c8') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_vif [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:0a:ef,bridge_name='br-int',has_traffic_filtering=True,id=f25fb1ed-c869-4d45-b859-50a9f757b481,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25fb1ed-c8') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf25fb1ed-c8, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:59:45 user nova-compute[72874]: INFO os_vif [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:0a:ef,bridge_name='br-int',has_traffic_filtering=True,id=f25fb1ed-c869-4d45-b859-50a9f757b481,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf25fb1ed-c8')
Aug 17 18:59:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jQtfrMwC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:59:45 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd210e68-4091-4d61-bf99-30d15ef9c256]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] No VIF found with MAC fa:16:3e:8b:20:ce, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa793fd7-5fc0-4737-99fc-89983b35fa41]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:59:45 user nova-compute[72874]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 (non-flash)
Aug 17 18:59:45 user nova-compute[72874]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 (non-flash)
Aug 17 18:59:45 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef (non-flash)
Aug 17 18:59:45 user nova-compute[72874]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 (non-flash)
Aug 17 18:59:45 user nova-compute[72874]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 (non-flash)
Aug 17 18:59:45 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a060b130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c309f986-5340-416b-a412-f028b422bfe2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d71fcf0-80d2-48e1-8326-200e3f553e2d]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f991b5a-3f3b-4a93-b8a7-0a165ab84038]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-038b85dd-88b0-4c02-8380-cdfa4971d221 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.804s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c0f8e7-38cc-4a7a-a430-fba613c2ff40]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[315e0d49-dee0-46f8-9d73-1c57869338d9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:46 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e902f0de-c97a-4f15-9ded-8ffbc70668a4]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:46 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef, portal: 172.16.0.220,3260]
Aug 17 18:59:46 user nova-compute[72874]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef, portal: 172.16.0.220,3260] successful.
Aug 17 18:59:46 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:46 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bdd618c9-3765-4380-a933-86b0a38bbdef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:46 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf3e325-e007-4b3c-8a92-ab0a7d1b224c]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:46 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:46 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:59:46 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== disconnect_volume: return (325ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:59:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:59:46 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Deleting instance files /opt/stack/data/nova/instances/60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d_del
Aug 17 18:59:46 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Deletion of /opt/stack/data/nova/instances/60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d_del complete
Aug 17 18:59:46 user nova-compute[72874]: INFO nova.compute.manager [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Took 1.45 seconds to destroy the instance on the hypervisor.
Aug 17 18:59:46 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:59:46 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:59:46 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:59:46 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:59:47 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Took 0.88 seconds to deallocate network for instance.
Aug 17 18:59:47 user nova-compute[72874]: DEBUG nova.compute.manager [req-8aad43d1-9619-422c-8c4e-5a3fa27b5861 req-ac6c0474-2255-4ec5-b006-3ebae134d3e0 service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Received event network-vif-deleted-f25fb1ed-c869-4d45-b859-50a9f757b481 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG nova.compute.manager [req-1344d84c-353b-4c0c-b742-346aacd5a46e req-61091c11-18d1-4de2-8fa8-fe22a50d904e service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Received event network-vif-plugged-f25fb1ed-c869-4d45-b859-50a9f757b481 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1344d84c-353b-4c0c-b742-346aacd5a46e req-61091c11-18d1-4de2-8fa8-fe22a50d904e service nova] Acquiring lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1344d84c-353b-4c0c-b742-346aacd5a46e req-61091c11-18d1-4de2-8fa8-fe22a50d904e service nova] Lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-1344d84c-353b-4c0c-b742-346aacd5a46e req-61091c11-18d1-4de2-8fa8-fe22a50d904e service nova] Lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG nova.compute.manager [req-1344d84c-353b-4c0c-b742-346aacd5a46e req-61091c11-18d1-4de2-8fa8-fe22a50d904e service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] No waiting events found dispatching network-vif-plugged-f25fb1ed-c869-4d45-b859-50a9f757b481 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:59:47 user nova-compute[72874]: WARNING nova.compute.manager [req-1344d84c-353b-4c0c-b742-346aacd5a46e req-61091c11-18d1-4de2-8fa8-fe22a50d904e service nova] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Received unexpected event network-vif-plugged-f25fb1ed-c869-4d45-b859-50a9f757b481 for instance with vm_state active and task_state deleting.
Aug 17 18:59:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "6910360f-3540-4705-a5ad-16fac50d2e18" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk --force-share --output=json" returned: 0 in 0.305s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:47 user nova-compute[72874]: INFO nova.compute.manager [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Detaching volume e5fef76a-8fc8-4982-8945-6651875371d3
Aug 17 18:59:47 user nova-compute[72874]: INFO nova.virt.block_device [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Attempting to driver detach volume e5fef76a-8fc8-4982-8945-6651875371d3 from mountpoint /dev/vdb
Aug 17 18:59:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Attempting to detach device vdb from instance 6910360f-3540-4705-a5ad-16fac50d2e18 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:59:47 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:59:47 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:59:47 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:59:47 user nova-compute[72874]:   <serial>e5fef76a-8fc8-4982-8945-6651875371d3</serial>
Aug 17 18:59:47 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:59:47 user nova-compute[72874]: </disk>
Aug 17 18:59:47 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:59:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Successfully detached device vdb from instance 6910360f-3540-4705-a5ad-16fac50d2e18 from the persistent domain config.
Aug 17 18:59:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6910360f-3540-4705-a5ad-16fac50d2e18 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:59:47 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:59:47 user nova-compute[72874]:   <source dev="/dev/sdc"/>
Aug 17 18:59:47 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 18:59:47 user nova-compute[72874]:   <serial>e5fef76a-8fc8-4982-8945-6651875371d3</serial>
Aug 17 18:59:47 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 18:59:47 user nova-compute[72874]: </disk>
Aug 17 18:59:47 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:59:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 18:59:48 user nova-compute[72874]: INFO nova.compute.manager [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Took 1.41 seconds to detach 1 volumes for instance.
Aug 17 18:59:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692298788.129548, 6910360f-3540-4705-a5ad-16fac50d2e18 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6910360f-3540-4705-a5ad-16fac50d2e18 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG nova.compute.manager [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Deleting volume: bdd618c9-3765-4380-a933-86b0a38bbdef {{(pid=72874) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 18:59:48 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Successfully detached device vdb from instance 6910360f-3540-4705-a5ad-16fac50d2e18 from the live domain config.
Aug 17 18:59:48 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:59:48 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 18:59:48 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8766MB free_disk=25.175556182861328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kxKfOrBZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:59:48 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1b93ec-4e03-4e8c-8c30-230ad4871db8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3986eefe-b84e-4e0d-a6f4-c3155adeaf51]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 (non-flash)
Aug 17 18:59:48 user nova-compute[72874]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 (non-flash)
Aug 17 18:59:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 (non-flash)
Aug 17 18:59:48 user nova-compute[72874]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 (non-flash)
Aug 17 18:59:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c05d09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3'): ({'sdc'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Removing single pathed devices sdc {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e611f82-8e8a-4793-8fc1-4783fe1e037a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 6910360f-3540-4705-a5ad-16fac50d2e18 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8d22d9-1325-4946-912a-1835245d00e1]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Flushing IO for device /dev/sdc {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bc7ba1-de75-42de-89f6-92a2fbb99b75]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e368940-0d49-49ac-91b3-50b241ac8ff8]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[294d6c3d-2bf9-4e62-8625-d008460e06f8]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.241s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.128s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[557ee262-00c5-49c1-8b98-5901e93068c4]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3, portal: 172.16.0.220,3260]
Aug 17 18:59:48 user nova-compute[72874]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3, portal: 172.16.0.220,3260] successful.
Aug 17 18:59:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5fef76a-8fc8-4982-8945-6651875371d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8449303e-c584-460f-8475-be67f3cdf675]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] <== disconnect_volume: return (270ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.141s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:48 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Deleted allocations for instance 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d
Aug 17 18:59:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-cdf2fb03-081f-44e1-bf92-cb0a1dc0c50e tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.265s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:49 user nova-compute[72874]: DEBUG nova.objects.instance [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'flavor' on Instance uuid 6910360f-3540-4705-a5ad-16fac50d2e18 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:59:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-07df9431-54c0-47a9-9d97-5d92d59a6a28 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.952s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "6910360f-3540-4705-a5ad-16fac50d2e18" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:49 user nova-compute[72874]: INFO nova.compute.manager [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Detaching volume abf53e39-f5e1-4913-b630-a5a8b86158d0
Aug 17 18:59:49 user nova-compute[72874]: INFO nova.virt.block_device [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Attempting to driver detach volume abf53e39-f5e1-4913-b630-a5a8b86158d0 from mountpoint /dev/vdc
Aug 17 18:59:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Attempting to detach device vdc from instance 6910360f-3540-4705-a5ad-16fac50d2e18 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 18:59:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:59:49 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:59:49 user nova-compute[72874]:   <source dev="/dev/sdd"/>
Aug 17 18:59:49 user nova-compute[72874]:   <target dev="vdc" bus="virtio"/>
Aug 17 18:59:49 user nova-compute[72874]:   <serial>abf53e39-f5e1-4913-b630-a5a8b86158d0</serial>
Aug 17 18:59:49 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 18:59:49 user nova-compute[72874]: </disk>
Aug 17 18:59:49 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:59:49 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Successfully detached device vdc from instance 6910360f-3540-4705-a5ad-16fac50d2e18 from the persistent domain config.
Aug 17 18:59:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6910360f-3540-4705-a5ad-16fac50d2e18 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 18:59:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 18:59:49 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 18:59:49 user nova-compute[72874]:   <source dev="/dev/sdd"/>
Aug 17 18:59:49 user nova-compute[72874]:   <target dev="vdc" bus="virtio"/>
Aug 17 18:59:49 user nova-compute[72874]:   <serial>abf53e39-f5e1-4913-b630-a5a8b86158d0</serial>
Aug 17 18:59:49 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 18:59:49 user nova-compute[72874]: </disk>
Aug 17 18:59:49 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692298790.414672, 6910360f-3540-4705-a5ad-16fac50d2e18 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6910360f-3540-4705-a5ad-16fac50d2e18 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 18:59:50 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Successfully detached device vdc from instance 6910360f-3540-4705-a5ad-16fac50d2e18 from the live domain config.
Aug 17 18:59:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoduQfPz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 18:59:50 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a059cc-e0f2-4980-9f01-2f95ca0398b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe2aefd-2d28-4c36-b38d-0d1b5ce17786]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 (non-flash)
Aug 17 18:59:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 (non-flash)
Aug 17 18:59:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6c0462290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0'): ({'sdd'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Removing single pathed devices sdd {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e698f4f1-952f-48f2-b530-0a571b0277c3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe82f954-69f6-4928-97b5-87639857e2c1]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Flushing IO for device /dev/sdd {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f89cc6-069e-42b7-89c3-f0a7e14dd770]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[773c04c0-af97-4100-a223-7985414c6cce]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] SCSI volumes sdd have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c52d17f-cc0e-4069-a073-e282cbe4cfa2]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d89f51f-f474-4b2a-b9b0-b7f8c05855e7]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0, portal: 172.16.0.220,3260]
Aug 17 18:59:50 user nova-compute[72874]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0, portal: 172.16.0.220,3260] successful.
Aug 17 18:59:50 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:abf53e39-f5e1-4913-b630-a5a8b86158d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc79700-702a-412b-9086-dc76da74f2bb]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.239s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] <== disconnect_volume: return (240ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:59:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:51 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:59:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 18:59:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 18:59:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-6910360f-3540-4705-a5ad-16fac50d2e18" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 18:59:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-6910360f-3540-4705-a5ad-16fac50d2e18" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 18:59:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 18:59:51 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid 6910360f-3540-4705-a5ad-16fac50d2e18 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:59:51 user nova-compute[72874]: DEBUG nova.objects.instance [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'flavor' on Instance uuid 6910360f-3540-4705-a5ad-16fac50d2e18 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:59:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-ff344172-f0fd-4c3f-9e11-988d7fe1a6a6 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.560s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Updating instance_info_cache with network_info: [{"id": "3b687d6e-b489-4bac-bc15-392d19991969", "address": "fa:16:3e:8b:20:ce", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b687d6e-b4", "ovs_interfaceid": "3b687d6e-b489-4bac-bc15-392d19991969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:59:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-6910360f-3540-4705-a5ad-16fac50d2e18" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 18:59:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 18:59:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "6910360f-3540-4705-a5ad-16fac50d2e18" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "6910360f-3540-4705-a5ad-16fac50d2e18-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:52 user nova-compute[72874]: INFO nova.compute.manager [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Terminating instance
Aug 17 18:59:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 18:59:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:53 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Instance destroyed successfully.
Aug 17 18:59:53 user nova-compute[72874]: DEBUG nova.objects.instance [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lazy-loading 'resources' on Instance uuid 6910360f-3540-4705-a5ad-16fac50d2e18 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 18:59:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T18:57:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1088035884',display_name='tempest-AttachVolumeTestJSON-server-1088035884',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1088035884',id=47,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJBjKhFsD7zCPiZ7SDquVjHKB85rPP2EBTHJbeBf489l3xwfdiYd2SGTzXrfzh+u7/3UfimHS/2O1PQaD+GLeR3am5qv8ep83z5t2CqnyzzXAiy654vDpgWhrwveqhrxCA==',key_name='tempest-keypair-862772394',keypairs=<?>,launch_index=0,launched_at=2023-08-17T18:57:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d8e6936f2004a5cbb90e1e26f3ec28d',ramdisk_id='',reservation_id='r-htwsug7t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-385757460',owner_user_name='tempest-AttachVolumeTestJSON-385757460-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T18:57:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04b47a0411fa4642bfc5aa08f48919c9',uuid=6910360f-3540-4705-a5ad-16fac50d2e18,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b687d6e-b489-4bac-bc15-392d19991969", "address": "fa:16:3e:8b:20:ce", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b687d6e-b4", "ovs_interfaceid": "3b687d6e-b489-4bac-bc15-392d19991969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 18:59:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converting VIF {"id": "3b687d6e-b489-4bac-bc15-392d19991969", "address": "fa:16:3e:8b:20:ce", "network": {"id": "7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1592187499-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d8e6936f2004a5cbb90e1e26f3ec28d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b687d6e-b4", "ovs_interfaceid": "3b687d6e-b489-4bac-bc15-392d19991969", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 18:59:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:20:ce,bridge_name='br-int',has_traffic_filtering=True,id=3b687d6e-b489-4bac-bc15-392d19991969,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b687d6e-b4') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 18:59:53 user nova-compute[72874]: DEBUG os_vif [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:20:ce,bridge_name='br-int',has_traffic_filtering=True,id=3b687d6e-b489-4bac-bc15-392d19991969,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b687d6e-b4') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 18:59:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b687d6e-b4, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 18:59:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 18:59:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 18:59:53 user nova-compute[72874]: INFO os_vif [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:20:ce,bridge_name='br-int',has_traffic_filtering=True,id=3b687d6e-b489-4bac-bc15-392d19991969,network=Network(7ee320f7-ebb4-4562-af7e-f5e1ca04b9c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b687d6e-b4')
Aug 17 18:59:53 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Deleting instance files /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18_del
Aug 17 18:59:53 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Deletion of /opt/stack/data/nova/instances/6910360f-3540-4705-a5ad-16fac50d2e18_del complete
Aug 17 18:59:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-a8dfa7e8-58a2-4071-bc91-cab090f78f64 req-1bcd3f2e-dd92-40a6-9fad-7c521255df79 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Received event network-vif-unplugged-3b687d6e-b489-4bac-bc15-392d19991969 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:59:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a8dfa7e8-58a2-4071-bc91-cab090f78f64 req-1bcd3f2e-dd92-40a6-9fad-7c521255df79 service nova] Acquiring lock "6910360f-3540-4705-a5ad-16fac50d2e18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a8dfa7e8-58a2-4071-bc91-cab090f78f64 req-1bcd3f2e-dd92-40a6-9fad-7c521255df79 service nova] Lock "6910360f-3540-4705-a5ad-16fac50d2e18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a8dfa7e8-58a2-4071-bc91-cab090f78f64 req-1bcd3f2e-dd92-40a6-9fad-7c521255df79 service nova] Lock "6910360f-3540-4705-a5ad-16fac50d2e18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-a8dfa7e8-58a2-4071-bc91-cab090f78f64 req-1bcd3f2e-dd92-40a6-9fad-7c521255df79 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] No waiting events found dispatching network-vif-unplugged-3b687d6e-b489-4bac-bc15-392d19991969 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:59:53 user nova-compute[72874]: DEBUG nova.compute.manager [req-a8dfa7e8-58a2-4071-bc91-cab090f78f64 req-1bcd3f2e-dd92-40a6-9fad-7c521255df79 service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Received event network-vif-unplugged-3b687d6e-b489-4bac-bc15-392d19991969 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 18:59:53 user nova-compute[72874]: INFO nova.compute.manager [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 18:59:53 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 18:59:53 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 18:59:53 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 18:59:54 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:59:54 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:59:54 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Took 0.98 seconds to deallocate network for instance.
Aug 17 18:59:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-5e1fa506-f396-470b-8bb0-7ac6a6434c81 req-bc74d3d5-57b0-4a83-9105-4b99e67852bf service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Received event network-vif-deleted-3b687d6e-b489-4bac-bc15-392d19991969 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:59:54 user nova-compute[72874]: INFO nova.compute.manager [req-5e1fa506-f396-470b-8bb0-7ac6a6434c81 req-bc74d3d5-57b0-4a83-9105-4b99e67852bf service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Neutron deleted interface 3b687d6e-b489-4bac-bc15-392d19991969; detaching it from the instance and deleting it from the info cache
Aug 17 18:59:54 user nova-compute[72874]: DEBUG nova.network.neutron [req-5e1fa506-f396-470b-8bb0-7ac6a6434c81 req-bc74d3d5-57b0-4a83-9105-4b99e67852bf service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 18:59:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-5e1fa506-f396-470b-8bb0-7ac6a6434c81 req-bc74d3d5-57b0-4a83-9105-4b99e67852bf service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Detach interface failed, port_id=3b687d6e-b489-4bac-bc15-392d19991969, reason: Instance 6910360f-3540-4705-a5ad-16fac50d2e18 could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 18:59:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:54 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 18:59:54 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 18:59:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.123s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:54 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Deleted allocations for instance 6910360f-3540-4705-a5ad-16fac50d2e18
Aug 17 18:59:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-4c75501c-120e-4661-baa7-16ebf8283906 tempest-AttachVolumeTestJSON-385757460 tempest-AttachVolumeTestJSON-385757460-project-member] Lock "6910360f-3540-4705-a5ad-16fac50d2e18" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.139s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-4c090e58-2fa4-4ec4-83cd-c3cd5db2d426 req-e145f074-b648-4e7b-9227-1fe0b60c3b2c service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Received event network-vif-plugged-3b687d6e-b489-4bac-bc15-392d19991969 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 18:59:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4c090e58-2fa4-4ec4-83cd-c3cd5db2d426 req-e145f074-b648-4e7b-9227-1fe0b60c3b2c service nova] Acquiring lock "6910360f-3540-4705-a5ad-16fac50d2e18-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 18:59:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4c090e58-2fa4-4ec4-83cd-c3cd5db2d426 req-e145f074-b648-4e7b-9227-1fe0b60c3b2c service nova] Lock "6910360f-3540-4705-a5ad-16fac50d2e18-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 18:59:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-4c090e58-2fa4-4ec4-83cd-c3cd5db2d426 req-e145f074-b648-4e7b-9227-1fe0b60c3b2c service nova] Lock "6910360f-3540-4705-a5ad-16fac50d2e18-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 18:59:55 user nova-compute[72874]: DEBUG nova.compute.manager [req-4c090e58-2fa4-4ec4-83cd-c3cd5db2d426 req-e145f074-b648-4e7b-9227-1fe0b60c3b2c service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] No waiting events found dispatching network-vif-plugged-3b687d6e-b489-4bac-bc15-392d19991969 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 18:59:55 user nova-compute[72874]: WARNING nova.compute.manager [req-4c090e58-2fa4-4ec4-83cd-c3cd5db2d426 req-e145f074-b648-4e7b-9227-1fe0b60c3b2c service nova] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Received unexpected event network-vif-plugged-3b687d6e-b489-4bac-bc15-392d19991969 for instance with vm_state deleted and task_state None.
Aug 17 18:59:56 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:59:56 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 18:59:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:00:00 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692298785.6827097, 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:00:00 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] VM Stopped (Lifecycle Event)
Aug 17 19:00:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b66de93f-e54c-4080-b4e5-389910799b60 None None] [instance: 60d899bf-f5ff-4bbe-9f4d-25bc3cc97c1d] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:00:01 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:00:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:00:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:00:08 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692298793.2816179, 6910360f-3540-4705-a5ad-16fac50d2e18 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:00:08 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] VM Stopped (Lifecycle Event)
Aug 17 19:00:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-d198952a-9c71-462b-9f77-d2bc5ab4b12f None None] [instance: 6910360f-3540-4705-a5ad-16fac50d2e18] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:00:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:00:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:00:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:00:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:00:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:00:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:00:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:00:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:00:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:00:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:00:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:00:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:00:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:00:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:00:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:00:47 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:00:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:00:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:00:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:00:47 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:00:47 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:00:47 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:00:47 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8938MB free_disk=25.201736450195312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:00:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:00:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:00:47 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:00:47 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:00:47 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:00:47 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:00:47 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:00:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.139s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:00:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:00:49 user nova-compute[72874]: INFO nova.compute.claims [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Claim successful on node user
Aug 17 19:00:49 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.181s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG nova.network.neutron [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:00:49 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:00:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:00:49 user nova-compute[72874]: INFO nova.virt.block_device [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Booting with volume 2116ded6-64a3-45e1-8352-b6f6fd268fb6 at /dev/vda
Aug 17 19:00:49 user nova-compute[72874]: DEBUG os_brick.utils [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG nova.policy [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73cdc5d076a14395ad1958394f0c48e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41b302a39da4ab18c463789f2a73dd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d59b179-d540-458f-8702-ab6f2dcdacf9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adb91d5-7ae1-45aa-a45f-b13ac946dca9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[775a4c18-8ee6-46aa-bff9-3fdfbc379f30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd77704-a7cc-419b-8bfb-161dba29c165]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:00:49 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:00:49 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef79b33-2110-4c04-9587-11afd6813f4a]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG os_brick.utils [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:00:49 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Updating existing volume attachment record: b7cc4110-2569-4ce7-a579-4cc49ccf6bc8 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:00:50 user nova-compute[72874]: DEBUG nova.network.neutron [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Successfully created port: 1cc9e8d6-6d85-44c9-854a-69fd9b021de6 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Skipping network cache update for instance because it is Building. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Didn't find any instances for network info cache update. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Successfully updated port: 1cc9e8d6-6d85-44c9-854a-69fd9b021de6 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "refresh_cache-96517eb0-3bd8-4983-8e13-fdc526e94dd1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquired lock "refresh_cache-96517eb0-3bd8-4983-8e13-fdc526e94dd1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG nova.compute.manager [req-c0f53e3b-edbf-466c-9f8a-acc997578943 req-3ed5a81b-15b2-4d0a-9b78-1b39a6fd2732 service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Received event network-changed-1cc9e8d6-6d85-44c9-854a-69fd9b021de6 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG nova.compute.manager [req-c0f53e3b-edbf-466c-9f8a-acc997578943 req-3ed5a81b-15b2-4d0a-9b78-1b39a6fd2732 service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Refreshing instance network info cache due to event network-changed-1cc9e8d6-6d85-44c9-854a-69fd9b021de6. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c0f53e3b-edbf-466c-9f8a-acc997578943 req-3ed5a81b-15b2-4d0a-9b78-1b39a6fd2732 service nova] Acquiring lock "refresh_cache-96517eb0-3bd8-4983-8e13-fdc526e94dd1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG nova.network.neutron [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Updating instance_info_cache with network_info: [{"id": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "address": "fa:16:3e:4c:40:90", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc9e8d6-6d", "ovs_interfaceid": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Releasing lock "refresh_cache-96517eb0-3bd8-4983-8e13-fdc526e94dd1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG nova.compute.manager [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Instance network_info: |[{"id": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "address": "fa:16:3e:4c:40:90", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc9e8d6-6d", "ovs_interfaceid": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c0f53e3b-edbf-466c-9f8a-acc997578943 req-3ed5a81b-15b2-4d0a-9b78-1b39a6fd2732 service nova] Acquired lock "refresh_cache-96517eb0-3bd8-4983-8e13-fdc526e94dd1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:00:51 user nova-compute[72874]: DEBUG nova.network.neutron [req-c0f53e3b-edbf-466c-9f8a-acc997578943 req-3ed5a81b-15b2-4d0a-9b78-1b39a6fd2732 service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Refreshing network info cache for port 1cc9e8d6-6d85-44c9-854a-69fd9b021de6 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:00:52 user nova-compute[72874]: DEBUG nova.network.neutron [req-c0f53e3b-edbf-466c-9f8a-acc997578943 req-3ed5a81b-15b2-4d0a-9b78-1b39a6fd2732 service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Updated VIF entry in instance network info cache for port 1cc9e8d6-6d85-44c9-854a-69fd9b021de6. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:00:52 user nova-compute[72874]: DEBUG nova.network.neutron [req-c0f53e3b-edbf-466c-9f8a-acc997578943 req-3ed5a81b-15b2-4d0a-9b78-1b39a6fd2732 service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Updating instance_info_cache with network_info: [{"id": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "address": "fa:16:3e:4c:40:90", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc9e8d6-6d", "ovs_interfaceid": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:00:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c0f53e3b-edbf-466c-9f8a-acc997578943 req-3ed5a81b-15b2-4d0a-9b78-1b39a6fd2732 service nova] Releasing lock "refresh_cache-96517eb0-3bd8-4983-8e13-fdc526e94dd1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:00:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:00:55 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:00:56 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:00:58 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:00:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:00:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:00:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:00:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:00:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:00:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:01:00 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Creating image(s)
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Ensure instance console log exists: /opt/stack/data/nova/instances/96517eb0-3bd8-4983-8e13-fdc526e94dd1/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Start _get_guest_xml network_info=[{"id": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "address": "fa:16:3e:4c:40:90", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc9e8d6-6d", "ovs_interfaceid": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfazCiOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '96517eb0-3bd8-4983-8e13-fdc526e94dd1', 'attached_at': '', 'detached_at': '', 'volume_id': '2116ded6-64a3-45e1-8352-b6f6fd268fb6', 'serial': '2116ded6-64a3-45e1-8352-b6f6fd268fb6'}, 'delete_on_termination': False, 'attachment_id': 'b7cc4110-2569-4ce7-a579-4cc49ccf6bc8', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:01:00 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:01:00 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfazCiOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:01:00 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:01:00 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:01:00 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[21372c1c-e6f6-4a03-a635-fb55f4506a26]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:01:00 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8681f2b4-2fb8-4c24-806a-84dde7df436a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6] added
Aug 17 19:01:00 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[107e5fcd-d44c-4afd-b1a6-16743c1cc330]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d61d6b-7803-46bb-b93d-ffc5dc05ab19]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SfazCiOT {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SfazCiOT" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4b06c0-46f9-4c7a-8770-f6d17204c549]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SfazCiOT'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[392fea60-ec91-481a-987a-32c70eb5e342]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d88cd73-3011-4c01-b9b2-bf3a9192e592]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 19:01:00 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 19:01:00 user nova-compute[72874]:  {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:01:00 user nova-compute[72874]: WARNING os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 19:01:00 user nova-compute[72874]: 
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd41ac9e-21ea-4ba4-b199-aefa2f88ca41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6, portal: 172.16.0.220,3260]
Aug 17 19:01:00 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6, portal: 172.16.0.220,3260] successful.
Aug 17 19:01:00 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0c290f-4e49-49c5-b7fc-e5f0463fbcf3]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbbe5e6-e87e-4985-af17-f629b7cffc96]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)
Aug 17 19:01:00 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)
Aug 17 19:01:00 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fb3451-fb16-40d5-90dc-5786e1c102e2]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:01:00 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfazCiOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23763623438633031', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763623438633031', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2061523143',display_name='tempest-TestVolumeBootPattern-server-2061523143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2061523143',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD0QND9oDqLOeCRGJTfBiqvc9k5nhifesJCblmsatayQ+aHww3+pEyx5G901afugjNrgFeSIRDCLDmSzdlvHF+9raZzw2NgQ/zaMgW0gnu4EPfQxjC8TOHunbpuo/Q4aQ==',key_name='tempest-TestVolumeBootPattern-1498174102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-izw6wwf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:00:50Z,user_data=None,user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=96517eb0-3bd8-4983-8e13-fdc526e94dd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "address": "fa:16:3e:4c:40:90", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc9e8d6-6d", "ovs_interfaceid": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "address": "fa:16:3e:4c:40:90", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc9e8d6-6d", "ovs_interfaceid": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:40:90,bridge_name='br-int',has_traffic_filtering=True,id=1cc9e8d6-6d85-44c9-854a-69fd9b021de6,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cc9e8d6-6d') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG nova.objects.instance [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lazy-loading 'pci_devices' on Instance uuid 96517eb0-3bd8-4983-8e13-fdc526e94dd1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:01:01 user nova-compute[72874]:   <uuid>96517eb0-3bd8-4983-8e13-fdc526e94dd1</uuid>
Aug 17 19:01:01 user nova-compute[72874]:   <name>instance-00000030</name>
Aug 17 19:01:01 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 19:01:01 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 19:01:01 user nova-compute[72874]:   <metadata>
Aug 17 19:01:01 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:01:01 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 19:01:01 user nova-compute[72874]:       <nova:name>tempest-TestVolumeBootPattern-server-2061523143</nova:name>
Aug 17 19:01:01 user nova-compute[72874]:       <nova:creationTime>2023-08-17 19:01:00</nova:creationTime>
Aug 17 19:01:01 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 19:01:01 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 19:01:01 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 19:01:01 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 19:01:01 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:01:01 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:01:01 user nova-compute[72874]:       </nova:flavor>
Aug 17 19:01:01 user nova-compute[72874]:       <nova:owner>
Aug 17 19:01:01 user nova-compute[72874]:         <nova:user uuid="73cdc5d076a14395ad1958394f0c48e4">tempest-TestVolumeBootPattern-414332602-project-member</nova:user>
Aug 17 19:01:01 user nova-compute[72874]:         <nova:project uuid="f41b302a39da4ab18c463789f2a73dd5">tempest-TestVolumeBootPattern-414332602</nova:project>
Aug 17 19:01:01 user nova-compute[72874]:       </nova:owner>
Aug 17 19:01:01 user nova-compute[72874]:       <nova:ports>
Aug 17 19:01:01 user nova-compute[72874]:         <nova:port uuid="1cc9e8d6-6d85-44c9-854a-69fd9b021de6">
Aug 17 19:01:01 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 19:01:01 user nova-compute[72874]:         </nova:port>
Aug 17 19:01:01 user nova-compute[72874]:       </nova:ports>
Aug 17 19:01:01 user nova-compute[72874]:     </nova:instance>
Aug 17 19:01:01 user nova-compute[72874]:   </metadata>
Aug 17 19:01:01 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 19:01:01 user nova-compute[72874]:     <system>
Aug 17 19:01:01 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:01:01 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:01:01 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 19:01:01 user nova-compute[72874]:       <entry name="serial">96517eb0-3bd8-4983-8e13-fdc526e94dd1</entry>
Aug 17 19:01:01 user nova-compute[72874]:       <entry name="uuid">96517eb0-3bd8-4983-8e13-fdc526e94dd1</entry>
Aug 17 19:01:01 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:01:01 user nova-compute[72874]:     </system>
Aug 17 19:01:01 user nova-compute[72874]:   </sysinfo>
Aug 17 19:01:01 user nova-compute[72874]:   <os>
Aug 17 19:01:01 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:01:01 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 19:01:01 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 19:01:01 user nova-compute[72874]:   </os>
Aug 17 19:01:01 user nova-compute[72874]:   <features>
Aug 17 19:01:01 user nova-compute[72874]:     <acpi/>
Aug 17 19:01:01 user nova-compute[72874]:     <apic/>
Aug 17 19:01:01 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 19:01:01 user nova-compute[72874]:   </features>
Aug 17 19:01:01 user nova-compute[72874]:   <clock offset="utc">
Aug 17 19:01:01 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:01:01 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:01:01 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 19:01:01 user nova-compute[72874]:   </clock>
Aug 17 19:01:01 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 19:01:01 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 19:01:01 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:01:01 user nova-compute[72874]:   </cpu>
Aug 17 19:01:01 user nova-compute[72874]:   <devices>
Aug 17 19:01:01 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 19:01:01 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:01:01 user nova-compute[72874]:       <source dev="/dev/sdb"/>
Aug 17 19:01:01 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 19:01:01 user nova-compute[72874]:       <serial>2116ded6-64a3-45e1-8352-b6f6fd268fb6</serial>
Aug 17 19:01:01 user nova-compute[72874]:     </disk>
Aug 17 19:01:01 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 19:01:01 user nova-compute[72874]:       <mac address="fa:16:3e:4c:40:90"/>
Aug 17 19:01:01 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 19:01:01 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 19:01:01 user nova-compute[72874]:       <target dev="tap1cc9e8d6-6d"/>
Aug 17 19:01:01 user nova-compute[72874]:     </interface>
Aug 17 19:01:01 user nova-compute[72874]:     <serial type="pty">
Aug 17 19:01:01 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/96517eb0-3bd8-4983-8e13-fdc526e94dd1/console.log" append="off"/>
Aug 17 19:01:01 user nova-compute[72874]:     </serial>
Aug 17 19:01:01 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:01:01 user nova-compute[72874]:     <video>
Aug 17 19:01:01 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 19:01:01 user nova-compute[72874]:     </video>
Aug 17 19:01:01 user nova-compute[72874]:     <rng model="virtio">
Aug 17 19:01:01 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:01:01 user nova-compute[72874]:     </rng>
Aug 17 19:01:01 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:01:01 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 19:01:01 user nova-compute[72874]:       <stats period="10"/>
Aug 17 19:01:01 user nova-compute[72874]:     </memballoon>
Aug 17 19:01:01 user nova-compute[72874]:   </devices>
Aug 17 19:01:01 user nova-compute[72874]: </domain>
Aug 17 19:01:01 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2061523143',display_name='tempest-TestVolumeBootPattern-server-2061523143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2061523143',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD0QND9oDqLOeCRGJTfBiqvc9k5nhifesJCblmsatayQ+aHww3+pEyx5G901afugjNrgFeSIRDCLDmSzdlvHF+9raZzw2NgQ/zaMgW0gnu4EPfQxjC8TOHunbpuo/Q4aQ==',key_name='tempest-TestVolumeBootPattern-1498174102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-izw6wwf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:00:50Z,user_data=None,user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=96517eb0-3bd8-4983-8e13-fdc526e94dd1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "address": "fa:16:3e:4c:40:90", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc9e8d6-6d", "ovs_interfaceid": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "address": "fa:16:3e:4c:40:90", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc9e8d6-6d", "ovs_interfaceid": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:40:90,bridge_name='br-int',has_traffic_filtering=True,id=1cc9e8d6-6d85-44c9-854a-69fd9b021de6,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cc9e8d6-6d') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG os_vif [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:40:90,bridge_name='br-int',has_traffic_filtering=True,id=1cc9e8d6-6d85-44c9-854a-69fd9b021de6,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cc9e8d6-6d') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cc9e8d6-6d, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1cc9e8d6-6d, col_values=(('external_ids', {'iface-id': '1cc9e8d6-6d85-44c9-854a-69fd9b021de6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:40:90', 'vm-uuid': '96517eb0-3bd8-4983-8e13-fdc526e94dd1'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:01 user nova-compute[72874]: INFO os_vif [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:40:90,bridge_name='br-int',has_traffic_filtering=True,id=1cc9e8d6-6d85-44c9-854a-69fd9b021de6,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cc9e8d6-6d')
Aug 17 19:01:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:01:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] No VIF found with MAC fa:16:3e:4c:40:90, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:01:02 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:01:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:01:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:03 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:01:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-e87facd8-32b2-4abd-8e52-e37a5fa16db5 req-c69b43a3-5f35-469f-815a-c6ba0b8a75e5 service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Received event network-vif-plugged-1cc9e8d6-6d85-44c9-854a-69fd9b021de6 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:01:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e87facd8-32b2-4abd-8e52-e37a5fa16db5 req-c69b43a3-5f35-469f-815a-c6ba0b8a75e5 service nova] Acquiring lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:01:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e87facd8-32b2-4abd-8e52-e37a5fa16db5 req-c69b43a3-5f35-469f-815a-c6ba0b8a75e5 service nova] Lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:01:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e87facd8-32b2-4abd-8e52-e37a5fa16db5 req-c69b43a3-5f35-469f-815a-c6ba0b8a75e5 service nova] Lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:01:03 user nova-compute[72874]: DEBUG nova.compute.manager [req-e87facd8-32b2-4abd-8e52-e37a5fa16db5 req-c69b43a3-5f35-469f-815a-c6ba0b8a75e5 service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] No waiting events found dispatching network-vif-plugged-1cc9e8d6-6d85-44c9-854a-69fd9b021de6 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:01:03 user nova-compute[72874]: WARNING nova.compute.manager [req-e87facd8-32b2-4abd-8e52-e37a5fa16db5 req-c69b43a3-5f35-469f-815a-c6ba0b8a75e5 service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Received unexpected event network-vif-plugged-1cc9e8d6-6d85-44c9-854a-69fd9b021de6 for instance with vm_state building and task_state spawning.
Aug 17 19:01:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692298865.1728134, 96517eb0-3bd8-4983-8e13-fdc526e94dd1 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:01:05 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] VM Resumed (Lifecycle Event)
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:01:05 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Instance spawned successfully.
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:01:05 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692298865.1803014, 96517eb0-3bd8-4983-8e13-fdc526e94dd1 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:01:05 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] VM Started (Lifecycle Event)
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:01:05 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:01:05 user nova-compute[72874]: INFO nova.compute.manager [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.compute.manager [req-2fb3a44e-ddf3-49f9-a5c9-ab72e45bc1a4 req-00db6d43-2046-4c63-93cc-91171b96767f service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Received event network-vif-plugged-1cc9e8d6-6d85-44c9-854a-69fd9b021de6 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:01:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2fb3a44e-ddf3-49f9-a5c9-ab72e45bc1a4 req-00db6d43-2046-4c63-93cc-91171b96767f service nova] Acquiring lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:01:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2fb3a44e-ddf3-49f9-a5c9-ab72e45bc1a4 req-00db6d43-2046-4c63-93cc-91171b96767f service nova] Lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:01:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2fb3a44e-ddf3-49f9-a5c9-ab72e45bc1a4 req-00db6d43-2046-4c63-93cc-91171b96767f service nova] Lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:01:05 user nova-compute[72874]: DEBUG nova.compute.manager [req-2fb3a44e-ddf3-49f9-a5c9-ab72e45bc1a4 req-00db6d43-2046-4c63-93cc-91171b96767f service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] No waiting events found dispatching network-vif-plugged-1cc9e8d6-6d85-44c9-854a-69fd9b021de6 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:01:05 user nova-compute[72874]: WARNING nova.compute.manager [req-2fb3a44e-ddf3-49f9-a5c9-ab72e45bc1a4 req-00db6d43-2046-4c63-93cc-91171b96767f service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Received unexpected event network-vif-plugged-1cc9e8d6-6d85-44c9-854a-69fd9b021de6 for instance with vm_state building and task_state spawning.
Aug 17 19:01:05 user nova-compute[72874]: INFO nova.compute.manager [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Took 16.13 seconds to build instance.
Aug 17 19:01:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-25379e64-46c2-4594-b393-328b79f9b8ef tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.230s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:01:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:01:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:01:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:01:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:01:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:01:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:01:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:48 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:01:49 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:01:49 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:01:49 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8762MB free_disk=25.19098663330078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 96517eb0-3bd8-4983-8e13-fdc526e94dd1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:01:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:01:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:01:53 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:01:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:01:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:01:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-96517eb0-3bd8-4983-8e13-fdc526e94dd1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:01:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-96517eb0-3bd8-4983-8e13-fdc526e94dd1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:01:53 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:01:53 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid 96517eb0-3bd8-4983-8e13-fdc526e94dd1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:01:54 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Updating instance_info_cache with network_info: [{"id": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "address": "fa:16:3e:4c:40:90", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc9e8d6-6d", "ovs_interfaceid": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:01:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-96517eb0-3bd8-4983-8e13-fdc526e94dd1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:01:54 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:01:55 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:01:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:01:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:01:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:01:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:01:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:01:58 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:02:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:02:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:02:03 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:02:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:02:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:02:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:02:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:02:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:02:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:02:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:02:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:02:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:02:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:02:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:02:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:02:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:02:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:02:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:02:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:02:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:02:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:02:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:02:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:02:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:02:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:02:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:02:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:02:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:02:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:02:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:02:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:02:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:02:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:41 user nova-compute[72874]: DEBUG nova.compute.manager [req-0921ea62-65cb-468d-9eae-698348888ad9 req-8be56e1c-41f3-47c3-bae1-fc9f483b93bb service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Received event network-changed-1cc9e8d6-6d85-44c9-854a-69fd9b021de6 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:02:41 user nova-compute[72874]: DEBUG nova.compute.manager [req-0921ea62-65cb-468d-9eae-698348888ad9 req-8be56e1c-41f3-47c3-bae1-fc9f483b93bb service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Refreshing instance network info cache due to event network-changed-1cc9e8d6-6d85-44c9-854a-69fd9b021de6. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:02:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0921ea62-65cb-468d-9eae-698348888ad9 req-8be56e1c-41f3-47c3-bae1-fc9f483b93bb service nova] Acquiring lock "refresh_cache-96517eb0-3bd8-4983-8e13-fdc526e94dd1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:02:41 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0921ea62-65cb-468d-9eae-698348888ad9 req-8be56e1c-41f3-47c3-bae1-fc9f483b93bb service nova] Acquired lock "refresh_cache-96517eb0-3bd8-4983-8e13-fdc526e94dd1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:02:41 user nova-compute[72874]: DEBUG nova.network.neutron [req-0921ea62-65cb-468d-9eae-698348888ad9 req-8be56e1c-41f3-47c3-bae1-fc9f483b93bb service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Refreshing network info cache for port 1cc9e8d6-6d85-44c9-854a-69fd9b021de6 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:02:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:02:42 user nova-compute[72874]: INFO nova.compute.manager [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Terminating instance
Aug 17 19:02:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG nova.network.neutron [req-0921ea62-65cb-468d-9eae-698348888ad9 req-8be56e1c-41f3-47c3-bae1-fc9f483b93bb service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Updated VIF entry in instance network info cache for port 1cc9e8d6-6d85-44c9-854a-69fd9b021de6. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG nova.network.neutron [req-0921ea62-65cb-468d-9eae-698348888ad9 req-8be56e1c-41f3-47c3-bae1-fc9f483b93bb service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Updating instance_info_cache with network_info: [{"id": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "address": "fa:16:3e:4c:40:90", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc9e8d6-6d", "ovs_interfaceid": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-0921ea62-65cb-468d-9eae-698348888ad9 req-8be56e1c-41f3-47c3-bae1-fc9f483b93bb service nova] Releasing lock "refresh_cache-96517eb0-3bd8-4983-8e13-fdc526e94dd1" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:42 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Instance destroyed successfully.
Aug 17 19:02:42 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lazy-loading 'resources' on Instance uuid 96517eb0-3bd8-4983-8e13-fdc526e94dd1 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:00:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2061523143',display_name='tempest-TestVolumeBootPattern-server-2061523143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2061523143',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD0QND9oDqLOeCRGJTfBiqvc9k5nhifesJCblmsatayQ+aHww3+pEyx5G901afugjNrgFeSIRDCLDmSzdlvHF+9raZzw2NgQ/zaMgW0gnu4EPfQxjC8TOHunbpuo/Q4aQ==',key_name='tempest-TestVolumeBootPattern-1498174102',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:01:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-izw6wwf2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:01:05Z,user_data=None,user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=96517eb0-3bd8-4983-8e13-fdc526e94dd1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "address": "fa:16:3e:4c:40:90", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc9e8d6-6d", "ovs_interfaceid": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "address": "fa:16:3e:4c:40:90", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cc9e8d6-6d", "ovs_interfaceid": "1cc9e8d6-6d85-44c9-854a-69fd9b021de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:40:90,bridge_name='br-int',has_traffic_filtering=True,id=1cc9e8d6-6d85-44c9-854a-69fd9b021de6,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cc9e8d6-6d') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG os_vif [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:40:90,bridge_name='br-int',has_traffic_filtering=True,id=1cc9e8d6-6d85-44c9-854a-69fd9b021de6,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cc9e8d6-6d') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cc9e8d6-6d, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:02:42 user nova-compute[72874]: INFO os_vif [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:40:90,bridge_name='br-int',has_traffic_filtering=True,id=1cc9e8d6-6d85-44c9-854a-69fd9b021de6,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cc9e8d6-6d')
Aug 17 19:02:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfazCiOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:02:43 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a42873b-4420-4d68-bb15-ac3407dcbf15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f44441-5e17-48dc-b2c4-b47fab416b61]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)
Aug 17 19:02:43 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)
Aug 17 19:02:43 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a050a320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3a80c6-c201-48fb-a3d1-eaa347c58b0e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2ed21e-338a-4b77-b773-7f9d97f96cf2]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[981d5c7f-008d-4666-980b-4dcb6f0a1392]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d146a77-4fd9-43ba-8011-0c47cbbc7fa2]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb0275f50-7cb48c01c99911c5', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b0275f50', '/dev/disk/by-id/scsi-23763623438633031') {{(pid=83588) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de612d0-cf5c-4864-bc4c-8071ce748a3b]: (4, None) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a455f863-5e23-4707-8d2c-34e478257059]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[674e2e89-4805-4aa4-8833-32fb485f0576]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6, portal: 172.16.0.220,3260]
Aug 17 19:02:43 user nova-compute[72874]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6, portal: 172.16.0.220,3260] successful.
Aug 17 19:02:43 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[46814a74-eefd-480f-961c-508af435c987]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== disconnect_volume: return (280ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:02:43 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Deleting instance files /opt/stack/data/nova/instances/96517eb0-3bd8-4983-8e13-fdc526e94dd1_del
Aug 17 19:02:43 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Deletion of /opt/stack/data/nova/instances/96517eb0-3bd8-4983-8e13-fdc526e94dd1_del complete
Aug 17 19:02:43 user nova-compute[72874]: INFO nova.compute.manager [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-82289597-c15f-47e0-bac4-820478dd0c49 req-b083baa4-030d-4309-bdd8-b21dd42ca3dc service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Received event network-vif-unplugged-1cc9e8d6-6d85-44c9-854a-69fd9b021de6 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-82289597-c15f-47e0-bac4-820478dd0c49 req-b083baa4-030d-4309-bdd8-b21dd42ca3dc service nova] Acquiring lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-82289597-c15f-47e0-bac4-820478dd0c49 req-b083baa4-030d-4309-bdd8-b21dd42ca3dc service nova] Lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-82289597-c15f-47e0-bac4-820478dd0c49 req-b083baa4-030d-4309-bdd8-b21dd42ca3dc service nova] Lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-82289597-c15f-47e0-bac4-820478dd0c49 req-b083baa4-030d-4309-bdd8-b21dd42ca3dc service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] No waiting events found dispatching network-vif-unplugged-1cc9e8d6-6d85-44c9-854a-69fd9b021de6 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-82289597-c15f-47e0-bac4-820478dd0c49 req-b083baa4-030d-4309-bdd8-b21dd42ca3dc service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Received event network-vif-unplugged-1cc9e8d6-6d85-44c9-854a-69fd9b021de6 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-82289597-c15f-47e0-bac4-820478dd0c49 req-b083baa4-030d-4309-bdd8-b21dd42ca3dc service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Received event network-vif-plugged-1cc9e8d6-6d85-44c9-854a-69fd9b021de6 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-82289597-c15f-47e0-bac4-820478dd0c49 req-b083baa4-030d-4309-bdd8-b21dd42ca3dc service nova] Acquiring lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-82289597-c15f-47e0-bac4-820478dd0c49 req-b083baa4-030d-4309-bdd8-b21dd42ca3dc service nova] Lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-82289597-c15f-47e0-bac4-820478dd0c49 req-b083baa4-030d-4309-bdd8-b21dd42ca3dc service nova] Lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:02:43 user nova-compute[72874]: DEBUG nova.compute.manager [req-82289597-c15f-47e0-bac4-820478dd0c49 req-b083baa4-030d-4309-bdd8-b21dd42ca3dc service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] No waiting events found dispatching network-vif-plugged-1cc9e8d6-6d85-44c9-854a-69fd9b021de6 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:02:43 user nova-compute[72874]: WARNING nova.compute.manager [req-82289597-c15f-47e0-bac4-820478dd0c49 req-b083baa4-030d-4309-bdd8-b21dd42ca3dc service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Received unexpected event network-vif-plugged-1cc9e8d6-6d85-44c9-854a-69fd9b021de6 for instance with vm_state active and task_state deleting.
Aug 17 19:02:44 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:02:44 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Took 0.97 seconds to deallocate network for instance.
Aug 17 19:02:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-402a4758-1f8f-4f57-8745-bb35704b5337 req-514c44ab-e0e6-4842-acbd-a8018377bb27 service nova] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Received event network-vif-deleted-1cc9e8d6-6d85-44c9-854a-69fd9b021de6 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:02:45 user nova-compute[72874]: INFO nova.compute.manager [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Took 0.87 seconds to detach 1 volumes for instance.
Aug 17 19:02:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:02:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:02:45 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:02:45 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:02:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:02:45 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Deleted allocations for instance 96517eb0-3bd8-4983-8e13-fdc526e94dd1
Aug 17 19:02:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b2aa3a8b-08a2-4530-91bf-13a4e5db163b tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "96517eb0-3bd8-4983-8e13-fdc526e94dd1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.476s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:02:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:02:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:02:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:02:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:02:49 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:02:49 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:02:49 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:02:49 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8900MB free_disk=25.18948745727539GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:02:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:02:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:02:49 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:02:49 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:02:49 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:02:49 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:02:49 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:02:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:02:50 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:02:50 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:02:51 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:02:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:02:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:02:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:02:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:02:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:55 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:02:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:02:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:02:55 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Didn't find any instances for network info cache update. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 19:02:55 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:02:57 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692298962.9612057, 96517eb0-3bd8-4983-8e13-fdc526e94dd1 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:02:57 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] VM Stopped (Lifecycle Event)
Aug 17 19:02:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-37355c2e-5c90-44a0-a225-29ec2b81ec65 None None] [instance: 96517eb0-3bd8-4983-8e13-fdc526e94dd1] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:02:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:02:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:02:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:02:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:02:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:02:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:03:01 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:03:01 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:03:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 19:03:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:05 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:03:05 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:03:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:03:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:03:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:15 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:03:15 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 19:03:15 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] There are 0 instances to clean {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 19:03:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:03:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:03:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:03:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:03:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:03:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:03:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:03:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:03:34 user nova-compute[72874]: INFO nova.compute.claims [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Claim successful on node user
Aug 17 19:03:34 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:03:34 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:03:34 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:03:34 user nova-compute[72874]: INFO nova.virt.block_device [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Booting with volume 2116ded6-64a3-45e1-8352-b6f6fd268fb6 at /dev/vda
Aug 17 19:03:34 user nova-compute[72874]: DEBUG os_brick.utils [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG nova.policy [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73cdc5d076a14395ad1958394f0c48e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41b302a39da4ab18c463789f2a73dd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a7e006-fa68-46fa-93ca-cdcd7c3ec594]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e5b35d-ccb9-4482-a56c-e99e457178ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dce71e8-ba3f-4950-85ea-83d819e4787e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[746b7109-fcc2-409b-802b-ac42b5e837fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:03:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:03:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:03:35 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:03:35 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:03:35 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[309160ff-fe42-4297-bc6a-fa4635fefb0f]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:03:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:03:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:03:35 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:03:35 user nova-compute[72874]: DEBUG os_brick.utils [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:03:35 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Updating existing volume attachment record: f777a3ec-1d82-46ea-8972-07574fcd5ca5 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:03:35 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Successfully created port: fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:03:36 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Successfully updated port: fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:03:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:03:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquired lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:03:36 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:03:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-29b15232-3f47-4e21-be6c-8782ac4926fa req-42a4711b-81e7-459a-b9e2-994155e94fb7 service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Received event network-changed-fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:03:36 user nova-compute[72874]: DEBUG nova.compute.manager [req-29b15232-3f47-4e21-be6c-8782ac4926fa req-42a4711b-81e7-459a-b9e2-994155e94fb7 service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Refreshing instance network info cache due to event network-changed-fd32008c-39d7-48e7-bc46-0a48df1c0b9f. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:03:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-29b15232-3f47-4e21-be6c-8782ac4926fa req-42a4711b-81e7-459a-b9e2-994155e94fb7 service nova] Acquiring lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:03:36 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:03:36 user nova-compute[72874]: DEBUG nova.network.neutron [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Updating instance_info_cache with network_info: [{"id": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "address": "fa:16:3e:3b:93:c7", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32008c-39", "ovs_interfaceid": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:03:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Releasing lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:03:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Instance network_info: |[{"id": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "address": "fa:16:3e:3b:93:c7", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32008c-39", "ovs_interfaceid": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:03:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-29b15232-3f47-4e21-be6c-8782ac4926fa req-42a4711b-81e7-459a-b9e2-994155e94fb7 service nova] Acquired lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:03:36 user nova-compute[72874]: DEBUG nova.network.neutron [req-29b15232-3f47-4e21-be6c-8782ac4926fa req-42a4711b-81e7-459a-b9e2-994155e94fb7 service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Refreshing network info cache for port fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:03:37 user nova-compute[72874]: DEBUG nova.network.neutron [req-29b15232-3f47-4e21-be6c-8782ac4926fa req-42a4711b-81e7-459a-b9e2-994155e94fb7 service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Updated VIF entry in instance network info cache for port fd32008c-39d7-48e7-bc46-0a48df1c0b9f. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:03:37 user nova-compute[72874]: DEBUG nova.network.neutron [req-29b15232-3f47-4e21-be6c-8782ac4926fa req-42a4711b-81e7-459a-b9e2-994155e94fb7 service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Updating instance_info_cache with network_info: [{"id": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "address": "fa:16:3e:3b:93:c7", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32008c-39", "ovs_interfaceid": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:03:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-29b15232-3f47-4e21-be6c-8782ac4926fa req-42a4711b-81e7-459a-b9e2-994155e94fb7 service nova] Releasing lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:03:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:03:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:03:45 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Creating image(s)
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Ensure instance console log exists: /opt/stack/data/nova/instances/5e41f20d-6d1a-4289-b7e5-53959a7c66b7/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Start _get_guest_xml network_info=[{"id": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "address": "fa:16:3e:3b:93:c7", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32008c-39", "ovs_interfaceid": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfazCiOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5e41f20d-6d1a-4289-b7e5-53959a7c66b7', 'attached_at': '', 'detached_at': '', 'volume_id': '2116ded6-64a3-45e1-8352-b6f6fd268fb6', 'serial': '2116ded6-64a3-45e1-8352-b6f6fd268fb6'}, 'delete_on_termination': False, 'attachment_id': 'f777a3ec-1d82-46ea-8972-07574fcd5ca5', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:03:45 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:03:45 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfazCiOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:03:45 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:03:45 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:03:45 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e24820-cbb4-44aa-86ac-b890fa018a19]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:03:45 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31d27c0-5ea3-43ee-b666-b8f1f07a3baa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6] added
Aug 17 19:03:45 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[afde1953-c442-44d2-971e-99be1355376a]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4cb36d-de97-45ef-9bc5-3e5dafa223d6]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SfazCiOT {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SfazCiOT" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[00857ca5-6bc1-4a39-98f2-56bd84060ea8]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SfazCiOT'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[599b40a6-68f8-4ab1-b172-208be23ebd5b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[64234bdd-9a02-4652-b21d-996f9b0a00be]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 19:03:45 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 19:03:45 user nova-compute[72874]:  {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:03:45 user nova-compute[72874]: WARNING os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 19:03:45 user nova-compute[72874]: 
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[786dbc87-c3a6-47b4-ae07-c8520a84b839]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6, portal: 172.16.0.220,3260]
Aug 17 19:03:45 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6, portal: 172.16.0.220,3260] successful.
Aug 17 19:03:45 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c76ab3-c249-4263-a552-89df080cb5a6]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c81f145-590a-4a03-a79e-98d407d5547c]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)
Aug 17 19:03:45 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)
Aug 17 19:03:45 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4335407-99fc-4e81-a7c9-a31fb3a02e9b]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:03:45 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfazCiOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23763623438633031', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763623438633031', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1595057449',display_name='tempest-TestVolumeBootPattern-server-1595057449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1595057449',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD0QND9oDqLOeCRGJTfBiqvc9k5nhifesJCblmsatayQ+aHww3+pEyx5G901afugjNrgFeSIRDCLDmSzdlvHF+9raZzw2NgQ/zaMgW0gnu4EPfQxjC8TOHunbpuo/Q4aQ==',key_name='tempest-TestVolumeBootPattern-1498174102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-0tz1hraw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:03:35Z,user_data=None,user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=5e41f20d-6d1a-4289-b7e5-53959a7c66b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "address": "fa:16:3e:3b:93:c7", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32008c-39", "ovs_interfaceid": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "address": "fa:16:3e:3b:93:c7", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32008c-39", "ovs_interfaceid": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:93:c7,bridge_name='br-int',has_traffic_filtering=True,id=fd32008c-39d7-48e7-bc46-0a48df1c0b9f,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd32008c-39') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG nova.objects.instance [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e41f20d-6d1a-4289-b7e5-53959a7c66b7 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:03:46 user nova-compute[72874]:   <uuid>5e41f20d-6d1a-4289-b7e5-53959a7c66b7</uuid>
Aug 17 19:03:46 user nova-compute[72874]:   <name>instance-00000031</name>
Aug 17 19:03:46 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 19:03:46 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 19:03:46 user nova-compute[72874]:   <metadata>
Aug 17 19:03:46 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:03:46 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 19:03:46 user nova-compute[72874]:       <nova:name>tempest-TestVolumeBootPattern-server-1595057449</nova:name>
Aug 17 19:03:46 user nova-compute[72874]:       <nova:creationTime>2023-08-17 19:03:45</nova:creationTime>
Aug 17 19:03:46 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 19:03:46 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 19:03:46 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 19:03:46 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 19:03:46 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:03:46 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:03:46 user nova-compute[72874]:       </nova:flavor>
Aug 17 19:03:46 user nova-compute[72874]:       <nova:owner>
Aug 17 19:03:46 user nova-compute[72874]:         <nova:user uuid="73cdc5d076a14395ad1958394f0c48e4">tempest-TestVolumeBootPattern-414332602-project-member</nova:user>
Aug 17 19:03:46 user nova-compute[72874]:         <nova:project uuid="f41b302a39da4ab18c463789f2a73dd5">tempest-TestVolumeBootPattern-414332602</nova:project>
Aug 17 19:03:46 user nova-compute[72874]:       </nova:owner>
Aug 17 19:03:46 user nova-compute[72874]:       <nova:ports>
Aug 17 19:03:46 user nova-compute[72874]:         <nova:port uuid="fd32008c-39d7-48e7-bc46-0a48df1c0b9f">
Aug 17 19:03:46 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 19:03:46 user nova-compute[72874]:         </nova:port>
Aug 17 19:03:46 user nova-compute[72874]:       </nova:ports>
Aug 17 19:03:46 user nova-compute[72874]:     </nova:instance>
Aug 17 19:03:46 user nova-compute[72874]:   </metadata>
Aug 17 19:03:46 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 19:03:46 user nova-compute[72874]:     <system>
Aug 17 19:03:46 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:03:46 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:03:46 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 19:03:46 user nova-compute[72874]:       <entry name="serial">5e41f20d-6d1a-4289-b7e5-53959a7c66b7</entry>
Aug 17 19:03:46 user nova-compute[72874]:       <entry name="uuid">5e41f20d-6d1a-4289-b7e5-53959a7c66b7</entry>
Aug 17 19:03:46 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:03:46 user nova-compute[72874]:     </system>
Aug 17 19:03:46 user nova-compute[72874]:   </sysinfo>
Aug 17 19:03:46 user nova-compute[72874]:   <os>
Aug 17 19:03:46 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:03:46 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 19:03:46 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 19:03:46 user nova-compute[72874]:   </os>
Aug 17 19:03:46 user nova-compute[72874]:   <features>
Aug 17 19:03:46 user nova-compute[72874]:     <acpi/>
Aug 17 19:03:46 user nova-compute[72874]:     <apic/>
Aug 17 19:03:46 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 19:03:46 user nova-compute[72874]:   </features>
Aug 17 19:03:46 user nova-compute[72874]:   <clock offset="utc">
Aug 17 19:03:46 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:03:46 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:03:46 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 19:03:46 user nova-compute[72874]:   </clock>
Aug 17 19:03:46 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 19:03:46 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 19:03:46 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:03:46 user nova-compute[72874]:   </cpu>
Aug 17 19:03:46 user nova-compute[72874]:   <devices>
Aug 17 19:03:46 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 19:03:46 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:03:46 user nova-compute[72874]:       <source dev="/dev/sdb"/>
Aug 17 19:03:46 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 19:03:46 user nova-compute[72874]:       <serial>2116ded6-64a3-45e1-8352-b6f6fd268fb6</serial>
Aug 17 19:03:46 user nova-compute[72874]:     </disk>
Aug 17 19:03:46 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 19:03:46 user nova-compute[72874]:       <mac address="fa:16:3e:3b:93:c7"/>
Aug 17 19:03:46 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 19:03:46 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 19:03:46 user nova-compute[72874]:       <target dev="tapfd32008c-39"/>
Aug 17 19:03:46 user nova-compute[72874]:     </interface>
Aug 17 19:03:46 user nova-compute[72874]:     <serial type="pty">
Aug 17 19:03:46 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/5e41f20d-6d1a-4289-b7e5-53959a7c66b7/console.log" append="off"/>
Aug 17 19:03:46 user nova-compute[72874]:     </serial>
Aug 17 19:03:46 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:03:46 user nova-compute[72874]:     <video>
Aug 17 19:03:46 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 19:03:46 user nova-compute[72874]:     </video>
Aug 17 19:03:46 user nova-compute[72874]:     <rng model="virtio">
Aug 17 19:03:46 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:03:46 user nova-compute[72874]:     </rng>
Aug 17 19:03:46 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:03:46 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 19:03:46 user nova-compute[72874]:       <stats period="10"/>
Aug 17 19:03:46 user nova-compute[72874]:     </memballoon>
Aug 17 19:03:46 user nova-compute[72874]:   </devices>
Aug 17 19:03:46 user nova-compute[72874]: </domain>
Aug 17 19:03:46 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1595057449',display_name='tempest-TestVolumeBootPattern-server-1595057449',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1595057449',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD0QND9oDqLOeCRGJTfBiqvc9k5nhifesJCblmsatayQ+aHww3+pEyx5G901afugjNrgFeSIRDCLDmSzdlvHF+9raZzw2NgQ/zaMgW0gnu4EPfQxjC8TOHunbpuo/Q4aQ==',key_name='tempest-TestVolumeBootPattern-1498174102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-0tz1hraw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:03:35Z,user_data=None,user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=5e41f20d-6d1a-4289-b7e5-53959a7c66b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "address": "fa:16:3e:3b:93:c7", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32008c-39", "ovs_interfaceid": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "address": "fa:16:3e:3b:93:c7", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32008c-39", "ovs_interfaceid": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:93:c7,bridge_name='br-int',has_traffic_filtering=True,id=fd32008c-39d7-48e7-bc46-0a48df1c0b9f,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd32008c-39') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG os_vif [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:93:c7,bridge_name='br-int',has_traffic_filtering=True,id=fd32008c-39d7-48e7-bc46-0a48df1c0b9f,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd32008c-39') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd32008c-39, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfd32008c-39, col_values=(('external_ids', {'iface-id': 'fd32008c-39d7-48e7-bc46-0a48df1c0b9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:93:c7', 'vm-uuid': '5e41f20d-6d1a-4289-b7e5-53959a7c66b7'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:46 user nova-compute[72874]: INFO os_vif [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:93:c7,bridge_name='br-int',has_traffic_filtering=True,id=fd32008c-39d7-48e7-bc46-0a48df1c0b9f,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd32008c-39')
Aug 17 19:03:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:03:46 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] No VIF found with MAC fa:16:3e:3b:93:c7, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:03:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-6ffb9880-6e40-4dae-9cdf-e07edc0af011 req-37bb5dd7-6e97-4def-8e6d-2d39c9f439d7 service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Received event network-vif-plugged-fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:03:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6ffb9880-6e40-4dae-9cdf-e07edc0af011 req-37bb5dd7-6e97-4def-8e6d-2d39c9f439d7 service nova] Acquiring lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:03:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6ffb9880-6e40-4dae-9cdf-e07edc0af011 req-37bb5dd7-6e97-4def-8e6d-2d39c9f439d7 service nova] Lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:03:48 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-6ffb9880-6e40-4dae-9cdf-e07edc0af011 req-37bb5dd7-6e97-4def-8e6d-2d39c9f439d7 service nova] Lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:03:48 user nova-compute[72874]: DEBUG nova.compute.manager [req-6ffb9880-6e40-4dae-9cdf-e07edc0af011 req-37bb5dd7-6e97-4def-8e6d-2d39c9f439d7 service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] No waiting events found dispatching network-vif-plugged-fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:03:48 user nova-compute[72874]: WARNING nova.compute.manager [req-6ffb9880-6e40-4dae-9cdf-e07edc0af011 req-37bb5dd7-6e97-4def-8e6d-2d39c9f439d7 service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Received unexpected event network-vif-plugged-fd32008c-39d7-48e7-bc46-0a48df1c0b9f for instance with vm_state building and task_state spawning.
Aug 17 19:03:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:03:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:03:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:03:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:03:49 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:03:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692299030.0127413, 5e41f20d-6d1a-4289-b7e5-53959a7c66b7 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:03:50 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] VM Resumed (Lifecycle Event)
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-3d8c937a-d0a1-4436-9477-95035bce9a55 req-132d5245-5111-4188-a181-20143a8e923b service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Received event network-vif-plugged-fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3d8c937a-d0a1-4436-9477-95035bce9a55 req-132d5245-5111-4188-a181-20143a8e923b service nova] Acquiring lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3d8c937a-d0a1-4436-9477-95035bce9a55 req-132d5245-5111-4188-a181-20143a8e923b service nova] Lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-3d8c937a-d0a1-4436-9477-95035bce9a55 req-132d5245-5111-4188-a181-20143a8e923b service nova] Lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.compute.manager [req-3d8c937a-d0a1-4436-9477-95035bce9a55 req-132d5245-5111-4188-a181-20143a8e923b service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] No waiting events found dispatching network-vif-plugged-fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:03:50 user nova-compute[72874]: WARNING nova.compute.manager [req-3d8c937a-d0a1-4436-9477-95035bce9a55 req-132d5245-5111-4188-a181-20143a8e923b service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Received unexpected event network-vif-plugged-fd32008c-39d7-48e7-bc46-0a48df1c0b9f for instance with vm_state building and task_state spawning.
Aug 17 19:03:50 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:03:50 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8848MB free_disk=25.18653106689453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:03:50 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Instance spawned successfully.
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:03:50 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692299030.0141702, 5e41f20d-6d1a-4289-b7e5-53959a7c66b7 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:03:50 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] VM Started (Lifecycle Event)
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:03:50 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:03:50 user nova-compute[72874]: INFO nova.compute.manager [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Took 5.13 seconds to spawn the instance on the hypervisor.
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.compute.manager [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 5e41f20d-6d1a-4289-b7e5-53959a7c66b7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing inventories for resource provider b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 19:03:50 user nova-compute[72874]: INFO nova.compute.manager [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Took 16.10 seconds to build instance.
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Updating ProviderTree inventory for provider b677d836-b01b-4674-8972-53d526f1b5f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Updating inventory in ProviderTree for provider b677d836-b01b-4674-8972-53d526f1b5f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-3f4e5c2a-b80d-472a-8c5d-1b8e5e6a3085 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.222s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing aggregate associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, aggregates: None {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing trait associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, traits: HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:03:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:03:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:51 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:03:51 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:03:53 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:03:56 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:03:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:03:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:03:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:03:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:03:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:03:57 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:03:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:03:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:03:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:03:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:03:57 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:03:57 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid 5e41f20d-6d1a-4289-b7e5-53959a7c66b7 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:03:57 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Updating instance_info_cache with network_info: [{"id": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "address": "fa:16:3e:3b:93:c7", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32008c-39", "ovs_interfaceid": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:03:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:03:57 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:04:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:04:01 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:04:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:04:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:04:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:04:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:04:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:05 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:04:05 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:04:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:04:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:04:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:04:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:04:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Acquiring lock "53ba195b-f1b7-4fc9-a311-7a9904625c13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:04:35 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:04:36 user nova-compute[72874]: INFO nova.compute.claims [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Claim successful on node user
Aug 17 19:04:36 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.193s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG nova.network.neutron [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:04:36 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:04:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:04:36 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Creating image(s)
Aug 17 19:04:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Acquiring lock "/opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lock "/opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lock "/opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG nova.policy [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ded5de4639544869b28ff88efed82d84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8aef2f77b6b4e948613363a0cc93e13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.224s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.193s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk 1073741824" returned: 0 in 0.056s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:04:36 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:04:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.179s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:04:37 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Checking if we can resize image /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:04:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:04:37 user nova-compute[72874]: DEBUG nova.network.neutron [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Successfully created port: 1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:04:37 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:04:37 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Cannot resize image /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:04:37 user nova-compute[72874]: DEBUG nova.objects.instance [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lazy-loading 'migration_context' on Instance uuid 53ba195b-f1b7-4fc9-a311-7a9904625c13 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:04:37 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:04:37 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Ensure instance console log exists: /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:04:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:04:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:04:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.network.neutron [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Successfully updated port: 1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Acquiring lock "refresh_cache-53ba195b-f1b7-4fc9-a311-7a9904625c13" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Acquired lock "refresh_cache-53ba195b-f1b7-4fc9-a311-7a9904625c13" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.network.neutron [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-2426872b-a000-4c2d-a71f-cd42ea0ffa17 req-5650c95b-ad7a-4f1e-8bad-d9d62523f40c service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received event network-changed-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.compute.manager [req-2426872b-a000-4c2d-a71f-cd42ea0ffa17 req-5650c95b-ad7a-4f1e-8bad-d9d62523f40c service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Refreshing instance network info cache due to event network-changed-1a6780af-7892-4d7b-a872-bc5f44813708. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2426872b-a000-4c2d-a71f-cd42ea0ffa17 req-5650c95b-ad7a-4f1e-8bad-d9d62523f40c service nova] Acquiring lock "refresh_cache-53ba195b-f1b7-4fc9-a311-7a9904625c13" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.network.neutron [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.network.neutron [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Updating instance_info_cache with network_info: [{"id": "1a6780af-7892-4d7b-a872-bc5f44813708", "address": "fa:16:3e:86:e9:b2", "network": {"id": "4f400bf7-2de4-4236-b43f-9e23dcd6691f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f12da590ccfd4c61b5cb087b3fc22de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a6780af-78", "ovs_interfaceid": "1a6780af-7892-4d7b-a872-bc5f44813708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Releasing lock "refresh_cache-53ba195b-f1b7-4fc9-a311-7a9904625c13" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.compute.manager [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Instance network_info: |[{"id": "1a6780af-7892-4d7b-a872-bc5f44813708", "address": "fa:16:3e:86:e9:b2", "network": {"id": "4f400bf7-2de4-4236-b43f-9e23dcd6691f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f12da590ccfd4c61b5cb087b3fc22de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a6780af-78", "ovs_interfaceid": "1a6780af-7892-4d7b-a872-bc5f44813708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2426872b-a000-4c2d-a71f-cd42ea0ffa17 req-5650c95b-ad7a-4f1e-8bad-d9d62523f40c service nova] Acquired lock "refresh_cache-53ba195b-f1b7-4fc9-a311-7a9904625c13" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.network.neutron [req-2426872b-a000-4c2d-a71f-cd42ea0ffa17 req-5650c95b-ad7a-4f1e-8bad-d9d62523f40c service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Refreshing network info cache for port 1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Start _get_guest_xml network_info=[{"id": "1a6780af-7892-4d7b-a872-bc5f44813708", "address": "fa:16:3e:86:e9:b2", "network": {"id": "4f400bf7-2de4-4236-b43f-9e23dcd6691f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f12da590ccfd4c61b5cb087b3fc22de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a6780af-78", "ovs_interfaceid": "1a6780af-7892-4d7b-a872-bc5f44813708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:04:38 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:04:38 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-584981869',display_name='tempest-VolumesNegativeTest-instance-584981869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-584981869',id=50,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8aef2f77b6b4e948613363a0cc93e13',ramdisk_id='',reservation_id='r-yqiaeee0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1556700090',owner_user_name='tempest-VolumesNegativeTest-1556700090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:04:36Z,user_data=None,user_id='ded5de4639544869b28ff88efed82d84',uuid=53ba195b-f1b7-4fc9-a311-7a9904625c13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a6780af-7892-4d7b-a872-bc5f44813708", "address": "fa:16:3e:86:e9:b2", "network": {"id": "4f400bf7-2de4-4236-b43f-9e23dcd6691f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f12da590ccfd4c61b5cb087b3fc22de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a6780af-78", "ovs_interfaceid": "1a6780af-7892-4d7b-a872-bc5f44813708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Converting VIF {"id": "1a6780af-7892-4d7b-a872-bc5f44813708", "address": "fa:16:3e:86:e9:b2", "network": {"id": "4f400bf7-2de4-4236-b43f-9e23dcd6691f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f12da590ccfd4c61b5cb087b3fc22de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a6780af-78", "ovs_interfaceid": "1a6780af-7892-4d7b-a872-bc5f44813708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:e9:b2,bridge_name='br-int',has_traffic_filtering=True,id=1a6780af-7892-4d7b-a872-bc5f44813708,network=Network(4f400bf7-2de4-4236-b43f-9e23dcd6691f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a6780af-78') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.objects.instance [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lazy-loading 'pci_devices' on Instance uuid 53ba195b-f1b7-4fc9-a311-7a9904625c13 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:04:38 user nova-compute[72874]:   <uuid>53ba195b-f1b7-4fc9-a311-7a9904625c13</uuid>
Aug 17 19:04:38 user nova-compute[72874]:   <name>instance-00000032</name>
Aug 17 19:04:38 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 19:04:38 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 19:04:38 user nova-compute[72874]:   <metadata>
Aug 17 19:04:38 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:04:38 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 19:04:38 user nova-compute[72874]:       <nova:name>tempest-VolumesNegativeTest-instance-584981869</nova:name>
Aug 17 19:04:38 user nova-compute[72874]:       <nova:creationTime>2023-08-17 19:04:38</nova:creationTime>
Aug 17 19:04:38 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 19:04:38 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 19:04:38 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 19:04:38 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 19:04:38 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:04:38 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:04:38 user nova-compute[72874]:       </nova:flavor>
Aug 17 19:04:38 user nova-compute[72874]:       <nova:owner>
Aug 17 19:04:38 user nova-compute[72874]:         <nova:user uuid="ded5de4639544869b28ff88efed82d84">tempest-VolumesNegativeTest-1556700090-project-member</nova:user>
Aug 17 19:04:38 user nova-compute[72874]:         <nova:project uuid="a8aef2f77b6b4e948613363a0cc93e13">tempest-VolumesNegativeTest-1556700090</nova:project>
Aug 17 19:04:38 user nova-compute[72874]:       </nova:owner>
Aug 17 19:04:38 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 19:04:38 user nova-compute[72874]:       <nova:ports>
Aug 17 19:04:38 user nova-compute[72874]:         <nova:port uuid="1a6780af-7892-4d7b-a872-bc5f44813708">
Aug 17 19:04:38 user nova-compute[72874]:           <nova:ip type="fixed" address="192.168.233.244" ipVersion="4"/>
Aug 17 19:04:38 user nova-compute[72874]:         </nova:port>
Aug 17 19:04:38 user nova-compute[72874]:       </nova:ports>
Aug 17 19:04:38 user nova-compute[72874]:     </nova:instance>
Aug 17 19:04:38 user nova-compute[72874]:   </metadata>
Aug 17 19:04:38 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 19:04:38 user nova-compute[72874]:     <system>
Aug 17 19:04:38 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:04:38 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:04:38 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 19:04:38 user nova-compute[72874]:       <entry name="serial">53ba195b-f1b7-4fc9-a311-7a9904625c13</entry>
Aug 17 19:04:38 user nova-compute[72874]:       <entry name="uuid">53ba195b-f1b7-4fc9-a311-7a9904625c13</entry>
Aug 17 19:04:38 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:04:38 user nova-compute[72874]:     </system>
Aug 17 19:04:38 user nova-compute[72874]:   </sysinfo>
Aug 17 19:04:38 user nova-compute[72874]:   <os>
Aug 17 19:04:38 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:04:38 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 19:04:38 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 19:04:38 user nova-compute[72874]:   </os>
Aug 17 19:04:38 user nova-compute[72874]:   <features>
Aug 17 19:04:38 user nova-compute[72874]:     <acpi/>
Aug 17 19:04:38 user nova-compute[72874]:     <apic/>
Aug 17 19:04:38 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 19:04:38 user nova-compute[72874]:   </features>
Aug 17 19:04:38 user nova-compute[72874]:   <clock offset="utc">
Aug 17 19:04:38 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:04:38 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:04:38 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 19:04:38 user nova-compute[72874]:   </clock>
Aug 17 19:04:38 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 19:04:38 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 19:04:38 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:04:38 user nova-compute[72874]:   </cpu>
Aug 17 19:04:38 user nova-compute[72874]:   <devices>
Aug 17 19:04:38 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 19:04:38 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:04:38 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk"/>
Aug 17 19:04:38 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 19:04:38 user nova-compute[72874]:     </disk>
Aug 17 19:04:38 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 19:04:38 user nova-compute[72874]:       <mac address="fa:16:3e:86:e9:b2"/>
Aug 17 19:04:38 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 19:04:38 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 19:04:38 user nova-compute[72874]:       <target dev="tap1a6780af-78"/>
Aug 17 19:04:38 user nova-compute[72874]:     </interface>
Aug 17 19:04:38 user nova-compute[72874]:     <serial type="pty">
Aug 17 19:04:38 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/console.log" append="off"/>
Aug 17 19:04:38 user nova-compute[72874]:     </serial>
Aug 17 19:04:38 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:04:38 user nova-compute[72874]:     <video>
Aug 17 19:04:38 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 19:04:38 user nova-compute[72874]:     </video>
Aug 17 19:04:38 user nova-compute[72874]:     <rng model="virtio">
Aug 17 19:04:38 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:04:38 user nova-compute[72874]:     </rng>
Aug 17 19:04:38 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:04:38 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 19:04:38 user nova-compute[72874]:       <stats period="10"/>
Aug 17 19:04:38 user nova-compute[72874]:     </memballoon>
Aug 17 19:04:38 user nova-compute[72874]:   </devices>
Aug 17 19:04:38 user nova-compute[72874]: </domain>
Aug 17 19:04:38 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-584981869',display_name='tempest-VolumesNegativeTest-instance-584981869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-584981869',id=50,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8aef2f77b6b4e948613363a0cc93e13',ramdisk_id='',reservation_id='r-yqiaeee0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1556700090',owner_user_name='tempest-VolumesNegativeTest-1556700090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:04:36Z,user_data=None,user_id='ded5de4639544869b28ff88efed82d84',uuid=53ba195b-f1b7-4fc9-a311-7a9904625c13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a6780af-7892-4d7b-a872-bc5f44813708", "address": "fa:16:3e:86:e9:b2", "network": {"id": "4f400bf7-2de4-4236-b43f-9e23dcd6691f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f12da590ccfd4c61b5cb087b3fc22de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a6780af-78", "ovs_interfaceid": "1a6780af-7892-4d7b-a872-bc5f44813708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Converting VIF {"id": "1a6780af-7892-4d7b-a872-bc5f44813708", "address": "fa:16:3e:86:e9:b2", "network": {"id": "4f400bf7-2de4-4236-b43f-9e23dcd6691f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f12da590ccfd4c61b5cb087b3fc22de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a6780af-78", "ovs_interfaceid": "1a6780af-7892-4d7b-a872-bc5f44813708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:e9:b2,bridge_name='br-int',has_traffic_filtering=True,id=1a6780af-7892-4d7b-a872-bc5f44813708,network=Network(4f400bf7-2de4-4236-b43f-9e23dcd6691f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a6780af-78') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG os_vif [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:e9:b2,bridge_name='br-int',has_traffic_filtering=True,id=1a6780af-7892-4d7b-a872-bc5f44813708,network=Network(4f400bf7-2de4-4236-b43f-9e23dcd6691f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a6780af-78') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a6780af-78, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1a6780af-78, col_values=(('external_ids', {'iface-id': '1a6780af-7892-4d7b-a872-bc5f44813708', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:e9:b2', 'vm-uuid': '53ba195b-f1b7-4fc9-a311-7a9904625c13'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:38 user nova-compute[72874]: INFO os_vif [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:e9:b2,bridge_name='br-int',has_traffic_filtering=True,id=1a6780af-7892-4d7b-a872-bc5f44813708,network=Network(4f400bf7-2de4-4236-b43f-9e23dcd6691f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a6780af-78')
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:04:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] No VIF found with MAC fa:16:3e:86:e9:b2, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:04:39 user nova-compute[72874]: DEBUG nova.network.neutron [req-2426872b-a000-4c2d-a71f-cd42ea0ffa17 req-5650c95b-ad7a-4f1e-8bad-d9d62523f40c service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Updated VIF entry in instance network info cache for port 1a6780af-7892-4d7b-a872-bc5f44813708. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:04:39 user nova-compute[72874]: DEBUG nova.network.neutron [req-2426872b-a000-4c2d-a71f-cd42ea0ffa17 req-5650c95b-ad7a-4f1e-8bad-d9d62523f40c service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Updating instance_info_cache with network_info: [{"id": "1a6780af-7892-4d7b-a872-bc5f44813708", "address": "fa:16:3e:86:e9:b2", "network": {"id": "4f400bf7-2de4-4236-b43f-9e23dcd6691f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f12da590ccfd4c61b5cb087b3fc22de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a6780af-78", "ovs_interfaceid": "1a6780af-7892-4d7b-a872-bc5f44813708", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:04:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2426872b-a000-4c2d-a71f-cd42ea0ffa17 req-5650c95b-ad7a-4f1e-8bad-d9d62523f40c service nova] Releasing lock "refresh_cache-53ba195b-f1b7-4fc9-a311-7a9904625c13" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:04:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:40 user nova-compute[72874]: DEBUG nova.compute.manager [req-7c0cf182-09e0-4014-95fa-f45932ea9c69 req-b8194db7-1b76-4de1-9b5b-afc981623c6b service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received event network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:04:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7c0cf182-09e0-4014-95fa-f45932ea9c69 req-b8194db7-1b76-4de1-9b5b-afc981623c6b service nova] Acquiring lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:04:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7c0cf182-09e0-4014-95fa-f45932ea9c69 req-b8194db7-1b76-4de1-9b5b-afc981623c6b service nova] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:04:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-7c0cf182-09e0-4014-95fa-f45932ea9c69 req-b8194db7-1b76-4de1-9b5b-afc981623c6b service nova] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:04:40 user nova-compute[72874]: DEBUG nova.compute.manager [req-7c0cf182-09e0-4014-95fa-f45932ea9c69 req-b8194db7-1b76-4de1-9b5b-afc981623c6b service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] No waiting events found dispatching network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:04:40 user nova-compute[72874]: WARNING nova.compute.manager [req-7c0cf182-09e0-4014-95fa-f45932ea9c69 req-b8194db7-1b76-4de1-9b5b-afc981623c6b service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received unexpected event network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 for instance with vm_state building and task_state spawning.
Aug 17 19:04:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692299082.393355, 53ba195b-f1b7-4fc9-a311-7a9904625c13 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:04:42 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] VM Resumed (Lifecycle Event)
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:04:42 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Instance spawned successfully.
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-ae447a8d-4177-4045-bc22-d65314d152b0 req-c23305a1-fceb-439e-b1a6-0828d5e4f75d service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received event network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:04:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ae447a8d-4177-4045-bc22-d65314d152b0 req-c23305a1-fceb-439e-b1a6-0828d5e4f75d service nova] Acquiring lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:04:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ae447a8d-4177-4045-bc22-d65314d152b0 req-c23305a1-fceb-439e-b1a6-0828d5e4f75d service nova] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:04:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ae447a8d-4177-4045-bc22-d65314d152b0 req-c23305a1-fceb-439e-b1a6-0828d5e4f75d service nova] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-ae447a8d-4177-4045-bc22-d65314d152b0 req-c23305a1-fceb-439e-b1a6-0828d5e4f75d service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] No waiting events found dispatching network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:04:42 user nova-compute[72874]: WARNING nova.compute.manager [req-ae447a8d-4177-4045-bc22-d65314d152b0 req-c23305a1-fceb-439e-b1a6-0828d5e4f75d service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received unexpected event network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 for instance with vm_state building and task_state spawning.
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:04:42 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692299082.3944, 53ba195b-f1b7-4fc9-a311-7a9904625c13 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:04:42 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] VM Started (Lifecycle Event)
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:04:42 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:04:42 user nova-compute[72874]: INFO nova.compute.manager [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Took 6.03 seconds to spawn the instance on the hypervisor.
Aug 17 19:04:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:04:42 user nova-compute[72874]: INFO nova.compute.manager [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Took 6.56 seconds to build instance.
Aug 17 19:04:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-d2ec595d-e249-484a-a980-e3f33fd3625e tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.659s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:04:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:04:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:04:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:04:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:04:49 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:04:49 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:04:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:04:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:04:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:04:49 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:04:50 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:04:50 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:04:50 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8594MB free_disk=25.183486938476562GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:04:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:04:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:04:50 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 5e41f20d-6d1a-4289-b7e5-53959a7c66b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:04:50 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 53ba195b-f1b7-4fc9-a311-7a9904625c13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:04:50 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:04:50 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:04:50 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:04:50 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:04:50 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:04:50 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:04:51 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:04:52 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:04:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:04:54 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:04:56 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:04:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:04:58 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:04:58 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:04:58 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:04:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:04:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:04:58 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:04:58 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid 5e41f20d-6d1a-4289-b7e5-53959a7c66b7 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:04:58 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Updating instance_info_cache with network_info: [{"id": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "address": "fa:16:3e:3b:93:c7", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32008c-39", "ovs_interfaceid": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:04:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:04:58 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:04:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:05:01 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:05:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:06 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:05:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:05:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:05:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:05:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:05:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:05:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:05:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-9e2623cd-6fdc-440a-9c00-d6b82549d425 req-10055d6c-03ab-4e30-a7fc-fafd715a341b service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Received event network-changed-fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:05:26 user nova-compute[72874]: DEBUG nova.compute.manager [req-9e2623cd-6fdc-440a-9c00-d6b82549d425 req-10055d6c-03ab-4e30-a7fc-fafd715a341b service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Refreshing instance network info cache due to event network-changed-fd32008c-39d7-48e7-bc46-0a48df1c0b9f. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:05:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e2623cd-6fdc-440a-9c00-d6b82549d425 req-10055d6c-03ab-4e30-a7fc-fafd715a341b service nova] Acquiring lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:05:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e2623cd-6fdc-440a-9c00-d6b82549d425 req-10055d6c-03ab-4e30-a7fc-fafd715a341b service nova] Acquired lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:05:26 user nova-compute[72874]: DEBUG nova.network.neutron [req-9e2623cd-6fdc-440a-9c00-d6b82549d425 req-10055d6c-03ab-4e30-a7fc-fafd715a341b service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Refreshing network info cache for port fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:05:27 user nova-compute[72874]: DEBUG nova.network.neutron [req-9e2623cd-6fdc-440a-9c00-d6b82549d425 req-10055d6c-03ab-4e30-a7fc-fafd715a341b service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Updated VIF entry in instance network info cache for port fd32008c-39d7-48e7-bc46-0a48df1c0b9f. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:05:27 user nova-compute[72874]: DEBUG nova.network.neutron [req-9e2623cd-6fdc-440a-9c00-d6b82549d425 req-10055d6c-03ab-4e30-a7fc-fafd715a341b service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Updating instance_info_cache with network_info: [{"id": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "address": "fa:16:3e:3b:93:c7", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32008c-39", "ovs_interfaceid": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:05:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-9e2623cd-6fdc-440a-9c00-d6b82549d425 req-10055d6c-03ab-4e30-a7fc-fafd715a341b service nova] Releasing lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:05:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:05:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:05:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:05:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:05:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:05:40 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:05:40 user nova-compute[72874]: INFO nova.compute.claims [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Claim successful on node user
Aug 17 19:05:40 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:05:40 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:05:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.227s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:05:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:05:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:05:40 user nova-compute[72874]: DEBUG nova.network.neutron [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:05:40 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:05:40 user nova-compute[72874]: DEBUG nova.compute.manager [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:05:41 user nova-compute[72874]: INFO nova.virt.block_device [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Booting with volume ababd96d-9108-486e-9119-25655f49d556 at /dev/vda
Aug 17 19:05:41 user nova-compute[72874]: DEBUG nova.policy [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73cdc5d076a14395ad1958394f0c48e4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f41b302a39da4ab18c463789f2a73dd5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG os_brick.utils [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba390350-554d-41c5-bb4e-be976017aa0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[11698c87-1205-42af-925d-66a6009429f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba15c46f-ef39-42d9-a883-6e7e9013a027]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e51a461-0ada-494b-bc9a-ac64ea220e9c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:05:41 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:05:41 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[488a6887-8f2f-4d69-94da-76c7ac7660f8]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG os_brick.utils [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Updating existing volume attachment record: 5c02601b-28e6-4c75-a13c-e640166325e6 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:41 user nova-compute[72874]: DEBUG nova.network.neutron [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Successfully created port: 782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:05:42 user nova-compute[72874]: DEBUG nova.network.neutron [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Successfully updated port: 782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:05:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "refresh_cache-ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:05:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquired lock "refresh_cache-ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:05:42 user nova-compute[72874]: DEBUG nova.network.neutron [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:05:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-2f9ad951-cf4d-49e5-b94e-33cdf9090109 req-88805e89-2f3f-4db5-b1f0-d5a8934a1503 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Received event network-changed-782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:05:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-2f9ad951-cf4d-49e5-b94e-33cdf9090109 req-88805e89-2f3f-4db5-b1f0-d5a8934a1503 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Refreshing instance network info cache due to event network-changed-782f78a8-d031-49ee-a123-25fef3f8c271. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:05:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2f9ad951-cf4d-49e5-b94e-33cdf9090109 req-88805e89-2f3f-4db5-b1f0-d5a8934a1503 service nova] Acquiring lock "refresh_cache-ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:05:42 user nova-compute[72874]: DEBUG nova.network.neutron [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:05:42 user nova-compute[72874]: DEBUG nova.network.neutron [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Updating instance_info_cache with network_info: [{"id": "782f78a8-d031-49ee-a123-25fef3f8c271", "address": "fa:16:3e:e0:ca:b6", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782f78a8-d0", "ovs_interfaceid": "782f78a8-d031-49ee-a123-25fef3f8c271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:05:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Releasing lock "refresh_cache-ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:05:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Instance network_info: |[{"id": "782f78a8-d031-49ee-a123-25fef3f8c271", "address": "fa:16:3e:e0:ca:b6", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782f78a8-d0", "ovs_interfaceid": "782f78a8-d031-49ee-a123-25fef3f8c271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:05:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2f9ad951-cf4d-49e5-b94e-33cdf9090109 req-88805e89-2f3f-4db5-b1f0-d5a8934a1503 service nova] Acquired lock "refresh_cache-ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:05:42 user nova-compute[72874]: DEBUG nova.network.neutron [req-2f9ad951-cf4d-49e5-b94e-33cdf9090109 req-88805e89-2f3f-4db5-b1f0-d5a8934a1503 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Refreshing network info cache for port 782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:05:43 user nova-compute[72874]: DEBUG nova.network.neutron [req-2f9ad951-cf4d-49e5-b94e-33cdf9090109 req-88805e89-2f3f-4db5-b1f0-d5a8934a1503 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Updated VIF entry in instance network info cache for port 782f78a8-d031-49ee-a123-25fef3f8c271. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:05:43 user nova-compute[72874]: DEBUG nova.network.neutron [req-2f9ad951-cf4d-49e5-b94e-33cdf9090109 req-88805e89-2f3f-4db5-b1f0-d5a8934a1503 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Updating instance_info_cache with network_info: [{"id": "782f78a8-d031-49ee-a123-25fef3f8c271", "address": "fa:16:3e:e0:ca:b6", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782f78a8-d0", "ovs_interfaceid": "782f78a8-d031-49ee-a123-25fef3f8c271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:05:43 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2f9ad951-cf4d-49e5-b94e-33cdf9090109 req-88805e89-2f3f-4db5-b1f0-d5a8934a1503 service nova] Releasing lock "refresh_cache-ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:05:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:51 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:05:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:05:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:05:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:05:51 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:05:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:05:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:05:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.compute.manager [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:05:52 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Creating image(s)
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Did not create local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Ensure instance console log exists: /opt/stack/data/nova/instances/ba412bc8-d47a-4f9f-a22b-4f2adf6df01a/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Start _get_guest_xml network_info=[{"id": "782f78a8-d031-49ee-a123-25fef3f8c271", "address": "fa:16:3e:e0:ca:b6", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782f78a8-d0", "ovs_interfaceid": "782f78a8-d031-49ee-a123-25fef3f8c271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'device_type': 'disk', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woEQKrUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ba412bc8-d47a-4f9f-a22b-4f2adf6df01a', 'attached_at': '', 'detached_at': '', 'volume_id': 'ababd96d-9108-486e-9119-25655f49d556', 'serial': 'ababd96d-9108-486e-9119-25655f49d556'}, 'delete_on_termination': False, 'attachment_id': '5c02601b-28e6-4c75-a13c-e640166325e6', 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:05:52 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:05:52 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8666MB free_disk=25.14672088623047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:05:52 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:05:52 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woEQKrUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:05:52 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:05:52 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:05:52 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1762c888-a5d9-4a02-b6f5-3a3d57545431]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:05:52 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 5e41f20d-6d1a-4289-b7e5-53959a7c66b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 53ba195b-f1b7-4fc9-a311-7a9904625c13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance ba412bc8-d47a-4f9f-a22b-4f2adf6df01a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5678ff8a-e963-47a0-81e3-a5dced4cee3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556] added
Aug 17 19:05:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9dfc8b8-c807-4b24-b3a4-c71f4b5a80f3]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[648ab93f-1edf-4827-97fe-b5fbb5b52b6b]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woEQKrUi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v woEQKrUi" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[261d1915-5990-4417-a60f-a10e288e77ed]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'woEQKrUi'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcec2b7e-d52c-48b2-9939-b7c6bac913db]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dd7b56-4587-4b3f-a2c5-dc277d37d6de]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)
Aug 17 19:05:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)
Aug 17 19:05:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0e9aa2-4224-424d-b6cd-fd978ae41815]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556, portal: 172.16.0.220,3260]
Aug 17 19:05:52 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556, portal: 172.16.0.220,3260] successful.
Aug 17 19:05:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ccd58f7-d5ab-4926-beec-95f1ec07722d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22d5f4a-6952-42fe-a931-743e65b0fefc]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)
Aug 17 19:05:52 user nova-compute[72874]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 (non-flash)
Aug 17 19:05:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)
Aug 17 19:05:52 user nova-compute[72874]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 (non-flash)
Aug 17 19:05:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3102e36-12f1-45f0-b529-d2b14b41167e]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:05:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woEQKrUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23530313263356563', 'path': '/dev/sdc'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530313263356563', 'path': '/dev/sdc'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:05:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-335904975',display_name='tempest-TestVolumeBootPattern-server-335904975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-335904975',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD0QND9oDqLOeCRGJTfBiqvc9k5nhifesJCblmsatayQ+aHww3+pEyx5G901afugjNrgFeSIRDCLDmSzdlvHF+9raZzw2NgQ/zaMgW0gnu4EPfQxjC8TOHunbpuo/Q4aQ==',key_name='tempest-TestVolumeBootPattern-1498174102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-yo4zkxvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:05:41Z,user_data=None,user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=ba412bc8-d47a-4f9f-a22b-4f2adf6df01a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "782f78a8-d031-49ee-a123-25fef3f8c271", "address": "fa:16:3e:e0:ca:b6", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782f78a8-d0", "ovs_interfaceid": "782f78a8-d031-49ee-a123-25fef3f8c271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "782f78a8-d031-49ee-a123-25fef3f8c271", "address": "fa:16:3e:e0:ca:b6", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782f78a8-d0", "ovs_interfaceid": "782f78a8-d031-49ee-a123-25fef3f8c271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=782f78a8-d031-49ee-a123-25fef3f8c271,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap782f78a8-d0') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG nova.objects.instance [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lazy-loading 'pci_devices' on Instance uuid ba412bc8-d47a-4f9f-a22b-4f2adf6df01a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:05:53 user nova-compute[72874]:   <uuid>ba412bc8-d47a-4f9f-a22b-4f2adf6df01a</uuid>
Aug 17 19:05:53 user nova-compute[72874]:   <name>instance-00000033</name>
Aug 17 19:05:53 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 19:05:53 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 19:05:53 user nova-compute[72874]:   <metadata>
Aug 17 19:05:53 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:05:53 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 19:05:53 user nova-compute[72874]:       <nova:name>tempest-TestVolumeBootPattern-server-335904975</nova:name>
Aug 17 19:05:53 user nova-compute[72874]:       <nova:creationTime>2023-08-17 19:05:52</nova:creationTime>
Aug 17 19:05:53 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 19:05:53 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 19:05:53 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 19:05:53 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 19:05:53 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:05:53 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:05:53 user nova-compute[72874]:       </nova:flavor>
Aug 17 19:05:53 user nova-compute[72874]:       <nova:owner>
Aug 17 19:05:53 user nova-compute[72874]:         <nova:user uuid="73cdc5d076a14395ad1958394f0c48e4">tempest-TestVolumeBootPattern-414332602-project-member</nova:user>
Aug 17 19:05:53 user nova-compute[72874]:         <nova:project uuid="f41b302a39da4ab18c463789f2a73dd5">tempest-TestVolumeBootPattern-414332602</nova:project>
Aug 17 19:05:53 user nova-compute[72874]:       </nova:owner>
Aug 17 19:05:53 user nova-compute[72874]:       <nova:ports>
Aug 17 19:05:53 user nova-compute[72874]:         <nova:port uuid="782f78a8-d031-49ee-a123-25fef3f8c271">
Aug 17 19:05:53 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 19:05:53 user nova-compute[72874]:         </nova:port>
Aug 17 19:05:53 user nova-compute[72874]:       </nova:ports>
Aug 17 19:05:53 user nova-compute[72874]:     </nova:instance>
Aug 17 19:05:53 user nova-compute[72874]:   </metadata>
Aug 17 19:05:53 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 19:05:53 user nova-compute[72874]:     <system>
Aug 17 19:05:53 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:05:53 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:05:53 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 19:05:53 user nova-compute[72874]:       <entry name="serial">ba412bc8-d47a-4f9f-a22b-4f2adf6df01a</entry>
Aug 17 19:05:53 user nova-compute[72874]:       <entry name="uuid">ba412bc8-d47a-4f9f-a22b-4f2adf6df01a</entry>
Aug 17 19:05:53 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:05:53 user nova-compute[72874]:     </system>
Aug 17 19:05:53 user nova-compute[72874]:   </sysinfo>
Aug 17 19:05:53 user nova-compute[72874]:   <os>
Aug 17 19:05:53 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:05:53 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 19:05:53 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 19:05:53 user nova-compute[72874]:   </os>
Aug 17 19:05:53 user nova-compute[72874]:   <features>
Aug 17 19:05:53 user nova-compute[72874]:     <acpi/>
Aug 17 19:05:53 user nova-compute[72874]:     <apic/>
Aug 17 19:05:53 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 19:05:53 user nova-compute[72874]:   </features>
Aug 17 19:05:53 user nova-compute[72874]:   <clock offset="utc">
Aug 17 19:05:53 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:05:53 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:05:53 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 19:05:53 user nova-compute[72874]:   </clock>
Aug 17 19:05:53 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 19:05:53 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 19:05:53 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:05:53 user nova-compute[72874]:   </cpu>
Aug 17 19:05:53 user nova-compute[72874]:   <devices>
Aug 17 19:05:53 user nova-compute[72874]:     <disk type="block" device="disk">
Aug 17 19:05:53 user nova-compute[72874]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:05:53 user nova-compute[72874]:       <source dev="/dev/sdc"/>
Aug 17 19:05:53 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 19:05:53 user nova-compute[72874]:       <serial>ababd96d-9108-486e-9119-25655f49d556</serial>
Aug 17 19:05:53 user nova-compute[72874]:     </disk>
Aug 17 19:05:53 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 19:05:53 user nova-compute[72874]:       <mac address="fa:16:3e:e0:ca:b6"/>
Aug 17 19:05:53 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 19:05:53 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 19:05:53 user nova-compute[72874]:       <target dev="tap782f78a8-d0"/>
Aug 17 19:05:53 user nova-compute[72874]:     </interface>
Aug 17 19:05:53 user nova-compute[72874]:     <serial type="pty">
Aug 17 19:05:53 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/ba412bc8-d47a-4f9f-a22b-4f2adf6df01a/console.log" append="off"/>
Aug 17 19:05:53 user nova-compute[72874]:     </serial>
Aug 17 19:05:53 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:05:53 user nova-compute[72874]:     <video>
Aug 17 19:05:53 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 19:05:53 user nova-compute[72874]:     </video>
Aug 17 19:05:53 user nova-compute[72874]:     <rng model="virtio">
Aug 17 19:05:53 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:05:53 user nova-compute[72874]:     </rng>
Aug 17 19:05:53 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:05:53 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 19:05:53 user nova-compute[72874]:       <stats period="10"/>
Aug 17 19:05:53 user nova-compute[72874]:     </memballoon>
Aug 17 19:05:53 user nova-compute[72874]:   </devices>
Aug 17 19:05:53 user nova-compute[72874]: </domain>
Aug 17 19:05:53 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:05:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-335904975',display_name='tempest-TestVolumeBootPattern-server-335904975',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-335904975',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD0QND9oDqLOeCRGJTfBiqvc9k5nhifesJCblmsatayQ+aHww3+pEyx5G901afugjNrgFeSIRDCLDmSzdlvHF+9raZzw2NgQ/zaMgW0gnu4EPfQxjC8TOHunbpuo/Q4aQ==',key_name='tempest-TestVolumeBootPattern-1498174102',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-yo4zkxvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:05:41Z,user_data=None,user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=ba412bc8-d47a-4f9f-a22b-4f2adf6df01a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "782f78a8-d031-49ee-a123-25fef3f8c271", "address": "fa:16:3e:e0:ca:b6", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782f78a8-d0", "ovs_interfaceid": "782f78a8-d031-49ee-a123-25fef3f8c271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "782f78a8-d031-49ee-a123-25fef3f8c271", "address": "fa:16:3e:e0:ca:b6", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782f78a8-d0", "ovs_interfaceid": "782f78a8-d031-49ee-a123-25fef3f8c271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=782f78a8-d031-49ee-a123-25fef3f8c271,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap782f78a8-d0') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG os_vif [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=782f78a8-d031-49ee-a123-25fef3f8c271,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap782f78a8-d0') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap782f78a8-d0, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap782f78a8-d0, col_values=(('external_ids', {'iface-id': '782f78a8-d031-49ee-a123-25fef3f8c271', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:ca:b6', 'vm-uuid': 'ba412bc8-d47a-4f9f-a22b-4f2adf6df01a'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:53 user nova-compute[72874]: INFO os_vif [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=782f78a8-d031-49ee-a123-25fef3f8c271,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap782f78a8-d0')
Aug 17 19:05:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:05:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] No VIF found with MAC fa:16:3e:e0:ca:b6, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:05:54 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:05:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-a6bb6e41-a367-47a0-b6e2-1449d31993e9 req-6f2b3bd3-9031-4e5a-b479-ffa5bd5e215d service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Received event network-vif-plugged-782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:05:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a6bb6e41-a367-47a0-b6e2-1449d31993e9 req-6f2b3bd3-9031-4e5a-b479-ffa5bd5e215d service nova] Acquiring lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:05:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a6bb6e41-a367-47a0-b6e2-1449d31993e9 req-6f2b3bd3-9031-4e5a-b479-ffa5bd5e215d service nova] Lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:05:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-a6bb6e41-a367-47a0-b6e2-1449d31993e9 req-6f2b3bd3-9031-4e5a-b479-ffa5bd5e215d service nova] Lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:05:54 user nova-compute[72874]: DEBUG nova.compute.manager [req-a6bb6e41-a367-47a0-b6e2-1449d31993e9 req-6f2b3bd3-9031-4e5a-b479-ffa5bd5e215d service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] No waiting events found dispatching network-vif-plugged-782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:05:54 user nova-compute[72874]: WARNING nova.compute.manager [req-a6bb6e41-a367-47a0-b6e2-1449d31993e9 req-6f2b3bd3-9031-4e5a-b479-ffa5bd5e215d service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Received unexpected event network-vif-plugged-782f78a8-d031-49ee-a123-25fef3f8c271 for instance with vm_state building and task_state spawning.
Aug 17 19:05:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692299156.793777, ba412bc8-d47a-4f9f-a22b-4f2adf6df01a => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:05:56 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] VM Resumed (Lifecycle Event)
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:05:56 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Instance spawned successfully.
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:05:56 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692299156.7951152, ba412bc8-d47a-4f9f-a22b-4f2adf6df01a => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:05:56 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] VM Started (Lifecycle Event)
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:05:56 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:05:56 user nova-compute[72874]: INFO nova.compute.manager [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Took 4.89 seconds to spawn the instance on the hypervisor.
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.compute.manager [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-b9578496-6818-468e-a5f9-4afdba816e0f req-04071f83-d7e0-4331-a4b9-0f048f2e289a service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Received event network-vif-plugged-782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b9578496-6818-468e-a5f9-4afdba816e0f req-04071f83-d7e0-4331-a4b9-0f048f2e289a service nova] Acquiring lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b9578496-6818-468e-a5f9-4afdba816e0f req-04071f83-d7e0-4331-a4b9-0f048f2e289a service nova] Lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b9578496-6818-468e-a5f9-4afdba816e0f req-04071f83-d7e0-4331-a4b9-0f048f2e289a service nova] Lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:05:56 user nova-compute[72874]: DEBUG nova.compute.manager [req-b9578496-6818-468e-a5f9-4afdba816e0f req-04071f83-d7e0-4331-a4b9-0f048f2e289a service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] No waiting events found dispatching network-vif-plugged-782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:05:56 user nova-compute[72874]: WARNING nova.compute.manager [req-b9578496-6818-468e-a5f9-4afdba816e0f req-04071f83-d7e0-4331-a4b9-0f048f2e289a service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Received unexpected event network-vif-plugged-782f78a8-d031-49ee-a123-25fef3f8c271 for instance with vm_state building and task_state spawning.
Aug 17 19:05:56 user nova-compute[72874]: INFO nova.compute.manager [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Took 16.38 seconds to build instance.
Aug 17 19:05:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-09fc43cf-67b9-48bb-a3df-4167293de714 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.488s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:05:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:06:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:06:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-53ba195b-f1b7-4fc9-a311-7a9904625c13" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:06:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-53ba195b-f1b7-4fc9-a311-7a9904625c13" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:06:00 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:06:00 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Updating instance_info_cache with network_info: [{"id": "1a6780af-7892-4d7b-a872-bc5f44813708", "address": "fa:16:3e:86:e9:b2", "network": {"id": "4f400bf7-2de4-4236-b43f-9e23dcd6691f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f12da590ccfd4c61b5cb087b3fc22de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a6780af-78", "ovs_interfaceid": "1a6780af-7892-4d7b-a872-bc5f44813708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:06:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-53ba195b-f1b7-4fc9-a311-7a9904625c13" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:06:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:06:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:02 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:06:02 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:06:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:06:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:06:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:06:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:06:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:06:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:06:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Acquiring lock "53ba195b-f1b7-4fc9-a311-7a9904625c13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:06:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:06:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Acquiring lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:06:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:06:26 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:06:26 user nova-compute[72874]: INFO nova.compute.manager [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Terminating instance
Aug 17 19:06:26 user nova-compute[72874]: DEBUG nova.compute.manager [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 19:06:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-16d57aa7-8890-4763-8bdb-37740fbbd888 req-6769950a-3e3b-43f8-a45a-03c5f894c5bb service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received event network-vif-unplugged-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-16d57aa7-8890-4763-8bdb-37740fbbd888 req-6769950a-3e3b-43f8-a45a-03c5f894c5bb service nova] Acquiring lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-16d57aa7-8890-4763-8bdb-37740fbbd888 req-6769950a-3e3b-43f8-a45a-03c5f894c5bb service nova] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-16d57aa7-8890-4763-8bdb-37740fbbd888 req-6769950a-3e3b-43f8-a45a-03c5f894c5bb service nova] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-16d57aa7-8890-4763-8bdb-37740fbbd888 req-6769950a-3e3b-43f8-a45a-03c5f894c5bb service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] No waiting events found dispatching network-vif-unplugged-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG nova.compute.manager [req-16d57aa7-8890-4763-8bdb-37740fbbd888 req-6769950a-3e3b-43f8-a45a-03c5f894c5bb service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received event network-vif-unplugged-1a6780af-7892-4d7b-a872-bc5f44813708 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:27 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Instance destroyed successfully.
Aug 17 19:06:27 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lazy-loading 'resources' on Instance uuid 53ba195b-f1b7-4fc9-a311-7a9904625c13 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:04:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-584981869',display_name='tempest-VolumesNegativeTest-instance-584981869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-584981869',id=50,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:04:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8aef2f77b6b4e948613363a0cc93e13',ramdisk_id='',reservation_id='r-yqiaeee0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1556700090',owner_user_name='tempest-VolumesNegativeTest-1556700090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:04:43Z,user_data=None,user_id='ded5de4639544869b28ff88efed82d84',uuid=53ba195b-f1b7-4fc9-a311-7a9904625c13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a6780af-7892-4d7b-a872-bc5f44813708", "address": "fa:16:3e:86:e9:b2", "network": {"id": "4f400bf7-2de4-4236-b43f-9e23dcd6691f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f12da590ccfd4c61b5cb087b3fc22de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a6780af-78", "ovs_interfaceid": "1a6780af-7892-4d7b-a872-bc5f44813708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Converting VIF {"id": "1a6780af-7892-4d7b-a872-bc5f44813708", "address": "fa:16:3e:86:e9:b2", "network": {"id": "4f400bf7-2de4-4236-b43f-9e23dcd6691f", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.244", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f12da590ccfd4c61b5cb087b3fc22de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a6780af-78", "ovs_interfaceid": "1a6780af-7892-4d7b-a872-bc5f44813708", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:e9:b2,bridge_name='br-int',has_traffic_filtering=True,id=1a6780af-7892-4d7b-a872-bc5f44813708,network=Network(4f400bf7-2de4-4236-b43f-9e23dcd6691f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a6780af-78') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG os_vif [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:e9:b2,bridge_name='br-int',has_traffic_filtering=True,id=1a6780af-7892-4d7b-a872-bc5f44813708,network=Network(4f400bf7-2de4-4236-b43f-9e23dcd6691f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a6780af-78') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a6780af-78, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:06:27 user nova-compute[72874]: INFO os_vif [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:e9:b2,bridge_name='br-int',has_traffic_filtering=True,id=1a6780af-7892-4d7b-a872-bc5f44813708,network=Network(4f400bf7-2de4-4236-b43f-9e23dcd6691f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a6780af-78')
Aug 17 19:06:27 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Deleting instance files /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13_del
Aug 17 19:06:27 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Deletion of /opt/stack/data/nova/instances/53ba195b-f1b7-4fc9-a311-7a9904625c13_del complete
Aug 17 19:06:27 user nova-compute[72874]: INFO nova.compute.manager [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 17 19:06:27 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 19:06:27 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 19:06:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:28 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:06:28 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Took 0.63 seconds to deallocate network for instance.
Aug 17 19:06:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:06:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:06:28 user nova-compute[72874]: DEBUG nova.compute.manager [req-aeab9a16-0120-4625-b2d9-713ee0d97e1d req-815e5b26-7e88-4462-839b-d3d93a9f84b8 service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received event network-vif-deleted-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:06:28 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:06:28 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:06:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:06:28 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Deleted allocations for instance 53ba195b-f1b7-4fc9-a311-7a9904625c13
Aug 17 19:06:28 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b12ab92d-c64c-48f8-b4da-ee0257c86180 tempest-VolumesNegativeTest-1556700090 tempest-VolumesNegativeTest-1556700090-project-member] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.897s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received event network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] Acquiring lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] No waiting events found dispatching network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:06:29 user nova-compute[72874]: WARNING nova.compute.manager [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received unexpected event network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 for instance with vm_state deleted and task_state None.
Aug 17 19:06:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received event network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] Acquiring lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] No waiting events found dispatching network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:06:29 user nova-compute[72874]: WARNING nova.compute.manager [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received unexpected event network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 for instance with vm_state deleted and task_state None.
Aug 17 19:06:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received event network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] Acquiring lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] No waiting events found dispatching network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:06:29 user nova-compute[72874]: WARNING nova.compute.manager [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received unexpected event network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 for instance with vm_state deleted and task_state None.
Aug 17 19:06:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received event network-vif-unplugged-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] Acquiring lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] No waiting events found dispatching network-vif-unplugged-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:06:29 user nova-compute[72874]: WARNING nova.compute.manager [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received unexpected event network-vif-unplugged-1a6780af-7892-4d7b-a872-bc5f44813708 for instance with vm_state deleted and task_state None.
Aug 17 19:06:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received event network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] Acquiring lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] Lock "53ba195b-f1b7-4fc9-a311-7a9904625c13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:06:29 user nova-compute[72874]: DEBUG nova.compute.manager [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] No waiting events found dispatching network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:06:29 user nova-compute[72874]: WARNING nova.compute.manager [req-5f2c4295-32fd-4f09-b317-0a4e7a8ebeec req-9607bb86-d56a-49e6-9cff-8df035ef03f5 service nova] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Received unexpected event network-vif-plugged-1a6780af-7892-4d7b-a872-bc5f44813708 for instance with vm_state deleted and task_state None.
Aug 17 19:06:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:06:42 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692299187.5871396, 53ba195b-f1b7-4fc9-a311-7a9904625c13 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:06:42 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] VM Stopped (Lifecycle Event)
Aug 17 19:06:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-6344ad21-4abc-4696-a705-de0895f16aca None None] [instance: 53ba195b-f1b7-4fc9-a311-7a9904625c13] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:06:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:06:47 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:06:51 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:06:51 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:06:51 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8674MB free_disk=25.17296600341797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 5e41f20d-6d1a-4289-b7e5-53959a7c66b7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance ba412bc8-d47a-4f9f-a22b-4f2adf6df01a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:06:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:06:52 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:06:53 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:06:56 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:06:56 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:06:56 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:06:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:07:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:07:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:07:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:07:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:07:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:07:00 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:07:00 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid 5e41f20d-6d1a-4289-b7e5-53959a7c66b7 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:07:00 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Updating instance_info_cache with network_info: [{"id": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "address": "fa:16:3e:3b:93:c7", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32008c-39", "ovs_interfaceid": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:07:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:07:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:07:02 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:07:04 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:07:04 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:07:07 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:07:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:07:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:07:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:07:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:07:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:07:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:07:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:07:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:07:12 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:07:17 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:07:22 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:07:27 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:07:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:07:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:07:32 user nova-compute[72874]: DEBUG nova.compute.manager [req-e409ba14-2437-49df-94e3-8ace36f41c56 req-c00cfbb8-a2eb-4c7e-91b1-4ff5b5c331d7 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Received event network-changed-782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:07:32 user nova-compute[72874]: DEBUG nova.compute.manager [req-e409ba14-2437-49df-94e3-8ace36f41c56 req-c00cfbb8-a2eb-4c7e-91b1-4ff5b5c331d7 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Refreshing instance network info cache due to event network-changed-782f78a8-d031-49ee-a123-25fef3f8c271. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:07:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e409ba14-2437-49df-94e3-8ace36f41c56 req-c00cfbb8-a2eb-4c7e-91b1-4ff5b5c331d7 service nova] Acquiring lock "refresh_cache-ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:07:32 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e409ba14-2437-49df-94e3-8ace36f41c56 req-c00cfbb8-a2eb-4c7e-91b1-4ff5b5c331d7 service nova] Acquired lock "refresh_cache-ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:07:32 user nova-compute[72874]: DEBUG nova.network.neutron [req-e409ba14-2437-49df-94e3-8ace36f41c56 req-c00cfbb8-a2eb-4c7e-91b1-4ff5b5c331d7 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Refreshing network info cache for port 782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:07:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-2e8f94e9-42c7-4f43-a99c-dc48f87ca475 req-98b6ee2a-c082-4342-8d2d-fcfa49c2c200 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Received event network-changed-782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:07:33 user nova-compute[72874]: DEBUG nova.compute.manager [req-2e8f94e9-42c7-4f43-a99c-dc48f87ca475 req-98b6ee2a-c082-4342-8d2d-fcfa49c2c200 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Refreshing instance network info cache due to event network-changed-782f78a8-d031-49ee-a123-25fef3f8c271. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:07:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2e8f94e9-42c7-4f43-a99c-dc48f87ca475 req-98b6ee2a-c082-4342-8d2d-fcfa49c2c200 service nova] Acquiring lock "refresh_cache-ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:07:33 user nova-compute[72874]: DEBUG nova.network.neutron [req-e409ba14-2437-49df-94e3-8ace36f41c56 req-c00cfbb8-a2eb-4c7e-91b1-4ff5b5c331d7 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Updated VIF entry in instance network info cache for port 782f78a8-d031-49ee-a123-25fef3f8c271. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:07:33 user nova-compute[72874]: DEBUG nova.network.neutron [req-e409ba14-2437-49df-94e3-8ace36f41c56 req-c00cfbb8-a2eb-4c7e-91b1-4ff5b5c331d7 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Updating instance_info_cache with network_info: [{"id": "782f78a8-d031-49ee-a123-25fef3f8c271", "address": "fa:16:3e:e0:ca:b6", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782f78a8-d0", "ovs_interfaceid": "782f78a8-d031-49ee-a123-25fef3f8c271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:07:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:07:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:07:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:07:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:07:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:07:33 user nova-compute[72874]: INFO nova.compute.manager [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Terminating instance
Aug 17 19:07:33 user nova-compute[72874]: DEBUG nova.compute.manager [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 19:07:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-e409ba14-2437-49df-94e3-8ace36f41c56 req-c00cfbb8-a2eb-4c7e-91b1-4ff5b5c331d7 service nova] Releasing lock "refresh_cache-ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:07:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2e8f94e9-42c7-4f43-a99c-dc48f87ca475 req-98b6ee2a-c082-4342-8d2d-fcfa49c2c200 service nova] Acquired lock "refresh_cache-ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:07:33 user nova-compute[72874]: DEBUG nova.network.neutron [req-2e8f94e9-42c7-4f43-a99c-dc48f87ca475 req-98b6ee2a-c082-4342-8d2d-fcfa49c2c200 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Refreshing network info cache for port 782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:07:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:07:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG nova.network.neutron [req-2e8f94e9-42c7-4f43-a99c-dc48f87ca475 req-98b6ee2a-c082-4342-8d2d-fcfa49c2c200 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Updated VIF entry in instance network info cache for port 782f78a8-d031-49ee-a123-25fef3f8c271. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG nova.network.neutron [req-2e8f94e9-42c7-4f43-a99c-dc48f87ca475 req-98b6ee2a-c082-4342-8d2d-fcfa49c2c200 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Updating instance_info_cache with network_info: [{"id": "782f78a8-d031-49ee-a123-25fef3f8c271", "address": "fa:16:3e:e0:ca:b6", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782f78a8-d0", "ovs_interfaceid": "782f78a8-d031-49ee-a123-25fef3f8c271", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-2e8f94e9-42c7-4f43-a99c-dc48f87ca475 req-98b6ee2a-c082-4342-8d2d-fcfa49c2c200 service nova] Releasing lock "refresh_cache-ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:07:34 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Instance destroyed successfully.
Aug 17 19:07:34 user nova-compute[72874]: DEBUG nova.objects.instance [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lazy-loading 'resources' on Instance uuid ba412bc8-d47a-4f9f-a22b-4f2adf6df01a {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:05:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-335904975',display_name='tempest-TestVolumeBootPattern-server-335904975',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-335904975',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD0QND9oDqLOeCRGJTfBiqvc9k5nhifesJCblmsatayQ+aHww3+pEyx5G901afugjNrgFeSIRDCLDmSzdlvHF+9raZzw2NgQ/zaMgW0gnu4EPfQxjC8TOHunbpuo/Q4aQ==',key_name='tempest-TestVolumeBootPattern-1498174102',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:05:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-yo4zkxvl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:05:57Z,user_data=None,user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=ba412bc8-d47a-4f9f-a22b-4f2adf6df01a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "782f78a8-d031-49ee-a123-25fef3f8c271", "address": "fa:16:3e:e0:ca:b6", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782f78a8-d0", "ovs_interfaceid": "782f78a8-d031-49ee-a123-25fef3f8c271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "782f78a8-d031-49ee-a123-25fef3f8c271", "address": "fa:16:3e:e0:ca:b6", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap782f78a8-d0", "ovs_interfaceid": "782f78a8-d031-49ee-a123-25fef3f8c271", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=782f78a8-d031-49ee-a123-25fef3f8c271,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap782f78a8-d0') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_vif [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=782f78a8-d031-49ee-a123-25fef3f8c271,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap782f78a8-d0') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap782f78a8-d0, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:07:34 user nova-compute[72874]: INFO os_vif [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:ca:b6,bridge_name='br-int',has_traffic_filtering=True,id=782f78a8-d031-49ee-a123-25fef3f8c271,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap782f78a8-d0')
Aug 17 19:07:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'woEQKrUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:07:34 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b01541-495c-45e0-9d2a-e7b4ffe66440]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[228898ed-f4ba-4c15-936e-ca2b87cc136e]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)
Aug 17 19:07:34 user nova-compute[72874]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 (non-flash)
Aug 17 19:07:34 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)
Aug 17 19:07:34 user nova-compute[72874]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 (non-flash)
Aug 17 19:07:34 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a051e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556'): ({'sdc'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Removing single pathed devices sdc {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2670cba6-a1a7-40a6-a6d4-7ba0388885fc]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aea7c9-1d96-4568-9af4-081fab000016]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flushing IO for device /dev/sdc {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebf2cd4-46aa-43b3-89b2-3d58314bb4cd]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5587507b-7666-4197-9ab4-387e613e4f0b]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] SCSI volumes sdc have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff2ecd9-e768-46de-af06-08e623e5d6aa]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-ef64ac66-e647-4859-80cf-9afb50a2024d req-69c3f94a-a148-45c2-8825-3794e15f2171 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Received event network-vif-unplugged-782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ef64ac66-e647-4859-80cf-9afb50a2024d req-69c3f94a-a148-45c2-8825-3794e15f2171 service nova] Acquiring lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ef64ac66-e647-4859-80cf-9afb50a2024d req-69c3f94a-a148-45c2-8825-3794e15f2171 service nova] Lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ef64ac66-e647-4859-80cf-9afb50a2024d req-69c3f94a-a148-45c2-8825-3794e15f2171 service nova] Lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-ef64ac66-e647-4859-80cf-9afb50a2024d req-69c3f94a-a148-45c2-8825-3794e15f2171 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] No waiting events found dispatching network-vif-unplugged-782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-ef64ac66-e647-4859-80cf-9afb50a2024d req-69c3f94a-a148-45c2-8825-3794e15f2171 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Received event network-vif-unplugged-782f78a8-d031-49ee-a123-25fef3f8c271 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-ef64ac66-e647-4859-80cf-9afb50a2024d req-69c3f94a-a148-45c2-8825-3794e15f2171 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Received event network-vif-plugged-782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ef64ac66-e647-4859-80cf-9afb50a2024d req-69c3f94a-a148-45c2-8825-3794e15f2171 service nova] Acquiring lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ef64ac66-e647-4859-80cf-9afb50a2024d req-69c3f94a-a148-45c2-8825-3794e15f2171 service nova] Lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-ef64ac66-e647-4859-80cf-9afb50a2024d req-69c3f94a-a148-45c2-8825-3794e15f2171 service nova] Lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG nova.compute.manager [req-ef64ac66-e647-4859-80cf-9afb50a2024d req-69c3f94a-a148-45c2-8825-3794e15f2171 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] No waiting events found dispatching network-vif-plugged-782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:07:34 user nova-compute[72874]: WARNING nova.compute.manager [req-ef64ac66-e647-4859-80cf-9afb50a2024d req-69c3f94a-a148-45c2-8825-3794e15f2171 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Received unexpected event network-vif-plugged-782f78a8-d031-49ee-a123-25fef3f8c271 for instance with vm_state active and task_state deleting.
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[debf19a0-f7b4-4160-8e88-2f908a7ac858]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556, portal: 172.16.0.220,3260]
Aug 17 19:07:34 user nova-compute[72874]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556, portal: 172.16.0.220,3260] successful.
Aug 17 19:07:34 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ababd96d-9108-486e-9119-25655f49d556 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bbe4c45-141d-4b51-a815-5146d0bba4b7]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== disconnect_volume: return (310ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:07:34 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Deleting instance files /opt/stack/data/nova/instances/ba412bc8-d47a-4f9f-a22b-4f2adf6df01a_del
Aug 17 19:07:34 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Deletion of /opt/stack/data/nova/instances/ba412bc8-d47a-4f9f-a22b-4f2adf6df01a_del complete
Aug 17 19:07:34 user nova-compute[72874]: INFO nova.compute.manager [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 17 19:07:34 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 19:07:34 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 19:07:35 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:07:35 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Took 0.71 seconds to deallocate network for instance.
Aug 17 19:07:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-b3a7537d-3577-4e89-bb3c-d76210001c06 req-fd825729-d4d7-40f3-aa73-6045dcd94855 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Received event network-vif-deleted-782f78a8-d031-49ee-a123-25fef3f8c271 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:07:35 user nova-compute[72874]: INFO nova.compute.manager [req-b3a7537d-3577-4e89-bb3c-d76210001c06 req-fd825729-d4d7-40f3-aa73-6045dcd94855 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Neutron deleted interface 782f78a8-d031-49ee-a123-25fef3f8c271; detaching it from the instance and deleting it from the info cache
Aug 17 19:07:35 user nova-compute[72874]: DEBUG nova.network.neutron [req-b3a7537d-3577-4e89-bb3c-d76210001c06 req-fd825729-d4d7-40f3-aa73-6045dcd94855 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:07:35 user nova-compute[72874]: DEBUG nova.compute.manager [req-b3a7537d-3577-4e89-bb3c-d76210001c06 req-fd825729-d4d7-40f3-aa73-6045dcd94855 service nova] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Detach interface failed, port_id=782f78a8-d031-49ee-a123-25fef3f8c271, reason: Instance ba412bc8-d47a-4f9f-a22b-4f2adf6df01a could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 19:07:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:07:36 user nova-compute[72874]: INFO nova.compute.manager [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Took 1.02 seconds to detach 1 volumes for instance.
Aug 17 19:07:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:07:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:07:36 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:07:36 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:07:36 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:07:36 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Deleted allocations for instance ba412bc8-d47a-4f9f-a22b-4f2adf6df01a
Aug 17 19:07:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-7ae2fdc7-5d2a-4f2e-b20d-46d174ed785c tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "ba412bc8-d47a-4f9f-a22b-4f2adf6df01a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.309s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:07:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:07:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:07:49 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692299254.457766, ba412bc8-d47a-4f9f-a22b-4f2adf6df01a => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:07:49 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] VM Stopped (Lifecycle Event)
Aug 17 19:07:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-0e8dab38-481c-412a-bf4b-aae05389caf9 None None] [instance: ba412bc8-d47a-4f9f-a22b-4f2adf6df01a] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:07:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:07:52 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:07:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:07:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:07:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:07:52 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:07:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72874) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 19:07:52 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:07:52 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:07:52 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8754MB free_disk=25.17090606689453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:07:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:07:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:07:52 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance 5e41f20d-6d1a-4289-b7e5-53959a7c66b7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:07:52 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:07:52 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:07:52 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:07:52 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:07:52 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:07:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:07:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:07:55 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:07:57 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:07:58 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:07:58 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:07:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:08:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:08:00 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Didn't find any instances for network info cache update. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 19:08:04 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:08:04 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:08:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:08:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:08:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:08:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:08:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 19:08:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:08:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:08:25 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:08:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 19:08:25 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] There are 0 instances to clean {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 19:08:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-357ff7fe-9521-4eeb-a725-567b1bf19e29 req-2bd578f1-e698-4fd2-bc5f-f1bb08905b0b service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Received event network-changed-fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:08:37 user nova-compute[72874]: DEBUG nova.compute.manager [req-357ff7fe-9521-4eeb-a725-567b1bf19e29 req-2bd578f1-e698-4fd2-bc5f-f1bb08905b0b service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Refreshing instance network info cache due to event network-changed-fd32008c-39d7-48e7-bc46-0a48df1c0b9f. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:08:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-357ff7fe-9521-4eeb-a725-567b1bf19e29 req-2bd578f1-e698-4fd2-bc5f-f1bb08905b0b service nova] Acquiring lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:08:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-357ff7fe-9521-4eeb-a725-567b1bf19e29 req-2bd578f1-e698-4fd2-bc5f-f1bb08905b0b service nova] Acquired lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:08:37 user nova-compute[72874]: DEBUG nova.network.neutron [req-357ff7fe-9521-4eeb-a725-567b1bf19e29 req-2bd578f1-e698-4fd2-bc5f-f1bb08905b0b service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Refreshing network info cache for port fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:08:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:08:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:08:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:08:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:08:37 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:08:37 user nova-compute[72874]: INFO nova.compute.manager [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Terminating instance
Aug 17 19:08:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 19:08:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:37 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG nova.network.neutron [req-357ff7fe-9521-4eeb-a725-567b1bf19e29 req-2bd578f1-e698-4fd2-bc5f-f1bb08905b0b service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Updated VIF entry in instance network info cache for port fd32008c-39d7-48e7-bc46-0a48df1c0b9f. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG nova.network.neutron [req-357ff7fe-9521-4eeb-a725-567b1bf19e29 req-2bd578f1-e698-4fd2-bc5f-f1bb08905b0b service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Updating instance_info_cache with network_info: [{"id": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "address": "fa:16:3e:3b:93:c7", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32008c-39", "ovs_interfaceid": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:08:38 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Instance destroyed successfully.
Aug 17 19:08:38 user nova-compute[72874]: DEBUG nova.objects.instance [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lazy-loading 'resources' on Instance uuid 5e41f20d-6d1a-4289-b7e5-53959a7c66b7 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-357ff7fe-9521-4eeb-a725-567b1bf19e29 req-2bd578f1-e698-4fd2-bc5f-f1bb08905b0b service nova] Releasing lock "refresh_cache-5e41f20d-6d1a-4289-b7e5-53959a7c66b7" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:03:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1595057449',display_name='tempest-TestVolumeBootPattern-server-1595057449',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1595057449',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPD0QND9oDqLOeCRGJTfBiqvc9k5nhifesJCblmsatayQ+aHww3+pEyx5G901afugjNrgFeSIRDCLDmSzdlvHF+9raZzw2NgQ/zaMgW0gnu4EPfQxjC8TOHunbpuo/Q4aQ==',key_name='tempest-TestVolumeBootPattern-1498174102',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:03:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f41b302a39da4ab18c463789f2a73dd5',ramdisk_id='',reservation_id='r-0tz1hraw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-414332602',owner_user_name='tempest-TestVolumeBootPattern-414332602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:03:50Z,user_data=None,user_id='73cdc5d076a14395ad1958394f0c48e4',uuid=5e41f20d-6d1a-4289-b7e5-53959a7c66b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "address": "fa:16:3e:3b:93:c7", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32008c-39", "ovs_interfaceid": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converting VIF {"id": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "address": "fa:16:3e:3b:93:c7", "network": {"id": "5756e355-4056-4ae1-bd67-8d2e995b8427", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-813407930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f41b302a39da4ab18c463789f2a73dd5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd32008c-39", "ovs_interfaceid": "fd32008c-39d7-48e7-bc46-0a48df1c0b9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:93:c7,bridge_name='br-int',has_traffic_filtering=True,id=fd32008c-39d7-48e7-bc46-0a48df1c0b9f,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd32008c-39') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_vif [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:93:c7,bridge_name='br-int',has_traffic_filtering=True,id=fd32008c-39d7-48e7-bc46-0a48df1c0b9f,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd32008c-39') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd32008c-39, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:08:38 user nova-compute[72874]: INFO os_vif [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:93:c7,bridge_name='br-int',has_traffic_filtering=True,id=fd32008c-39d7-48e7-bc46-0a48df1c0b9f,network=Network(5756e355-4056-4ae1-bd67-8d2e995b8427),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd32008c-39')
Aug 17 19:08:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SfazCiOT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:08:38 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcd1e29-9db1-45cc-8c41-0eba5be35492]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec0957b-48f9-4dad-a8c2-d6826acb8bc7]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)
Aug 17 19:08:38 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 (non-flash)
Aug 17 19:08:38 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a059ed40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdacd42-0bea-4f75-b684-461ba22735b5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e1dd40-5d86-441c-8c87-84f3a469a761]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[029a1f8a-8dca-40ac-a389-c04b22b56ff2]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2387f4c3-78bd-48cb-b06d-1d336ce4bc19]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOb0275f50-7cb48c01c99911c5', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b0275f50', '/dev/disk/by-id/scsi-23763623438633031') {{(pid=83588) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a69f362-33eb-4ae1-8843-4206e70596f9]: (4, None) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba5d6ae-a1ea-48bd-90e7-f75eb89bbb32]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8365fc6-57bb-4d1c-a2b9-3bd8348dc539]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6, portal: 172.16.0.220,3260]
Aug 17 19:08:38 user nova-compute[72874]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6, portal: 172.16.0.220,3260] successful.
Aug 17 19:08:38 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2116ded6-64a3-45e1-8352-b6f6fd268fb6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e623620d-8a6a-4da1-bf93-2cb68ee1b9fe]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] <== disconnect_volume: return (284ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:08:38 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:08:38 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Deleting instance files /opt/stack/data/nova/instances/5e41f20d-6d1a-4289-b7e5-53959a7c66b7_del
Aug 17 19:08:38 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Deletion of /opt/stack/data/nova/instances/5e41f20d-6d1a-4289-b7e5-53959a7c66b7_del complete
Aug 17 19:08:39 user nova-compute[72874]: INFO nova.compute.manager [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Took 1.16 seconds to destroy the instance on the hypervisor.
Aug 17 19:08:39 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 19:08:39 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 19:08:39 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 19:08:39 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:08:39 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Took 0.54 seconds to deallocate network for instance.
Aug 17 19:08:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-6607abd8-7c17-469e-9958-4156217e0c96 req-4b1f0ad0-c36a-4159-9c51-9820b199216f service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Received event network-vif-deleted-fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:08:39 user nova-compute[72874]: INFO nova.compute.manager [req-6607abd8-7c17-469e-9958-4156217e0c96 req-4b1f0ad0-c36a-4159-9c51-9820b199216f service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Neutron deleted interface fd32008c-39d7-48e7-bc46-0a48df1c0b9f; detaching it from the instance and deleting it from the info cache
Aug 17 19:08:39 user nova-compute[72874]: DEBUG nova.network.neutron [req-6607abd8-7c17-469e-9958-4156217e0c96 req-4b1f0ad0-c36a-4159-9c51-9820b199216f service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:08:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-6607abd8-7c17-469e-9958-4156217e0c96 req-4b1f0ad0-c36a-4159-9c51-9820b199216f service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Detach interface failed, port_id=fd32008c-39d7-48e7-bc46-0a48df1c0b9f, reason: Instance 5e41f20d-6d1a-4289-b7e5-53959a7c66b7 could not be found. {{(pid=72874) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 19:08:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-b8677cba-27e8-464c-9cf9-9fe351710f3f req-aa3cf1fb-bb6b-448d-86d5-8581899157d9 service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Received event network-vif-unplugged-fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:08:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b8677cba-27e8-464c-9cf9-9fe351710f3f req-aa3cf1fb-bb6b-448d-86d5-8581899157d9 service nova] Acquiring lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:08:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b8677cba-27e8-464c-9cf9-9fe351710f3f req-aa3cf1fb-bb6b-448d-86d5-8581899157d9 service nova] Lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:08:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b8677cba-27e8-464c-9cf9-9fe351710f3f req-aa3cf1fb-bb6b-448d-86d5-8581899157d9 service nova] Lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:08:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-b8677cba-27e8-464c-9cf9-9fe351710f3f req-aa3cf1fb-bb6b-448d-86d5-8581899157d9 service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] No waiting events found dispatching network-vif-unplugged-fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:08:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-b8677cba-27e8-464c-9cf9-9fe351710f3f req-aa3cf1fb-bb6b-448d-86d5-8581899157d9 service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Received event network-vif-unplugged-fd32008c-39d7-48e7-bc46-0a48df1c0b9f for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 19:08:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-b8677cba-27e8-464c-9cf9-9fe351710f3f req-aa3cf1fb-bb6b-448d-86d5-8581899157d9 service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Received event network-vif-plugged-fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:08:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b8677cba-27e8-464c-9cf9-9fe351710f3f req-aa3cf1fb-bb6b-448d-86d5-8581899157d9 service nova] Acquiring lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:08:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b8677cba-27e8-464c-9cf9-9fe351710f3f req-aa3cf1fb-bb6b-448d-86d5-8581899157d9 service nova] Lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:08:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-b8677cba-27e8-464c-9cf9-9fe351710f3f req-aa3cf1fb-bb6b-448d-86d5-8581899157d9 service nova] Lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:08:39 user nova-compute[72874]: DEBUG nova.compute.manager [req-b8677cba-27e8-464c-9cf9-9fe351710f3f req-aa3cf1fb-bb6b-448d-86d5-8581899157d9 service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] No waiting events found dispatching network-vif-plugged-fd32008c-39d7-48e7-bc46-0a48df1c0b9f {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:08:39 user nova-compute[72874]: WARNING nova.compute.manager [req-b8677cba-27e8-464c-9cf9-9fe351710f3f req-aa3cf1fb-bb6b-448d-86d5-8581899157d9 service nova] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Received unexpected event network-vif-plugged-fd32008c-39d7-48e7-bc46-0a48df1c0b9f for instance with vm_state active and task_state deleting.
Aug 17 19:08:40 user nova-compute[72874]: INFO nova.compute.manager [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Took 0.74 seconds to detach 1 volumes for instance.
Aug 17 19:08:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:08:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:08:40 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:08:40 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:08:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:08:40 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Deleted allocations for instance 5e41f20d-6d1a-4289-b7e5-53959a7c66b7
Aug 17 19:08:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-0d60f2b1-9ea2-4465-9ff0-7b48b7433663 tempest-TestVolumeBootPattern-414332602 tempest-TestVolumeBootPattern-414332602-project-member] Lock "5e41f20d-6d1a-4289-b7e5-53959a7c66b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.760s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:08:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:08:53 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:08:53 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:08:53 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8932MB free_disk=25.16958236694336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692299318.6529865, 5e41f20d-6d1a-4289-b7e5-53959a7c66b7 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:08:53 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] VM Stopped (Lifecycle Event)
Aug 17 19:08:53 user nova-compute[72874]: DEBUG nova.compute.manager [None req-c129eff6-b910-4deb-bb40-9eafe59d0fac None None] [instance: 5e41f20d-6d1a-4289-b7e5-53959a7c66b7] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing inventories for resource provider b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Updating ProviderTree inventory for provider b677d836-b01b-4674-8972-53d526f1b5f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Updating inventory in ProviderTree for provider b677d836-b01b-4674-8972-53d526f1b5f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing aggregate associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, aggregates: None {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing trait associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, traits: HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:08:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:08:57 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:08:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:08:59 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:09:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:09:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:09:02 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:09:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:09:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:09:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Didn't find any instances for network info cache update. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 19:09:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:09:05 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:09:05 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:09:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:09:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:09:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:09:11 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:09:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:09:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:09:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:09:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:09:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:09:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:09:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:09:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:09:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:09:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:09:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:09:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:55 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:09:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:09:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:09:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:09:55 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:09:55 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:09:55 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:09:55 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8977MB free_disk=25.167652130126953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:09:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:09:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:09:55 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:09:55 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:09:55 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:09:55 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:09:55 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:09:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.128s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:09:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:57 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:09:59 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:09:59 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:10:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:10:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:10:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:10:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Starting instance... {{(pid=72874) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 19:10:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:10:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:10:01 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72874) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 19:10:01 user nova-compute[72874]: INFO nova.compute.claims [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Claim successful on node user
Aug 17 19:10:01 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:10:01 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:10:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.181s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:10:01 user nova-compute[72874]: DEBUG nova.compute.manager [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Start building networks asynchronously for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Allocating IP information in the background. {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG nova.network.neutron [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] allocate_for_instance() {{(pid=72874) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 19:10:02 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 19:10:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Start building block device mappings for instance. {{(pid=72874) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG nova.policy [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95f54d98e23549f2943a6c31422f8315', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7c248e6274f46ee864e316b195ab1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72874) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG nova.compute.manager [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Start spawning the instance on the hypervisor. {{(pid=72874) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Creating instance directory {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 19:10:02 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Creating image(s)
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "/opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "/opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "010be14c1b17d264a77a65496aad88ac8a54bb22" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.169s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk 1073741824 {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22,backing_fmt=raw /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk 1073741824" returned: 0 in 0.047s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "010be14c1b17d264a77a65496aad88ac8a54bb22" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG nova.network.neutron [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Successfully created port: 004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 {{(pid=72874) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/010be14c1b17d264a77a65496aad88ac8a54bb22 --force-share --output=json" returned: 0 in 0.219s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk. size=1073741824 {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG nova.virt.disk.api [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Cannot resize image /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk to a smaller size. {{(pid=72874) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG nova.objects.instance [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lazy-loading 'migration_context' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Created local disks {{(pid=72874) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Ensure instance console log exists: /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/console.log {{(pid=72874) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:10:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:10:03 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:10:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:10:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:10:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Skipping network cache update for instance because it is Building. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 19:10:03 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Didn't find any instances for network info cache update. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 19:10:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.network.neutron [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Successfully updated port: 004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 {{(pid=72874) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquired lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.network.neutron [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Building network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.compute.manager [req-464f6af1-d8a8-4904-a710-64975c8d840e req-854c170a-8357-4537-877f-941da537034f service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Received event network-changed-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.compute.manager [req-464f6af1-d8a8-4904-a710-64975c8d840e req-854c170a-8357-4537-877f-941da537034f service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Refreshing instance network info cache due to event network-changed-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-464f6af1-d8a8-4904-a710-64975c8d840e req-854c170a-8357-4537-877f-941da537034f service nova] Acquiring lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.network.neutron [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Instance cache missing network info. {{(pid=72874) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.network.neutron [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updating instance_info_cache with network_info: [{"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Releasing lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Instance network_info: |[{"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72874) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-464f6af1-d8a8-4904-a710-64975c8d840e req-854c170a-8357-4537-877f-941da537034f service nova] Acquired lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.network.neutron [req-464f6af1-d8a8-4904-a710-64975c8d840e req-854c170a-8357-4537-877f-941da537034f service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Refreshing network info cache for port 004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Start _get_guest_xml network_info=[{"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'guest_format': None, 'encryption_format': None, 'encryption_options': None, 'encryption_secret_uuid': None, 'size': 0, 'image_id': '7fe37517-c232-4d7a-939d-c3edde21bc31'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 19:10:04 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:10:04 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] CPU controller missing on host. {{(pid=72874) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.host [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] CPU controller found on host. {{(pid=72874) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72874) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T18:12:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T18:12:36Z,direct_url=<?>,disk_format='qcow2',id=7fe37517-c232-4d7a-939d-c3edde21bc31,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f12da590ccfd4c61b5cb087b3fc22de1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T18:12:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Flavor limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Image limits 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Flavor pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Image pref 0:0:0 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72874) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Got 1 possible topologies {{(pid=72874) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.hardware [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72874) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:10:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-591671340',display_name='tempest-SnapshotDataIntegrityTests-server-591671340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-591671340',id=52,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/p/5FDOcc+8jdtAmroH9xUpakWfv+xep87xpsse/3/M9GtOmpWUB+F7AiXgmGAikxp3ev1W+3GUtNiHnmCAXqHCFWpSgCHuKZw9PppMzOAm7jKxRoMJNdYsNsD500bAg==',key_name='tempest-keypair-128792530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7c248e6274f46ee864e316b195ab1aa',ramdisk_id='',reservation_id='r-mgo91u6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-655632535',owner_user_name='tempest-SnapshotDataIntegrityTests-655632535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:10:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95f54d98e23549f2943a6c31422f8315',uuid=cd58c38d-d2fb-4553-a920-ab80bc38c749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72874) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Converting VIF {"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7,network=Network(c24fcdda-c8de-4816-bc9d-5d582903473c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004c5cf6-8e') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.objects.instance [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lazy-loading 'pci_devices' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] End _get_guest_xml xml=<domain type="kvm">
Aug 17 19:10:04 user nova-compute[72874]:   <uuid>cd58c38d-d2fb-4553-a920-ab80bc38c749</uuid>
Aug 17 19:10:04 user nova-compute[72874]:   <name>instance-00000034</name>
Aug 17 19:10:04 user nova-compute[72874]:   <memory>524288</memory>
Aug 17 19:10:04 user nova-compute[72874]:   <vcpu>1</vcpu>
Aug 17 19:10:04 user nova-compute[72874]:   <metadata>
Aug 17 19:10:04 user nova-compute[72874]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 19:10:04 user nova-compute[72874]:       <nova:package version="0.0.0"/>
Aug 17 19:10:04 user nova-compute[72874]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-591671340</nova:name>
Aug 17 19:10:04 user nova-compute[72874]:       <nova:creationTime>2023-08-17 19:10:04</nova:creationTime>
Aug 17 19:10:04 user nova-compute[72874]:       <nova:flavor name="m1.tiny">
Aug 17 19:10:04 user nova-compute[72874]:         <nova:memory>512</nova:memory>
Aug 17 19:10:04 user nova-compute[72874]:         <nova:disk>1</nova:disk>
Aug 17 19:10:04 user nova-compute[72874]:         <nova:swap>0</nova:swap>
Aug 17 19:10:04 user nova-compute[72874]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 19:10:04 user nova-compute[72874]:         <nova:vcpus>1</nova:vcpus>
Aug 17 19:10:04 user nova-compute[72874]:       </nova:flavor>
Aug 17 19:10:04 user nova-compute[72874]:       <nova:owner>
Aug 17 19:10:04 user nova-compute[72874]:         <nova:user uuid="95f54d98e23549f2943a6c31422f8315">tempest-SnapshotDataIntegrityTests-655632535-project-member</nova:user>
Aug 17 19:10:04 user nova-compute[72874]:         <nova:project uuid="d7c248e6274f46ee864e316b195ab1aa">tempest-SnapshotDataIntegrityTests-655632535</nova:project>
Aug 17 19:10:04 user nova-compute[72874]:       </nova:owner>
Aug 17 19:10:04 user nova-compute[72874]:       <nova:root type="image" uuid="7fe37517-c232-4d7a-939d-c3edde21bc31"/>
Aug 17 19:10:04 user nova-compute[72874]:       <nova:ports>
Aug 17 19:10:04 user nova-compute[72874]:         <nova:port uuid="004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7">
Aug 17 19:10:04 user nova-compute[72874]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 19:10:04 user nova-compute[72874]:         </nova:port>
Aug 17 19:10:04 user nova-compute[72874]:       </nova:ports>
Aug 17 19:10:04 user nova-compute[72874]:     </nova:instance>
Aug 17 19:10:04 user nova-compute[72874]:   </metadata>
Aug 17 19:10:04 user nova-compute[72874]:   <sysinfo type="smbios">
Aug 17 19:10:04 user nova-compute[72874]:     <system>
Aug 17 19:10:04 user nova-compute[72874]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 19:10:04 user nova-compute[72874]:       <entry name="product">OpenStack Nova</entry>
Aug 17 19:10:04 user nova-compute[72874]:       <entry name="version">0.0.0</entry>
Aug 17 19:10:04 user nova-compute[72874]:       <entry name="serial">cd58c38d-d2fb-4553-a920-ab80bc38c749</entry>
Aug 17 19:10:04 user nova-compute[72874]:       <entry name="uuid">cd58c38d-d2fb-4553-a920-ab80bc38c749</entry>
Aug 17 19:10:04 user nova-compute[72874]:       <entry name="family">Virtual Machine</entry>
Aug 17 19:10:04 user nova-compute[72874]:     </system>
Aug 17 19:10:04 user nova-compute[72874]:   </sysinfo>
Aug 17 19:10:04 user nova-compute[72874]:   <os>
Aug 17 19:10:04 user nova-compute[72874]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 19:10:04 user nova-compute[72874]:     <boot dev="hd"/>
Aug 17 19:10:04 user nova-compute[72874]:     <smbios mode="sysinfo"/>
Aug 17 19:10:04 user nova-compute[72874]:   </os>
Aug 17 19:10:04 user nova-compute[72874]:   <features>
Aug 17 19:10:04 user nova-compute[72874]:     <acpi/>
Aug 17 19:10:04 user nova-compute[72874]:     <apic/>
Aug 17 19:10:04 user nova-compute[72874]:     <vmcoreinfo/>
Aug 17 19:10:04 user nova-compute[72874]:   </features>
Aug 17 19:10:04 user nova-compute[72874]:   <clock offset="utc">
Aug 17 19:10:04 user nova-compute[72874]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 19:10:04 user nova-compute[72874]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 19:10:04 user nova-compute[72874]:     <timer name="hpet" present="no"/>
Aug 17 19:10:04 user nova-compute[72874]:   </clock>
Aug 17 19:10:04 user nova-compute[72874]:   <cpu mode="custom" match="exact">
Aug 17 19:10:04 user nova-compute[72874]:     <model>Nehalem</model>
Aug 17 19:10:04 user nova-compute[72874]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 19:10:04 user nova-compute[72874]:   </cpu>
Aug 17 19:10:04 user nova-compute[72874]:   <devices>
Aug 17 19:10:04 user nova-compute[72874]:     <disk type="file" device="disk">
Aug 17 19:10:04 user nova-compute[72874]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 19:10:04 user nova-compute[72874]:       <source file="/opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk"/>
Aug 17 19:10:04 user nova-compute[72874]:       <target dev="vda" bus="virtio"/>
Aug 17 19:10:04 user nova-compute[72874]:     </disk>
Aug 17 19:10:04 user nova-compute[72874]:     <interface type="ethernet">
Aug 17 19:10:04 user nova-compute[72874]:       <mac address="fa:16:3e:d2:5a:4b"/>
Aug 17 19:10:04 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 19:10:04 user nova-compute[72874]:       <mtu size="1442"/>
Aug 17 19:10:04 user nova-compute[72874]:       <target dev="tap004c5cf6-8e"/>
Aug 17 19:10:04 user nova-compute[72874]:     </interface>
Aug 17 19:10:04 user nova-compute[72874]:     <serial type="pty">
Aug 17 19:10:04 user nova-compute[72874]:       <log file="/opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/console.log" append="off"/>
Aug 17 19:10:04 user nova-compute[72874]:     </serial>
Aug 17 19:10:04 user nova-compute[72874]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 19:10:04 user nova-compute[72874]:     <video>
Aug 17 19:10:04 user nova-compute[72874]:       <model type="virtio"/>
Aug 17 19:10:04 user nova-compute[72874]:     </video>
Aug 17 19:10:04 user nova-compute[72874]:     <rng model="virtio">
Aug 17 19:10:04 user nova-compute[72874]:       <backend model="random">/dev/urandom</backend>
Aug 17 19:10:04 user nova-compute[72874]:     </rng>
Aug 17 19:10:04 user nova-compute[72874]:     <controller type="usb" index="0" model="none"/>
Aug 17 19:10:04 user nova-compute[72874]:     <memballoon model="virtio">
Aug 17 19:10:04 user nova-compute[72874]:       <stats period="10"/>
Aug 17 19:10:04 user nova-compute[72874]:     </memballoon>
Aug 17 19:10:04 user nova-compute[72874]:   </devices>
Aug 17 19:10:04 user nova-compute[72874]: </domain>
Aug 17 19:10:04 user nova-compute[72874]:  {{(pid=72874) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:10:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-591671340',display_name='tempest-SnapshotDataIntegrityTests-server-591671340',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-591671340',id=52,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/p/5FDOcc+8jdtAmroH9xUpakWfv+xep87xpsse/3/M9GtOmpWUB+F7AiXgmGAikxp3ev1W+3GUtNiHnmCAXqHCFWpSgCHuKZw9PppMzOAm7jKxRoMJNdYsNsD500bAg==',key_name='tempest-keypair-128792530',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7c248e6274f46ee864e316b195ab1aa',ramdisk_id='',reservation_id='r-mgo91u6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-655632535',owner_user_name='tempest-SnapshotDataIntegrityTests-655632535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T19:10:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95f54d98e23549f2943a6c31422f8315',uuid=cd58c38d-d2fb-4553-a920-ab80bc38c749,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Converting VIF {"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7,network=Network(c24fcdda-c8de-4816-bc9d-5d582903473c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004c5cf6-8e') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG os_vif [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7,network=Network(c24fcdda-c8de-4816-bc9d-5d582903473c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004c5cf6-8e') {{(pid=72874) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap004c5cf6-8e, may_exist=True, interface_attrs={}) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap004c5cf6-8e, col_values=(('external_ids', {'iface-id': '004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:5a:4b', 'vm-uuid': 'cd58c38d-d2fb-4553-a920-ab80bc38c749'}),), if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:04 user nova-compute[72874]: INFO os_vif [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7,network=Network(c24fcdda-c8de-4816-bc9d-5d582903473c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004c5cf6-8e')
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:10:04 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] No VIF found with MAC fa:16:3e:d2:5a:4b, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:10:05 user nova-compute[72874]: DEBUG nova.network.neutron [req-464f6af1-d8a8-4904-a710-64975c8d840e req-854c170a-8357-4537-877f-941da537034f service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updated VIF entry in instance network info cache for port 004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:10:05 user nova-compute[72874]: DEBUG nova.network.neutron [req-464f6af1-d8a8-4904-a710-64975c8d840e req-854c170a-8357-4537-877f-941da537034f service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updating instance_info_cache with network_info: [{"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:10:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-464f6af1-d8a8-4904-a710-64975c8d840e req-854c170a-8357-4537-877f-941da537034f service nova] Releasing lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:10:05 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:10:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-c1045744-7c74-4e7c-ba50-71c949b27e2d req-140cc037-3e3b-4473-bff4-b5d228547a5f service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Received event network-vif-plugged-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:10:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c1045744-7c74-4e7c-ba50-71c949b27e2d req-140cc037-3e3b-4473-bff4-b5d228547a5f service nova] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:10:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c1045744-7c74-4e7c-ba50-71c949b27e2d req-140cc037-3e3b-4473-bff4-b5d228547a5f service nova] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:10:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-c1045744-7c74-4e7c-ba50-71c949b27e2d req-140cc037-3e3b-4473-bff4-b5d228547a5f service nova] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:10:06 user nova-compute[72874]: DEBUG nova.compute.manager [req-c1045744-7c74-4e7c-ba50-71c949b27e2d req-140cc037-3e3b-4473-bff4-b5d228547a5f service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] No waiting events found dispatching network-vif-plugged-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:10:06 user nova-compute[72874]: WARNING nova.compute.manager [req-c1045744-7c74-4e7c-ba50-71c949b27e2d req-140cc037-3e3b-4473-bff4-b5d228547a5f service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Received unexpected event network-vif-plugged-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 for instance with vm_state building and task_state spawning.
Aug 17 19:10:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692299408.0067978, cd58c38d-d2fb-4553-a920-ab80bc38c749 => Resumed> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:10:08 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] VM Resumed (Lifecycle Event)
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Instance event wait completed in 0 seconds for  {{(pid=72874) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Guest created on hypervisor {{(pid=72874) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 19:10:08 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Instance spawned successfully.
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Found default for hw_cdrom_bus of ide {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Found default for hw_disk_bus of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Found default for hw_input_bus of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Found default for hw_pointer_model of None {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Found default for hw_video_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Found default for hw_vif_model of virtio {{(pid=72874) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 19:10:08 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.virt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Emitting event <LifecycleEvent: 1692299408.0103745, cd58c38d-d2fb-4553-a920-ab80bc38c749 => Started> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:10:08 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] VM Started (Lifecycle Event)
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72874) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 19:10:08 user nova-compute[72874]: INFO nova.compute.manager [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 19:10:08 user nova-compute[72874]: INFO nova.compute.manager [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Took 5.97 seconds to spawn the instance on the hypervisor.
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.compute.manager [req-579943e0-4034-4f1a-a026-f289430ddf06 req-e60aff08-2934-4f1f-b8a6-9e1f3d19fd47 service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Received event network-vif-plugged-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:10:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-579943e0-4034-4f1a-a026-f289430ddf06 req-e60aff08-2934-4f1f-b8a6-9e1f3d19fd47 service nova] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:10:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-579943e0-4034-4f1a-a026-f289430ddf06 req-e60aff08-2934-4f1f-b8a6-9e1f3d19fd47 service nova] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:10:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-579943e0-4034-4f1a-a026-f289430ddf06 req-e60aff08-2934-4f1f-b8a6-9e1f3d19fd47 service nova] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:10:08 user nova-compute[72874]: DEBUG nova.compute.manager [req-579943e0-4034-4f1a-a026-f289430ddf06 req-e60aff08-2934-4f1f-b8a6-9e1f3d19fd47 service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] No waiting events found dispatching network-vif-plugged-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:10:08 user nova-compute[72874]: WARNING nova.compute.manager [req-579943e0-4034-4f1a-a026-f289430ddf06 req-e60aff08-2934-4f1f-b8a6-9e1f3d19fd47 service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Received unexpected event network-vif-plugged-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 for instance with vm_state building and task_state spawning.
Aug 17 19:10:08 user nova-compute[72874]: INFO nova.compute.manager [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Took 6.45 seconds to build instance.
Aug 17 19:10:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-26e35206-bdbc-4a81-abe1-7333c0fb90e0 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.540s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:10:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:10:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:10:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:10:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:10:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:10:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:10:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:10:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:10:55 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:10:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:10:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:10:55 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:10:55 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:10:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:10:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:10:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:10:55 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:10:56 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:10:56 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:10:56 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8798MB free_disk=25.137802124023438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:10:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:10:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:10:56 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance cd58c38d-d2fb-4553-a920-ab80bc38c749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:10:56 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:10:56 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:10:56 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:10:56 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:10:56 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:10:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.337s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:10:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:11:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:11:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:11:01 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:11:04 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:11:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:11:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:11:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:11:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:11:04 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:11:04 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:11:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:11:04 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updating instance_info_cache with network_info: [{"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:11:04 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:11:04 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:11:04 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:11:06 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:11:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:11:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:11:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:11:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:11:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:11:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:11:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:11:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:11:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:11:11 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:11:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:11:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:11:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:11:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:11:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:11:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:11:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:11:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:11:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:11:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:11:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:11:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:11:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:11:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-f6cfe7ed-d712-4719-b873-43abdfea02d8 req-b0c75b01-1862-448f-a40e-f89f45b8534a service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Received event network-changed-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:11:52 user nova-compute[72874]: DEBUG nova.compute.manager [req-f6cfe7ed-d712-4719-b873-43abdfea02d8 req-b0c75b01-1862-448f-a40e-f89f45b8534a service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Refreshing instance network info cache due to event network-changed-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7. {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 19:11:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f6cfe7ed-d712-4719-b873-43abdfea02d8 req-b0c75b01-1862-448f-a40e-f89f45b8534a service nova] Acquiring lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:11:52 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f6cfe7ed-d712-4719-b873-43abdfea02d8 req-b0c75b01-1862-448f-a40e-f89f45b8534a service nova] Acquired lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:11:52 user nova-compute[72874]: DEBUG nova.network.neutron [req-f6cfe7ed-d712-4719-b873-43abdfea02d8 req-b0c75b01-1862-448f-a40e-f89f45b8534a service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Refreshing network info cache for port 004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 19:11:53 user nova-compute[72874]: DEBUG nova.network.neutron [req-f6cfe7ed-d712-4719-b873-43abdfea02d8 req-b0c75b01-1862-448f-a40e-f89f45b8534a service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updated VIF entry in instance network info cache for port 004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7. {{(pid=72874) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 19:11:53 user nova-compute[72874]: DEBUG nova.network.neutron [req-f6cfe7ed-d712-4719-b873-43abdfea02d8 req-b0c75b01-1862-448f-a40e-f89f45b8534a service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updating instance_info_cache with network_info: [{"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:11:53 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-f6cfe7ed-d712-4719-b873-43abdfea02d8 req-b0c75b01-1862-448f-a40e-f89f45b8534a service nova] Releasing lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:11:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:11:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:11:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:11:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:11:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:11:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:11:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG nova.objects.instance [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lazy-loading 'flavor' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:11:57 user nova-compute[72874]: INFO nova.compute.manager [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Attaching volume 23d1da11-4944-4c48-940f-83a9e1f877d8 to /dev/vdb
Aug 17 19:11:57 user nova-compute[72874]: DEBUG os_brick.utils [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[316e9787-2711-440d-bf77-f6d3bfd019e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f592b543-4a1c-4626-ab02-8907e7fdfa9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f8b3c1-9a01-4b5f-a62b-ee3cf6dcbd72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ff1c10-d312-4dc9-9bd9-60088966dfd3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:11:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:11:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:11:58 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:11:58 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:11:58 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[807b2f98-d3ae-41b7-a4fe-336e0b014af2]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:11:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:11:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:11:58 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:11:58 user nova-compute[72874]: DEBUG os_brick.utils [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] <== get_connector_properties: return (433ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:11:58 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updating existing volume attachment record: 82336be8-9f6d-46ea-995b-c8e3d077545e {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:11:58 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:11:58 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:11:58 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8810MB free_disk=25.129249572753906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:11:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:11:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:11:58 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance cd58c38d-d2fb-4553-a920-ab80bc38c749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:11:58 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:11:58 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:11:58 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:11:58 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:11:58 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:11:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:11:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:02 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:12:02 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:12:03 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:12:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:05 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:12:06 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:12:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:12:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:12:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:12:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:12:06 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:12:06 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:12:06 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updating instance_info_cache with network_info: [{"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:12:06 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:12:06 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:12:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:12:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:12:07 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:12:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DiZwYHMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:12:07 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:12:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:12:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:12:07 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:12:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:12:07 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:12:07 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:12:07 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93fabd4-4c3f-4e96-8a93-1463d0a94435]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:12:08 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.173s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8611387-c9fc-4b86-a790-6a161043191e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8] added
Aug 17 19:12:08 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[df24f644-2ef5-493f-9012-0852141b3cf0]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d5ef39-5913-4e03-a014-3ebd26c25343]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DiZwYHMs {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DiZwYHMs" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[84043852-f215-46a1-a3ca-d1eb26b359ff]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DiZwYHMs'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[03dff29f-440b-445b-b941-d8a5753ce004]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[329bf8e4-a769-4033-b6bb-bcb263119706]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 19:12:08 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 19:12:08 user nova-compute[72874]:  {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:12:08 user nova-compute[72874]: WARNING os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 19:12:08 user nova-compute[72874]: 
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00633cf-13e3-4caa-a868-77e85e3b3330]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8, portal: 172.16.0.220,3260]
Aug 17 19:12:08 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8, portal: 172.16.0.220,3260] successful.
Aug 17 19:12:08 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e458f8-9d9e-41c3-95a3-da5975edeb50]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[97932216-65a2-473b-b3a9-c7b6a682ce9b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 (non-flash)
Aug 17 19:12:08 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 (non-flash)
Aug 17 19:12:08 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c92187b-be2b-408f-88b5-c7db81958350]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:08 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DiZwYHMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '26463623865623934', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463623865623934', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG nova.objects.instance [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lazy-loading 'flavor' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 19:12:09 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:12:09 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 19:12:09 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:12:09 user nova-compute[72874]:   <serial>23d1da11-4944-4c48-940f-83a9e1f877d8</serial>
Aug 17 19:12:09 user nova-compute[72874]: </disk>
Aug 17 19:12:09 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] No VIF found with MAC fa:16:3e:d2:5a:4b, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:12:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-8e465ca9-6687-403b-ac3d-6de51d2d24f8 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.299s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:12:11 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:12:11 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:12:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:12:11 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:16 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:21 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:26 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:29 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:31 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:34 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:12:39 user nova-compute[72874]: INFO nova.compute.manager [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Detaching volume 23d1da11-4944-4c48-940f-83a9e1f877d8
Aug 17 19:12:39 user nova-compute[72874]: INFO nova.virt.block_device [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Attempting to driver detach volume 23d1da11-4944-4c48-940f-83a9e1f877d8 from mountpoint /dev/vdb
Aug 17 19:12:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Attempting to detach device vdb from instance cd58c38d-d2fb-4553-a920-ab80bc38c749 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:12:39 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:12:39 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 19:12:39 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:12:39 user nova-compute[72874]:   <serial>23d1da11-4944-4c48-940f-83a9e1f877d8</serial>
Aug 17 19:12:39 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:12:39 user nova-compute[72874]: </disk>
Aug 17 19:12:39 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:12:39 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Successfully detached device vdb from instance cd58c38d-d2fb-4553-a920-ab80bc38c749 from the persistent domain config.
Aug 17 19:12:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd58c38d-d2fb-4553-a920-ab80bc38c749 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:12:39 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:12:39 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 19:12:39 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:12:39 user nova-compute[72874]:   <serial>23d1da11-4944-4c48-940f-83a9e1f877d8</serial>
Aug 17 19:12:39 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:12:39 user nova-compute[72874]: </disk>
Aug 17 19:12:39 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692299559.56998, cd58c38d-d2fb-4553-a920-ab80bc38c749 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 19:12:39 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Successfully detached device vdb from instance cd58c38d-d2fb-4553-a920-ab80bc38c749 from the live domain config.
Aug 17 19:12:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DiZwYHMs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:12:39 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ca0a5f-3c44-4986-95f7-fb2363d6ad0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca2547b-3c80-450a-8ed7-5f9e5d986117]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 (non-flash)
Aug 17 19:12:39 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 (non-flash)
Aug 17 19:12:39 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a04aa320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[21711776-68e8-421a-b5c0-e7f8fbe3d6d2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac4f140-783d-45a8-9d9f-3864bb215b80]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba38c75-2d4b-4d19-9c67-b3ac4a267b37]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a4e3fb-8ea8-4ea7-9e7e-538b219b752e]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[315f1fed-c504-42c1-b6ae-34acf30cc077]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[429e16ee-0271-40fb-8ed3-55cee02bd9b8]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8, portal: 172.16.0.220,3260]
Aug 17 19:12:39 user nova-compute[72874]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8, portal: 172.16.0.220,3260] successful.
Aug 17 19:12:39 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23d1da11-4944-4c48-940f-83a9e1f877d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f607c1-560f-4742-a685-b5542a2d8537]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.248s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] <== disconnect_volume: return (249ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:12:39 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:12:40 user nova-compute[72874]: DEBUG nova.objects.instance [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lazy-loading 'flavor' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:12:40 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-2ae134cc-dd47-4084-b126-ca60e31e8c41 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.566s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:12:44 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:12:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:12:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:12:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:12:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:12:49 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:12:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:12:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:12:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:12:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:12:54 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:59 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:12:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:12:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:12:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:12:59 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:12:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:12:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:12:59 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:12:59 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:12:59 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:12:59 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8806MB free_disk=25.127971649169922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:12:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:12:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:13:00 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance cd58c38d-d2fb-4553-a920-ab80bc38c749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:13:00 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:13:00 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:13:00 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:13:00 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:13:00 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:13:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:13:03 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:13:03 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:13:04 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:13:04 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:13:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:13:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:13:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:13:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:13:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:13:07 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:13:07 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:13:07 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updating instance_info_cache with network_info: [{"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:13:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:13:07 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:13:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:13:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:13:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:13:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:13:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:13:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:13:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:13:09 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:13:11 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:13:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:13:12 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:13:14 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:13:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:13:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:13:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:13:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:13:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:13:14 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:13:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:13:16 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 19:13:19 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:13:21 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:13:23 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:13:24 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:13:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:13:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:13:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:13:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:13:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:13:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lazy-loading 'flavor' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:13:33 user nova-compute[72874]: INFO nova.compute.manager [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Attaching volume 26b67240-e879-4fb3-a3f9-4f30d6415693 to /dev/vdb
Aug 17 19:13:33 user nova-compute[72874]: DEBUG os_brick.utils [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a434a388-1820-4b0e-9b28-91859268fc03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[330cee54-38b5-4718-b6bb-39b65a872e13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8759f9c-8f5b-4cec-b604-c2743e13ec11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5037e5-18cb-4869-b34f-d35c98e1b222]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:13:33 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:13:33 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41a0494-d8a1-4191-b6d2-1f356f5d967b]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG os_brick.utils [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:13:33 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updating existing volume attachment record: ec0dad55-d2d5-42c1-816b-5c5dc3c04612 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:13:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:13:36 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:13:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 19:13:36 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] There are 0 instances to clean {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 19:13:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:13:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtEuIGXm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:13:43 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:13:43 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:13:43 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7194323-b6a7-49c9-92ef-a1a05003f052]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:13:43 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a5fa7c-cb2c-4de7-889a-387d92369c75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693] added
Aug 17 19:13:43 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[da780d2f-c68a-4a0c-8c6f-b5d752c1d491]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b6ccfb-3e17-4d41-abaf-21fbe4a1f754]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NtEuIGXm {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NtEuIGXm" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0508a7-3319-4788-a627-c86a0e279719]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NtEuIGXm'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25c4a6a-695b-411f-8f4c-870398a9f996]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2a0c65-350b-47ce-860a-08f823f973d4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 19:13:43 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 19:13:43 user nova-compute[72874]:  {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:13:43 user nova-compute[72874]: WARNING os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 19:13:43 user nova-compute[72874]: 
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[47575f2e-fc5b-4229-b2da-3a1c3160927d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693, portal: 172.16.0.220,3260]
Aug 17 19:13:43 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693, portal: 172.16.0.220,3260] successful.
Aug 17 19:13:43 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8408a4c-b01d-4f0d-8018-92de7b10e344]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90f483e-e243-4e0b-9ae5-2b298cb087a1]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 (non-flash)
Aug 17 19:13:43 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 (non-flash)
Aug 17 19:13:43 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f1b48f-760b-4edb-aeb2-a85678502225]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:13:43 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtEuIGXm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:13:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:13:44 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23136623136333537', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:13:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136623136333537', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:13:44 user nova-compute[72874]: DEBUG nova.objects.instance [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lazy-loading 'flavor' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:13:44 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 19:13:44 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:13:44 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 19:13:44 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:13:44 user nova-compute[72874]:   <serial>26b67240-e879-4fb3-a3f9-4f30d6415693</serial>
Aug 17 19:13:44 user nova-compute[72874]: </disk>
Aug 17 19:13:44 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 19:13:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:13:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:13:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:13:45 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] No VIF found with MAC fa:16:3e:d2:5a:4b, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:13:45 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-b0be1a28-c5a9-49b4-93c4-2df79336bc20 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.234s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:13:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:13:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:13:47 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:13:47 user nova-compute[72874]: INFO nova.compute.manager [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Detaching volume 26b67240-e879-4fb3-a3f9-4f30d6415693
Aug 17 19:13:47 user nova-compute[72874]: INFO nova.virt.block_device [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Attempting to driver detach volume 26b67240-e879-4fb3-a3f9-4f30d6415693 from mountpoint /dev/vdb
Aug 17 19:13:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Attempting to detach device vdb from instance cd58c38d-d2fb-4553-a920-ab80bc38c749 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 19:13:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:13:47 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:13:47 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 19:13:47 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:13:47 user nova-compute[72874]:   <serial>26b67240-e879-4fb3-a3f9-4f30d6415693</serial>
Aug 17 19:13:47 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:13:47 user nova-compute[72874]: </disk>
Aug 17 19:13:47 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:13:47 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Successfully detached device vdb from instance cd58c38d-d2fb-4553-a920-ab80bc38c749 from the persistent domain config.
Aug 17 19:13:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd58c38d-d2fb-4553-a920-ab80bc38c749 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 19:13:47 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:13:47 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:13:47 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 19:13:47 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:13:47 user nova-compute[72874]:   <serial>26b67240-e879-4fb3-a3f9-4f30d6415693</serial>
Aug 17 19:13:47 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:13:47 user nova-compute[72874]: </disk>
Aug 17 19:13:47 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692299628.2664917, cd58c38d-d2fb-4553-a920-ab80bc38c749 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 19:13:48 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Successfully detached device vdb from instance cd58c38d-d2fb-4553-a920-ab80bc38c749 from the live domain config.
Aug 17 19:13:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NtEuIGXm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:13:48 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0333b3-bef4-461e-98e4-ed7bfd012955]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb9a6c4-df6c-4894-936f-412040d36b81]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 (non-flash)
Aug 17 19:13:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 (non-flash)
Aug 17 19:13:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a04ac0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4ba949-5b5c-4929-9b4c-f06122e1589f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[50621f4a-c886-4ded-9a61-5562d30c1385]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ec2524-b579-4798-a89f-9a64135717f9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6717304f-0324-45bf-877c-16bd1d2fad7a]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce8935f-3826-484d-8301-c697f17f9a67]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb6471d-e016-4011-8376-bece8a8f9b52]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693, portal: 172.16.0.220,3260]
Aug 17 19:13:48 user nova-compute[72874]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693, portal: 172.16.0.220,3260] successful.
Aug 17 19:13:48 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26b67240-e879-4fb3-a3f9-4f30d6415693 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb36370-5b2c-4e5a-a56c-2fb40230ea2d]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] <== disconnect_volume: return (262ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:13:48 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:13:49 user nova-compute[72874]: DEBUG nova.objects.instance [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lazy-loading 'flavor' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:13:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-17b9d3f7-5566-4937-bf42-017fcbe60347 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.691s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:13:49 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:13:49 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Triggering sync for uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 19:13:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:13:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:13:49 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:13:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:13:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:13:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:13:59 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:13:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:13:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:13:59 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:13:59 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:13:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:13:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:13:59 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:00 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:14:00 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:14:00 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8802MB free_disk=25.12692642211914GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:14:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:14:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:14:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:00 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance cd58c38d-d2fb-4553-a920-ab80bc38c749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:14:00 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:14:00 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:14:00 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing inventories for resource provider b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 19:14:00 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Updating ProviderTree inventory for provider b677d836-b01b-4674-8972-53d526f1b5f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 19:14:00 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Updating inventory in ProviderTree for provider b677d836-b01b-4674-8972-53d526f1b5f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 19:14:00 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing aggregate associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, aggregates: None {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 19:14:00 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing trait associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, traits: HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 19:14:00 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:14:00 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:14:00 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:14:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:14:03 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:14:03 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:14:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:14:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:14:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:14:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:14:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:05 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:14:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:14:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:14:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:14:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:14:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:14:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:14:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:14:08 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:14:08 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:14:08 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updating instance_info_cache with network_info: [{"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:14:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:14:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:14:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:11 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:14:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:14:13 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:14:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:14:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:14:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:14:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:14:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:14:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:14:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:14:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:14:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:14:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:14:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:14:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:14:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:14:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:14:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:14:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:14:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:14:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:14:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:14:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:14:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:14:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:14:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG nova.objects.instance [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lazy-loading 'flavor' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:14:42 user nova-compute[72874]: INFO nova.compute.manager [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Attaching volume 587b0fd7-b4e0-4c83-be39-66c541c52136 to /dev/vdb
Aug 17 19:14:42 user nova-compute[72874]: DEBUG os_brick.utils [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a964087e-7874-4ef5-8bf6-1d96f50d3ed0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8dfa5a-7b88-4288-9f50-b7921a23f215]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4476505-a9d5-45db-861e-9f4ec4442dd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dc7f3b-3d0e-4b25-965a-a98d409788fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:14:42 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:14:42 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[977545ff-11ed-4626-a0e5-ec13b5baffb1]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG os_brick.utils [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:14:42 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updating existing volume attachment record: e903676c-23de-4d54-b9f4-b02c2cdb8049 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:14:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:14:46 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgacCQNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:14:52 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:14:52 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:14:52 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fd6e34-c53f-4464-912a-3d2e2ae01524]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:14:52 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[810ea3eb-0532-4c6b-a2a6-64d9a839c133]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136] added
Aug 17 19:14:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5cb658-63b5-449b-a92b-930718927990]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3029cd-d9ab-4572-a674-aaeff5e154aa]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lgacCQNX {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lgacCQNX" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6fe27da-daf5-4028-88d9-8b68b3ca6057]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lgacCQNX'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9834e9ae-5f4c-4a9c-93a7-0398f226ecc9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[69682ade-70d2-487e-9623-a20d667123ea]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 19:14:52 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 19:14:52 user nova-compute[72874]:  {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:14:52 user nova-compute[72874]: WARNING os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 19:14:52 user nova-compute[72874]: 
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[162a5f63-fe71-4fc9-8f12-11d80c328827]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136, portal: 172.16.0.220,3260]
Aug 17 19:14:52 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136, portal: 172.16.0.220,3260] successful.
Aug 17 19:14:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[66611698-81c7-4fbd-b0c9-275ad1313268]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7ec62f-7c9a-4bd0-a829-c93bff945d09]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 (non-flash)
Aug 17 19:14:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 (non-flash)
Aug 17 19:14:52 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e112496-7e0e-4c8f-9ec8-69d25d46c239]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:14:52 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgacCQNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:14:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:14:53 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26262303436366661', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:14:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262303436366661', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:14:53 user nova-compute[72874]: DEBUG nova.objects.instance [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lazy-loading 'flavor' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:14:53 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 19:14:53 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:14:53 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 19:14:53 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:14:53 user nova-compute[72874]:   <serial>587b0fd7-b4e0-4c83-be39-66c541c52136</serial>
Aug 17 19:14:53 user nova-compute[72874]: </disk>
Aug 17 19:14:53 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 19:14:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:14:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:14:54 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] No VIF found with MAC fa:16:3e:d2:5a:4b, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:14:54 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-13634474-63cb-4495-8ee0-beb26867e138 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.988s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:14:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:56 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:14:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:14:56 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:14:56 user nova-compute[72874]: INFO nova.compute.manager [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Detaching volume 587b0fd7-b4e0-4c83-be39-66c541c52136
Aug 17 19:14:56 user nova-compute[72874]: INFO nova.virt.block_device [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Attempting to driver detach volume 587b0fd7-b4e0-4c83-be39-66c541c52136 from mountpoint /dev/vdb
Aug 17 19:14:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Attempting to detach device vdb from instance cd58c38d-d2fb-4553-a920-ab80bc38c749 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 19:14:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:14:56 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:14:56 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 19:14:56 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:14:56 user nova-compute[72874]:   <serial>587b0fd7-b4e0-4c83-be39-66c541c52136</serial>
Aug 17 19:14:56 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:14:56 user nova-compute[72874]: </disk>
Aug 17 19:14:56 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:14:56 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Successfully detached device vdb from instance cd58c38d-d2fb-4553-a920-ab80bc38c749 from the persistent domain config.
Aug 17 19:14:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd58c38d-d2fb-4553-a920-ab80bc38c749 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 19:14:56 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:14:56 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:14:56 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 19:14:56 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:14:56 user nova-compute[72874]:   <serial>587b0fd7-b4e0-4c83-be39-66c541c52136</serial>
Aug 17 19:14:56 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:14:56 user nova-compute[72874]: </disk>
Aug 17 19:14:56 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692299697.3862755, cd58c38d-d2fb-4553-a920-ab80bc38c749 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 19:14:57 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Successfully detached device vdb from instance cd58c38d-d2fb-4553-a920-ab80bc38c749 from the live domain config.
Aug 17 19:14:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgacCQNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:14:57 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0444650-c9f5-463c-a5d8-9cb44fe918cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[112e8472-1404-436e-82f4-d812648044ad]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 (non-flash)
Aug 17 19:14:57 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 (non-flash)
Aug 17 19:14:57 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a04ad2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a47b26-42f3-4cca-8947-1ab687e0749a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d94be72-8447-45a3-8dd2-242333ba886b]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca9102a-4bfb-4642-a927-22d07cde3034]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc5a0cf-994c-4302-90fb-c7d9524d3a8c]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b0c237-2e65-41fc-98ab-1c1dbe54a77a]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c16db0-3338-4da2-858d-e3365082d1c5]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136, portal: 172.16.0.220,3260]
Aug 17 19:14:57 user nova-compute[72874]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136, portal: 172.16.0.220,3260] successful.
Aug 17 19:14:57 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:587b0fd7-b4e0-4c83-be39-66c541c52136 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc143f7-4c03-43ea-a8f6-71e40a3be153]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] <== disconnect_volume: return (262ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:14:57 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:14:58 user nova-compute[72874]: DEBUG nova.objects.instance [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lazy-loading 'flavor' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:14:58 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-481e06e3-54b9-44ca-8042-1b6bd9446045 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.584s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:15:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:15:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:15:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:15:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:15:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:15:00 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:15:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:15:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:15:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:15:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:15:00 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:15:00 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:15:00 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8796MB free_disk=25.125934600830078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:15:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:15:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:15:01 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance cd58c38d-d2fb-4553-a920-ab80bc38c749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:15:01 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:15:01 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:15:01 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:15:01 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:15:01 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:15:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:15:01 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:15:04 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:15:04 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:15:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:15:05 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:15:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:15:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:15:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:15:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:15:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:15:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:15:08 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:15:08 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:15:08 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updating instance_info_cache with network_info: [{"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:15:08 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:15:08 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:15:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:15:10 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:15:12 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:15:12 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:15:14 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:15:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:15:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:15:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:15:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:15:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:15:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:15:17 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:15:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:15:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:15:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:15:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:15:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:15:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:15:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:15:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:15:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:15:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:15:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:15:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:15:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:15:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:15:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:15:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:15:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:15:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:15:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:15:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:15:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:15:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:15:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:15:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:15:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:15:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:15:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:15:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:15:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:15:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:15:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:15:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:15:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:15:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:15:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:15:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:15:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG nova.objects.instance [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lazy-loading 'flavor' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:15:51 user nova-compute[72874]: INFO nova.compute.manager [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Attaching volume 5c46dd84-b03d-4e12-9957-b26c09b7d456 to /dev/vdb
Aug 17 19:15:51 user nova-compute[72874]: DEBUG os_brick.utils [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec3b988-94db-4a28-ab5e-673ae958540f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:2a7ff38e56a\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e44d23-9f04-429b-b989-7022a62605d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f42193-4f6c-4c3d-944e-da0fd5351165]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d399bf47-8178-4e49-8024-92f71e102725]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Running cmd (subprocess): nvme version {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] 'nvme version' failed. Not Retrying. {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] nvme not present on system {{(pid=72874) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 19:15:51 user nova-compute[72874]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 19:15:51 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[49dfa8ae-0e5c-4a93-b223-79e11a010c6c]: (4, '') {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72874) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.lightos [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] LIGHTOS: no hostnqn found. {{(pid=72874) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG os_brick.utils [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:2a7ff38e56a', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:15:51 user nova-compute[72874]: DEBUG nova.virt.block_device [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updating existing volume attachment record: 27e9a3d5-11eb-45d4-ba2a-0dd1ff911ed1 {{(pid=72874) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 19:15:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:16:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:16:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:16:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:16:00 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:16:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:16:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:16:00 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:16:00 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:16:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:00 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:00 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:16:00 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:16:01 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.125171661376953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance cd58c38d-d2fb-4553-a920-ab80bc38c749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Calling os-brick to attach iSCSI Volume {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHTYcudS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:16:01 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:16:01 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:16:01 user nova-compute[72874]: INFO os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b6cdc6-92cc-438b-b8d9-aa5fb0bb7846]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 19:16:01 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --interface default --op new {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6b990a-9424-4d67-a7db-751a129a0742]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456] added\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456] added
Aug 17 19:16:01 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e94d73a-1ad4-40dc-9553-5828c377c6a9]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dfdb6d-2204-43d2-8f43-6993ce86cdbd]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHTYcudS {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHTYcudS" returned: 0 in 0.017s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[4caa2c5d-0314-4437-b1b7-16797185ec9e]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vHTYcudS'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f19524d-087c-4a50-b069-de7f728b4707]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74553a9-d65b-4c2f-b9de-b2b24f562dcc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 19:16:01 user nova-compute[72874]:  {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 19:16:01 user nova-compute[72874]:  {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:16:01 user nova-compute[72874]: WARNING os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 19:16:01 user nova-compute[72874]: 
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --login {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc193ffe-634e-4b78-bd74-d5af70c9d656]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456, portal: 172.16.0.220,3260]
Aug 17 19:16:01 user nova-compute[72874]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456, portal: 172.16.0.220,3260] successful.
Aug 17 19:16:01 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[abecb879-1e65-4b0e-a7e9-06239925a297]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dcab68-358c-4727-97a5-f7c8949a71e8]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 (non-flash)
Aug 17 19:16:01 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 (non-flash)
Aug 17 19:16:01 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Connected to 172.16.0.220:3260 {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=72874) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72874) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa6299e-fa99-4c0e-8706-03e795e6f734]: (4, ('- - 0', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:01 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:16:02 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72874) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 19:16:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHTYcudS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72874) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 19:16:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:16:02 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23265333332333836', 'path': '/dev/sdb'} {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:16:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265333332333836', 'path': '/dev/sdb'} {{(pid=72874) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 19:16:02 user nova-compute[72874]: DEBUG nova.objects.instance [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lazy-loading 'flavor' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:16:02 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 19:16:02 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:16:02 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 19:16:02 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:16:02 user nova-compute[72874]:   <serial>5c46dd84-b03d-4e12-9957-b26c09b7d456</serial>
Aug 17 19:16:02 user nova-compute[72874]: </disk>
Aug 17 19:16:02 user nova-compute[72874]:  {{(pid=72874) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 19:16:03 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] No BDM found with device name vda, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:16:03 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72874) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 19:16:03 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] No VIF found with MAC fa:16:3e:d2:5a:4b, not building metadata {{(pid=72874) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 19:16:03 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1b14c1b6-0076-4fd0-bc9e-f98ae227c862 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.234s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:16:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:16:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:16:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:16:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:16:05 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:16:05 user nova-compute[72874]: INFO nova.compute.manager [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Detaching volume 5c46dd84-b03d-4e12-9957-b26c09b7d456
Aug 17 19:16:05 user nova-compute[72874]: INFO nova.virt.block_device [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Attempting to driver detach volume 5c46dd84-b03d-4e12-9957-b26c09b7d456 from mountpoint /dev/vdb
Aug 17 19:16:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Attempting to detach device vdb from instance cd58c38d-d2fb-4553-a920-ab80bc38c749 from the persistent domain config. {{(pid=72874) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 19:16:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:16:05 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:16:05 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 19:16:05 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:16:05 user nova-compute[72874]:   <serial>5c46dd84-b03d-4e12-9957-b26c09b7d456</serial>
Aug 17 19:16:05 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:16:05 user nova-compute[72874]: </disk>
Aug 17 19:16:05 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:16:05 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Successfully detached device vdb from instance cd58c38d-d2fb-4553-a920-ab80bc38c749 from the persistent domain config.
Aug 17 19:16:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd58c38d-d2fb-4553-a920-ab80bc38c749 from the live domain config. {{(pid=72874) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 19:16:05 user nova-compute[72874]: DEBUG nova.virt.libvirt.guest [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 19:16:05 user nova-compute[72874]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 19:16:05 user nova-compute[72874]:   <source dev="/dev/sdb"/>
Aug 17 19:16:05 user nova-compute[72874]:   <target dev="vdb" bus="virtio"/>
Aug 17 19:16:05 user nova-compute[72874]:   <serial>5c46dd84-b03d-4e12-9957-b26c09b7d456</serial>
Aug 17 19:16:05 user nova-compute[72874]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 19:16:05 user nova-compute[72874]: </disk>
Aug 17 19:16:05 user nova-compute[72874]:  {{(pid=72874) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-5ab4ee83-2751-40e8-a377-35df96116b44 None None] Received event <DeviceRemovedEvent: 1692299766.1832664, cd58c38d-d2fb-4553-a920-ab80bc38c749 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72874) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.driver [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 19:16:06 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Successfully detached device vdb from instance cd58c38d-d2fb-4553-a920-ab80bc38c749 from the live domain config.
Aug 17 19:16:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] calling os-brick to detach iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fc6c07868c0>, {'target_iqns': ['iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHTYcudS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 19:16:06 user nova-compute[72874]: WARNING os_brick.initiator.connectors.base [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456', 0)] {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a96b004-9924-46f2-8154-a1ec74e8a9b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb03078-e4c9-46e5-a945-d954485b6fbc]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 (non-flash)\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 (non-flash)
Aug 17 19:16:06 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 (non-flash)
Aug 17 19:16:06 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fc6a050b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456'): ({'sdb'}, set())}) {{(pid=72874) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Removing single pathed devices sdb {{(pid=72874) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e03607-950c-4eb7-b8cb-559b1c2bba35]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[287f6562-482d-4ec9-80a9-b8d983c5dc2d]: (4, ('ok\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Flushing IO for device /dev/sdb {{(pid=72874) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39076d9-55fc-4888-b41f-cdef64460442]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72874) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c676de1-a517-4e22-8c81-736f8c62a97c]: (4, ('1', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.linuxscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] SCSI volumes sdb have been removed. {{(pid=72874) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456')] {{(pid=72874) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a477fc-ecfc-439f-8584-7f0e18417b1f]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --logout {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a9b325-483b-4bd4-8b9b-d07d5d6df2ea]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456, portal: 172.16.0.220,3260]
Aug 17 19:16:06 user nova-compute[72874]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456, portal: 172.16.0.220,3260] successful.
Aug 17 19:16:06 user nova-compute[72874]:  stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --op delete {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c46dd84-b03d-4e12-9957-b26c09b7d456 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83588) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27c5384-066f-4cf3-9b0b-08e969db5561]: (4, ('', '')) {{(pid=83588) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72874) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.base [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG os_brick.initiator.connectors.iscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] <== disconnect_volume: return (260ms) None {{(pid=72874) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Disconnected iSCSI Volume {{(pid=72874) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 19:16:06 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:16:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:16:07 user nova-compute[72874]: DEBUG nova.objects.instance [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lazy-loading 'flavor' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:16:07 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-eeec9a8b-9696-45e0-acf3-ee1261ada0d7 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.543s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:16:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:16:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:16:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:16:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:16:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:16:09 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:16:09 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:16:09 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updating instance_info_cache with network_info: [{"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:16:09 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:16:09 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:16:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:16:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:16:12 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:16:13 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:16:13 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:16:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:15 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:16:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:16:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:16:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:16:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:16:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:16:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:16:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:16:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:16:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:45 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:16:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:50 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:16:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:16:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:16:55 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:17:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:17:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:17:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:17:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:17:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:17:00 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:17:01 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:17:01 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 19:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.processutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72874) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 19:17:01 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:17:01 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:17:01 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=25.124248504638672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:17:01 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:17:02 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Instance cd58c38d-d2fb-4553-a920-ab80bc38c749 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72874) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 19:17:02 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:17:02 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:17:02 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:17:02 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:17:02 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:17:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:17:05 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:17:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:17:07 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:17:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:17:09 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:17:10 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:17:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:17:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:17:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:17:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:17:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:17:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:17:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:17:10 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:17:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 19:17:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquired lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 19:17:10 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Forcefully refreshing network info cache for instance {{(pid=72874) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 19:17:10 user nova-compute[72874]: DEBUG nova.objects.instance [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lazy-loading 'info_cache' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:17:10 user nova-compute[72874]: DEBUG nova.network.neutron [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updating instance_info_cache with network_info: [{"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:17:10 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Releasing lock "refresh_cache-cd58c38d-d2fb-4553-a920-ab80bc38c749" {{(pid=72874) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 19:17:10 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updated the network info_cache for instance {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 19:17:12 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:17:13 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:17:13 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:17:15 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:17:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:17:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:17:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:17:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:17:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:17:15 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:17:18 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:17:20 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:17:25 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:17:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:17:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:17:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:17:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:17:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:17:30 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:17:35 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:17:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:17:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:17:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72874) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 19:17:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:17:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72874) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 19:17:40 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:17:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:17:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:17:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:17:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:17:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:17:42 user nova-compute[72874]: INFO nova.compute.manager [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Terminating instance
Aug 17 19:17:42 user nova-compute[72874]: DEBUG nova.compute.manager [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Start destroying the instance on the hypervisor. {{(pid=72874) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 19:17:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:17:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:17:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:17:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:17:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-925079c1-c67d-45b0-9715-8ca49d9179b0 req-b81c33fc-2092-4e8b-9db7-a5736a49739a service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Received event network-vif-unplugged-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:17:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-925079c1-c67d-45b0-9715-8ca49d9179b0 req-b81c33fc-2092-4e8b-9db7-a5736a49739a service nova] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:17:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-925079c1-c67d-45b0-9715-8ca49d9179b0 req-b81c33fc-2092-4e8b-9db7-a5736a49739a service nova] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:17:42 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-925079c1-c67d-45b0-9715-8ca49d9179b0 req-b81c33fc-2092-4e8b-9db7-a5736a49739a service nova] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:17:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-925079c1-c67d-45b0-9715-8ca49d9179b0 req-b81c33fc-2092-4e8b-9db7-a5736a49739a service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] No waiting events found dispatching network-vif-unplugged-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:17:42 user nova-compute[72874]: DEBUG nova.compute.manager [req-925079c1-c67d-45b0-9715-8ca49d9179b0 req-b81c33fc-2092-4e8b-9db7-a5736a49739a service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Received event network-vif-unplugged-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 for instance with task_state deleting. {{(pid=72874) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 19:17:42 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:17:43 user nova-compute[72874]: INFO nova.virt.libvirt.driver [-] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Instance destroyed successfully.
Aug 17 19:17:43 user nova-compute[72874]: DEBUG nova.objects.instance [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lazy-loading 'resources' on Instance uuid cd58c38d-d2fb-4553-a920-ab80bc38c749 {{(pid=72874) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 19:17:43 user nova-compute[72874]: DEBUG nova.virt.libvirt.vif [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T19:10:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-591671340',display_name='tempest-SnapshotDataIntegrityTests-server-591671340',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-591671340',id=52,image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/p/5FDOcc+8jdtAmroH9xUpakWfv+xep87xpsse/3/M9GtOmpWUB+F7AiXgmGAikxp3ev1W+3GUtNiHnmCAXqHCFWpSgCHuKZw9PppMzOAm7jKxRoMJNdYsNsD500bAg==',key_name='tempest-keypair-128792530',keypairs=<?>,launch_index=0,launched_at=2023-08-17T19:10:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7c248e6274f46ee864e316b195ab1aa',ramdisk_id='',reservation_id='r-mgo91u6s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7fe37517-c232-4d7a-939d-c3edde21bc31',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-655632535',owner_user_name='tempest-SnapshotDataIntegrityTests-655632535-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T19:10:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95f54d98e23549f2943a6c31422f8315',uuid=cd58c38d-d2fb-4553-a920-ab80bc38c749,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 19:17:43 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Converting VIF {"id": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "address": "fa:16:3e:d2:5a:4b", "network": {"id": "c24fcdda-c8de-4816-bc9d-5d582903473c", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-167846790-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7c248e6274f46ee864e316b195ab1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap004c5cf6-8e", "ovs_interfaceid": "004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 19:17:43 user nova-compute[72874]: DEBUG nova.network.os_vif_util [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7,network=Network(c24fcdda-c8de-4816-bc9d-5d582903473c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004c5cf6-8e') {{(pid=72874) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 19:17:43 user nova-compute[72874]: DEBUG os_vif [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7,network=Network(c24fcdda-c8de-4816-bc9d-5d582903473c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004c5cf6-8e') {{(pid=72874) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 19:17:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:17:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap004c5cf6-8e, bridge=br-int, if_exists=True) {{(pid=72874) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 19:17:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:17:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:17:43 user nova-compute[72874]: INFO os_vif [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:5a:4b,bridge_name='br-int',has_traffic_filtering=True,id=004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7,network=Network(c24fcdda-c8de-4816-bc9d-5d582903473c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap004c5cf6-8e')
Aug 17 19:17:43 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Deleting instance files /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749_del
Aug 17 19:17:43 user nova-compute[72874]: INFO nova.virt.libvirt.driver [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Deletion of /opt/stack/data/nova/instances/cd58c38d-d2fb-4553-a920-ab80bc38c749_del complete
Aug 17 19:17:43 user nova-compute[72874]: INFO nova.compute.manager [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 19:17:43 user nova-compute[72874]: DEBUG oslo.service.loopingcall [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72874) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 19:17:43 user nova-compute[72874]: DEBUG nova.compute.manager [-] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Deallocating network for instance {{(pid=72874) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 19:17:43 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] deallocate_for_instance() {{(pid=72874) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 19:17:44 user nova-compute[72874]: DEBUG nova.network.neutron [-] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Updating instance_info_cache with network_info: [] {{(pid=72874) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 19:17:44 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Took 1.49 seconds to deallocate network for instance.
Aug 17 19:17:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:17:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:17:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-38dad6af-a371-4049-a03e-069f49c835b2 req-58a31f35-48c1-4d9e-b12a-7760f45cc1ba service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Received event network-vif-deleted-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:17:44 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:17:44 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:17:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.117s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:17:44 user nova-compute[72874]: INFO nova.scheduler.client.report [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Deleted allocations for instance cd58c38d-d2fb-4553-a920-ab80bc38c749
Aug 17 19:17:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-d25d3b74-5979-421b-a215-60cb4e7f5238 req-2dd3155b-d2e7-4590-ba62-2319069e0640 service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Received event network-vif-plugged-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 {{(pid=72874) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 19:17:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d25d3b74-5979-421b-a215-60cb4e7f5238 req-2dd3155b-d2e7-4590-ba62-2319069e0640 service nova] Acquiring lock "cd58c38d-d2fb-4553-a920-ab80bc38c749-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:17:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d25d3b74-5979-421b-a215-60cb4e7f5238 req-2dd3155b-d2e7-4590-ba62-2319069e0640 service nova] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:17:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [req-d25d3b74-5979-421b-a215-60cb4e7f5238 req-2dd3155b-d2e7-4590-ba62-2319069e0640 service nova] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:17:44 user nova-compute[72874]: DEBUG nova.compute.manager [req-d25d3b74-5979-421b-a215-60cb4e7f5238 req-2dd3155b-d2e7-4590-ba62-2319069e0640 service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] No waiting events found dispatching network-vif-plugged-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 {{(pid=72874) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 19:17:44 user nova-compute[72874]: WARNING nova.compute.manager [req-d25d3b74-5979-421b-a215-60cb4e7f5238 req-2dd3155b-d2e7-4590-ba62-2319069e0640 service nova] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Received unexpected event network-vif-plugged-004c5cf6-8e98-4a2d-9aa9-7618dc70a5b7 for instance with vm_state deleted and task_state None.
Aug 17 19:17:44 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-1948784b-9f47-4999-adc3-c10c3fac3b99 tempest-SnapshotDataIntegrityTests-655632535 tempest-SnapshotDataIntegrityTests-655632535-project-member] Lock "cd58c38d-d2fb-4553-a920-ab80bc38c749" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.712s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:17:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:17:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:17:58 user nova-compute[72874]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692299863.0196762, cd58c38d-d2fb-4553-a920-ab80bc38c749 => Stopped> {{(pid=72874) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 19:17:58 user nova-compute[72874]: INFO nova.compute.manager [-] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] VM Stopped (Lifecycle Event)
Aug 17 19:17:58 user nova-compute[72874]: DEBUG nova.compute.manager [None req-615ad55c-58b9-4301-b774-fe8364d5159f None None] [instance: cd58c38d-d2fb-4553-a920-ab80bc38c749] Checking state {{(pid=72874) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 19:17:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:18:02 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:18:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:18:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:18:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:18:02 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:18:02 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:18:02 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:18:02 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=8950MB free_disk=25.15134048461914GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:18:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:18:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:18:02 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:18:02 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:18:02 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:18:02 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:18:02 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:18:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:18:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:18:06 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:18:08 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:18:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:18:08 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:18:11 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:18:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Starting heal instance info cache {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 19:18:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Rebuilding the list of instances to heal {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 19:18:11 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Didn't find any instances for network info cache update. {{(pid=72874) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 19:18:11 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:18:13 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:18:13 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:18:13 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:18:13 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72874) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 19:18:16 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:18:18 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:18:21 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:18:23 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:18:24 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:18:24 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72874) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 19:18:28 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:18:32 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:18:33 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:18:36 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:18:37 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:18:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Cleaning up deleted instances {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 19:18:37 user nova-compute[72874]: DEBUG nova.compute.manager [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] There are 0 instances to clean {{(pid=72874) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 19:18:38 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:18:39 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:18:43 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:18:48 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:18:53 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 19:18:58 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG oslo_service.periodic_task [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72874) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Auditing locally available compute resources for user (node: user) {{(pid=72874) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 19:19:02 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:19:02 user nova-compute[72874]: WARNING nova.virt.libvirt.driver [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 19:19:02 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Hypervisor/Node resource view: name=user free_ram=9087MB free_disk=25.120059967041016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72874) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72874) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing inventories for resource provider b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Updating ProviderTree inventory for provider b677d836-b01b-4674-8972-53d526f1b5f7 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Updating inventory in ProviderTree for provider b677d836-b01b-4674-8972-53d526f1b5f7 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing aggregate associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, aggregates: None {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Refreshing trait associations for resource provider b677d836-b01b-4674-8972-53d526f1b5f7, traits: HW_CPU_X86_SSE42,COMPUTE_VOLUME_EXTEND,COMPUTE_STORAGE_BUS_SATA,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE2,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE41,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_VIRTIO {{(pid=72874) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG nova.compute.provider_tree [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed in ProviderTree for provider: b677d836-b01b-4674-8972-53d526f1b5f7 {{(pid=72874) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG nova.scheduler.client.report [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Inventory has not changed for provider b677d836-b01b-4674-8972-53d526f1b5f7 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72874) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG nova.compute.resource_tracker [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Compute_service record updated for user:user {{(pid=72874) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 19:19:02 user nova-compute[72874]: DEBUG oslo_concurrency.lockutils [None req-16752f2c-9f9d-4a39-a01f-70e3dc908018 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=72874) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 19:19:03 user nova-compute[72874]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72874) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}